Sep 10 20:52:33 devstack cinder-volume[74756]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=74756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} Sep 10 20:52:33 devstack cinder-volume[74756]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=74756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} Sep 10 20:52:33 devstack cinder-volume[74756]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=74756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} Sep 10 20:52:34 devstack cinder-volume[74756]: INFO dbcounter [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] Registered counter for database cinder Sep 10 20:52:34 devstack cinder-volume[74756]: DEBUG oslo_db.sqlalchemy.engines [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74756) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 10 20:52:35 devstack cinder-volume[74756]: DEBUG dbcounter [-] [74756] Writer thread running {{(pid=74756) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Sep 10 20:52:35 devstack cinder-volume[74756]: INFO cinder.rpc [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 10 20:52:35 devstack cinder-volume[74756]: INFO cinder.rpc [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 10 20:52:35 devstack cinder-volume[74756]: DEBUG oslo_db.sqlalchemy.engines [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74756) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 10 20:52:35 devstack cinder-volume[74756]: INFO cinder.volume.manager [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] Determined volume DB was empty at startup. Sep 10 20:52:35 devstack cinder-volume[74756]: DEBUG cinder.volume.manager [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=74756) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Sep 10 20:52:35 devstack cinder-volume[74756]: INFO cinder.volume.manager [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 10 20:52:35 devstack cinder-volume[74756]: WARNING stevedore.named [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 10 20:52:35 devstack cinder-volume[74756]: WARNING castellan.key_manager [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 10 20:52:35 devstack cinder-volume[74756]: WARNING cinder.keymgr.conf_key_mgr [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 10 20:52:35 devstack cinder-volume[74756]: DEBUG cinder.volume.drivers.lvm [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=74756) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Sep 10 20:52:35 devstack cinder-volume[74756]: DEBUG oslo_concurrency.processutils [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=74756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 20:52:36 devstack cinder-volume[74756]: DEBUG oslo_concurrency.processutils [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] CMD "cinder-rtstool verify" returned: 0 in 1.029s {{(pid=74756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 20:52:36 devstack cinder-volume[74756]: DEBUG oslo_db.sqlalchemy.engines [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74756) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 10 20:52:36 devstack cinder-volume[74756]: INFO cinder.rpc [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 10 20:52:36 devstack cinder-volume[74756]: INFO cinder.rpc [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 10 20:52:36 devstack cinder-volume[74756]: WARNING stevedore.named [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 10 20:52:36 devstack cinder-volume[74756]: WARNING castellan.key_manager [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 10 20:52:36 devstack cinder-volume[74756]: INFO cinder.volume.manager [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 10 20:52:36 devstack cinder-volume[74756]: DEBUG oslo_db.sqlalchemy.engines [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74756) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 10 20:52:37 devstack cinder-volume[74756]: INFO oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] Starting 1 workers Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] Started child 74854 {{(pid=74756) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}} Sep 10 20:52:37 devstack cinder-volume[74854]: INFO cinder.service [-] Starting cinder-volume node (version 26.1.0) Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] Full set of CONF: {{(pid=74756) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] ******************************************************************************** {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] Configuration options gathered from: {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] ================================================================================ {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] allow_availability_zone_fallback = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] allow_compression_on_image_upload = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] allowed_direct_url_schemes = [] {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] api_rate_limit = True {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] auth_strategy = keystone {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] az_cache_duration = 3600 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backend_availability_zone = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backend_host = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backend_name = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backend_stats_polling_interval = 60 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backup_api_class = cinder.backup.api.API {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backup_name_template = backup-%s {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backup_use_same_host = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backup_use_temp_snapshot = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] chap_password = **** {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] chap_username = {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] cinder_internal_tenant_project_id = e91b0372797e44e88c001e972f3b491a {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] cinder_internal_tenant_user_id = ca0d4e41d48b4aa985382270977fda16 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] cloned_volume_same_az = True {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] cluster = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] compression_format = gzip {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] compute_api_class = cinder.compute.nova.API {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] config_dir = [] {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] config_source = [] {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] control_exchange = openstack {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] debug = True {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] default_availability_zone = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] default_group_type = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] default_volume_type = lvmdriver-1 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] driver_client_cert = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] driver_client_cert_key = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] driver_data_namespace = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] driver_ssl_cert_path = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] driver_ssl_cert_verify = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] driver_use_ssl = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] enable_force_upload = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] enable_new_services = True {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] enable_unsupported_driver = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] enabled_backends = ['lvmdriver-1'] {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] enforce_multipath_for_image_xfer = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] filter_function = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] glance_api_insecure = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] glance_api_servers = ['http://192.168.122.32/image'] {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] glance_api_ssl_compression = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] glance_ca_certificates_file = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] glance_catalog_info = image:glance:publicURL {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] glance_certfile = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] glance_keyfile = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] glance_num_retries = 3 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] glance_request_timeout = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] goodness_function = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] graceful_shutdown_timeout = 5 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] group_api_class = cinder.group.api.API {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] host = devstack {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] image_compress_on_upload = True {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] image_conversion_address_space_limit = 1 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] image_conversion_cpu_limit = 60 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] image_conversion_disable = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] image_upload_use_cinder_backend = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] image_upload_use_internal_tenant = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] image_volume_cache_enabled = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] image_volume_cache_max_count = 0 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] image_volume_cache_max_size_gb = 0 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] init_host_max_objects_retrieval = 0 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] instance_format = [instance: %(uuid)s] {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] iscsi_iotype = fileio {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] iscsi_target_flags = {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] iscsi_write_cache = on {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] iser_helper = tgtadm {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] iser_ip_address = 192.168.122.32 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] iser_port = 3260 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] log_color = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] log_config_append = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] log_dir = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] log_file = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] log_options = True {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] log_rotate_interval = 1 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] log_rotate_interval_type = days {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] log_rotation_type = none {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] max_age = 0 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] max_logfile_count = 30 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] max_logfile_size_mb = 200 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] max_over_subscription_ratio = 20.0 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] message_reap_interval = 86400 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] message_ttl = 2592000 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] migration_create_volume_timeout_secs = 300 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] monkey_patch = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] monkey_patch_modules = [] {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] my_ip = 192.168.122.32 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] no_snapshot_gb_quota = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] num_iser_scan_tries = 3 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] num_shell_tries = 3 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] num_volume_device_scan_tries = 3 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] nvmeof_conn_info_version = 1 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] nvmet_ns_id = 10 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] nvmet_port_id = 1 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] osapi_max_limit = 1000 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] osapi_volume_ext_list = [] {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] osapi_volume_listen = 0.0.0.0 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] osapi_volume_listen_port = 8776 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] osapi_volume_use_ssl = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] osapi_volume_workers = 2 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] per_volume_size_limit = -1 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] periodic_fuzzy_delay = 60 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] periodic_interval = 60 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] project_id_regex = [0-9a-f\-]+ {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] public_endpoint = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] publish_errors = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] quota_backup_gigabytes = 1000 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] quota_backups = 10 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] quota_gigabytes = 1000 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] quota_groups = 10 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] quota_snapshots = 10 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] quota_volumes = 10 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] rate_limit_burst = 0 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] rate_limit_except_level = CRITICAL {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] rate_limit_interval = 0 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] reinit_driver_count = 3 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] replication_device = **** {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] report_discard_supported = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] report_interval = 120 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] reservation_clean_interval = 86400 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] reservation_expire = 86400 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] reserved_image_namespaces = [] {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] reserved_percentage = 0 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] rpc_response_timeout = 120 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] run_external_periodic_tasks = True {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] scst_target_driver = iscsi {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] scst_target_iqn_name = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] service_down_time = 720 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] shell_completion = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] snapshot_name_template = snapshot-%s {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] snapshot_same_host = True {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] split_loggers = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] state_path = /opt/stack/data/cinder {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] storage_availability_zone = nova {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] storage_protocol = iSCSI {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] syslog_log_facility = LOG_USER {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] target_helper = lioadm {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] target_ip_address = 192.168.122.32 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] target_port = 3260 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] target_protocol = iscsi {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] target_secondary_ip_addresses = [] {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] trace_flags = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] transfer_api_class = cinder.transfer.api.API {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] transport_url = **** {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] until_refresh = 0 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] use_chap_auth = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] use_default_quota_class = True {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] use_journal = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] use_json = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] use_multipath_for_image_xfer = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] use_stderr = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] use_syslog = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] verify_glance_signatures = enabled {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] volume_api_class = cinder.volume.api.API {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] volume_backend_name = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] volume_clear = zero {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] volume_clear_ionice = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] volume_clear_size = 0 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] volume_copy_bps_limit = 0 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] volume_dd_blocksize = 1M {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] volume_name_template = volume-%s {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] volume_service_inithost_offload = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] volume_usage_audit_period = month {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] watch_log_file = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] zoning_mode = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] os_brick.lock_path = /opt/stack/data/cinder {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] oslo_concurrency.disable_process_locking = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] keystone_authtoken.admin_password = **** {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] keystone_authtoken.admin_token = **** {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] keystone_authtoken.admin_user = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] keystone_authtoken.auth_admin_prefix = {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] keystone_authtoken.auth_port = 35357 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] keystone_authtoken.auth_protocol = https {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] keystone_authtoken.auth_section = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] keystone_authtoken.auth_type = password {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] keystone_authtoken.auth_uri = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] keystone_authtoken.auth_version = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] keystone_authtoken.cache = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] keystone_authtoken.certfile = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] keystone_authtoken.delay_auth_decision = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] keystone_authtoken.http_connect_timeout = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] keystone_authtoken.identity_uri = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] keystone_authtoken.include_service_catalog = True {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] keystone_authtoken.insecure = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] keystone_authtoken.interface = public {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] keystone_authtoken.keyfile = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] keystone_authtoken.memcache_password = {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] keystone_authtoken.memcache_username = {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] keystone_authtoken.region_name = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] keystone_authtoken.service_token_roles_required = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] keystone_authtoken.service_type = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] keystone_authtoken.token_cache_time = 300 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] cache.backend = dogpile.cache.null {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] cache.backend_argument = **** {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] cache.backend_expiration_time = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] cache.config_prefix = cache.oslo {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] cache.dead_timeout = 60.0 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] cache.debug_cache_backend = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] cache.enable_retry_client = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] cache.enable_socket_keepalive = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] cache.enabled = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] cache.enforce_fips_mode = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] cache.expiration_time = 600 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] cache.hashclient_retry_attempts = 2 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] cache.hashclient_retry_delay = 1.0 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] cache.memcache_dead_retry = 300 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] cache.memcache_password = **** {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] cache.memcache_pool_maxsize = 10 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] cache.memcache_sasl_enabled = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] cache.memcache_socket_timeout = 1.0 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] cache.memcache_username = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] cache.proxies = [] {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] cache.redis_db = 0 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] cache.redis_password = **** {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] cache.redis_sentinel_service_name = mymaster {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] cache.redis_server = localhost:6379 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] cache.redis_socket_timeout = 1.0 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] cache.redis_username = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] cache.retry_attempts = 2 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] cache.retry_delay = 0.0 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] cache.socket_keepalive_count = 1 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] cache.socket_keepalive_idle = 1 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] cache.socket_keepalive_interval = 1 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] cache.tls_allowed_ciphers = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] cache.tls_cafile = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] cache.tls_certfile = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] cache.tls_enabled = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] cache.tls_keyfile = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] coordination.backend_url = **** {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] database.asyncio_connection = **** {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] database.asyncio_slave_connection = **** {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] database.backend = sqlalchemy {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] database.connection = **** {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] database.connection_debug = 0 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] database.connection_parameters = {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] database.connection_recycle_time = 3600 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] database.connection_trace = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] database.db_inc_retry_interval = True {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] database.db_max_retries = 20 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] database.db_max_retry_interval = 10 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] database.db_retry_interval = 1 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] database.max_overflow = 50 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] database.max_pool_size = 5 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] database.max_retries = 10 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] database.mysql_wsrep_sync_wait = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] database.pool_timeout = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] database.retry_interval = 10 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] database.slave_connection = **** {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] database.sqlite_synchronous = True {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] database.use_db_reconnect = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] profiler.connection_string = messaging:// {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] profiler.enabled = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] profiler.es_doc_type = notification {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] profiler.es_scroll_size = 10000 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] profiler.es_scroll_time = 2m {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] profiler.filter_error_trace = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] profiler.hmac_keys = **** {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74854]: INFO cinder.volume.manager [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] profiler.sentinel_service_name = mymaster {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] profiler.socket_timeout = 0.1 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] profiler.trace_requests = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] profiler.trace_sqlalchemy = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] profiler_jaeger.process_tags = {} {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] profiler_jaeger.service_name_prefix = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] profiler_otlp.service_name_prefix = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] oslo_policy.enforce_new_defaults = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 20:52:37 devstack cinder-volume[74756]: WARNING oslo_config.cfg [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] oslo_policy.enforce_scope = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] oslo_policy.policy_default_rule = default {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] oslo_policy.policy_file = policy.yaml {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] oslo_policy.remote_timeout = 60.0 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] privsep_osbrick.group = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] privsep_osbrick.helper_command = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] privsep_osbrick.logger_name = os_brick.privileged {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] privsep_osbrick.thread_pool_size = 3 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] privsep_osbrick.user = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] cinder_sys_admin.group = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] cinder_sys_admin.helper_command = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] cinder_sys_admin.thread_pool_size = 3 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] cinder_sys_admin.user = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] service_user.auth_section = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] service_user.auth_type = password {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] service_user.cafile = /opt/stack/data/ca-bundle.pem {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] service_user.certfile = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] service_user.collect_timing = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] service_user.insecure = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] service_user.keyfile = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] service_user.send_service_user_token = True {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] service_user.split_loggers = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] service_user.timeout = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backend_defaults.backend_availability_zone = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backend_defaults.chap_password = **** {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backend_defaults.chap_username = {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backend_defaults.driver_client_cert = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backend_defaults.driver_client_cert_key = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backend_defaults.driver_data_namespace = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backend_defaults.driver_use_ssl = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backend_defaults.enable_unsupported_driver = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backend_defaults.extra_capabilities = {} {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backend_defaults.filter_function = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backend_defaults.goodness_function = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backend_defaults.iscsi_iotype = fileio {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backend_defaults.iscsi_target_flags = {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backend_defaults.iscsi_write_cache = on {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backend_defaults.iser_helper = tgtadm {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backend_defaults.iser_ip_address = 192.168.122.32 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backend_defaults.iser_port = 3260 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backend_defaults.lvm_mirrors = 0 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backend_defaults.lvm_share_target = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backend_defaults.lvm_type = auto {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backend_defaults.num_shell_tries = 3 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backend_defaults.nvmet_port_id = 1 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backend_defaults.replication_device = **** {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backend_defaults.report_discard_supported = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backend_defaults.reserved_percentage = 0 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backend_defaults.scst_target_driver = iscsi {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backend_defaults.scst_target_iqn_name = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backend_defaults.storage_protocol = iSCSI {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backend_defaults.target_helper = tgtadm {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backend_defaults.target_ip_address = 192.168.122.32 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backend_defaults.target_port = 3260 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backend_defaults.target_protocol = iscsi {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backend_defaults.trace_flags = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backend_defaults.unique_fqdn_network = True {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backend_defaults.use_chap_auth = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backend_defaults.volume_backend_name = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backend_defaults.volume_clear = zero {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backend_defaults.volume_clear_ionice = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backend_defaults.volume_clear_size = 0 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backend_defaults.volume_group = cinder-volumes {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] oslo_reports.file_event_handler = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] oslo_reports.log_dir = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] lvmdriver-1.backend_availability_zone = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] lvmdriver-1.backend_host = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] lvmdriver-1.chap_password = **** {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] lvmdriver-1.chap_username = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] lvmdriver-1.chiscsi_conf = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] lvmdriver-1.driver_client_cert = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] lvmdriver-1.driver_data_namespace = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] lvmdriver-1.driver_use_ssl = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] lvmdriver-1.extra_capabilities = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] lvmdriver-1.filter_function = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] lvmdriver-1.goodness_function = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] lvmdriver-1.iscsi_iotype = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] lvmdriver-1.iser_helper = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] lvmdriver-1.iser_ip_address = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] lvmdriver-1.iser_port = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] lvmdriver-1.iser_target_prefix = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] lvmdriver-1.lvm_conf_file = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] lvmdriver-1.lvm_mirrors = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] lvmdriver-1.lvm_share_target = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] lvmdriver-1.lvm_type = auto {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] lvmdriver-1.num_shell_tries = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] lvmdriver-1.nvmet_port_id = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] lvmdriver-1.replication_device = **** {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] lvmdriver-1.report_discard_supported = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] lvmdriver-1.reserved_percentage = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] lvmdriver-1.scst_target_driver = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] lvmdriver-1.storage_protocol = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] lvmdriver-1.target_helper = lioadm {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] lvmdriver-1.target_ip_address = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] lvmdriver-1.target_port = 3260 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] lvmdriver-1.target_protocol = iscsi {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] lvmdriver-1.trace_flags = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] lvmdriver-1.use_chap_auth = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] lvmdriver-1.volume_clear = zero {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] lvmdriver-1.volume_clear_size = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] lvmdriver-1.volumes_dir = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] oslo_messaging_rabbit.ssl = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] oslo_messaging_rabbit.ssl_version = {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] oslo_messaging_notifications.driver = [] {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] oslo_messaging_notifications.retry = -1 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] oslo_messaging_notifications.transport_url = **** {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.281s {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] key_manager.fixed_key = **** {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] barbican.barbican_api_version = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] barbican.barbican_endpoint = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] barbican.barbican_endpoint_type = public {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] barbican.barbican_region_name = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] barbican.cafile = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] barbican.certfile = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] barbican.collect_timing = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] barbican.insecure = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] barbican.keyfile = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] barbican.number_of_retries = 60 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] barbican.retry_delay = 1 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] barbican.send_service_user_token = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] barbican.split_loggers = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] barbican.timeout = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] barbican.verify_ssl = True {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] barbican.verify_ssl_path = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] barbican_service_user.auth_section = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] barbican_service_user.auth_type = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] barbican_service_user.cafile = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] barbican_service_user.certfile = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] barbican_service_user.collect_timing = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] barbican_service_user.insecure = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] barbican_service_user.keyfile = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] barbican_service_user.split_loggers = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] barbican_service_user.timeout = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] vault.approle_role_id = **** {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] vault.approle_secret_id = **** {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] vault.kv_mountpoint = secret {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] vault.kv_path = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] vault.kv_version = 2 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] vault.namespace = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] vault.root_token_id = **** {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] vault.ssl_ca_crt_file = None {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] vault.timeout = 60.0 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] vault.use_ssl = False {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:52:37 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] ******************************************************************************** {{(pid=74756) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} Sep 10 20:52:37 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 20:52:38 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.136s {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 20:52:38 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 20:52:38 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.113s {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 20:52:38 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 20:52:38 devstack sudo[74891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 10 20:52:38 devstack sudo[74891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:52:40 devstack sudo[74891]: pam_unix(sudo:session): session closed for user root Sep 10 20:52:40 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 2.082s {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 20:52:40 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 20:52:40 devstack sudo[75031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 20:52:40 devstack sudo[75031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:52:42 devstack sudo[75031]: pam_unix(sudo:session): session closed for user root Sep 10 20:52:42 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 2.379s {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 20:52:42 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 20:52:42 devstack cinder-volume[74854]: INFO cinder.brick.local_dev.lvm [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 10 20:52:42 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 20:52:42 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.092s {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 20:52:42 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 20:52:42 devstack sudo[75181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 20:52:42 devstack sudo[75181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:52:44 devstack sudo[75181]: pam_unix(sudo:session): session closed for user root Sep 10 20:52:44 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.911s {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 20:52:44 devstack cinder-volume[74854]: DEBUG cinder.brick.local_dev.lvm [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=74854) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Sep 10 20:52:44 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 20:52:44 devstack sudo[75273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 20:52:44 devstack sudo[75273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:52:47 devstack cinder-volume[74756]: DEBUG dbcounter [-] [74756] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=74756) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 20:52:48 devstack sudo[75273]: pam_unix(sudo:session): session closed for user root Sep 10 20:52:48 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 3.291s {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 20:52:48 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 20:52:48 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.092s {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 20:52:48 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 20:52:48 devstack sudo[75467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 20:52:48 devstack sudo[75467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:52:50 devstack sudo[75467]: pam_unix(sudo:session): session closed for user root Sep 10 20:52:50 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.188s {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 20:52:50 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 20:52:50 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.085s {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 20:52:50 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 20:52:50 devstack sudo[75517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 10 20:52:50 devstack sudo[75517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:52:52 devstack sudo[75517]: pam_unix(sudo:session): session closed for user root Sep 10 20:52:52 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 1.986s {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 20:52:52 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 20:52:52 devstack sudo[75554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 20:52:52 devstack sudo[75554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:52:55 devstack sudo[75554]: pam_unix(sudo:session): session closed for user root Sep 10 20:52:55 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.720s {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 20:52:55 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 20:52:55 devstack sudo[75633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 20:52:55 devstack sudo[75633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:52:57 devstack sudo[75633]: pam_unix(sudo:session): session closed for user root Sep 10 20:52:57 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.400s {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 20:52:57 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 20:52:57 devstack sudo[75645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 20:52:57 devstack sudo[75645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:53:00 devstack sudo[75645]: pam_unix(sudo:session): session closed for user root Sep 10 20:53:00 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.890s {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 20:53:00 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 20:53:00 devstack sudo[75650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 20:53:00 devstack sudo[75650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:53:03 devstack sudo[75650]: pam_unix(sudo:session): session closed for user root Sep 10 20:53:03 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.591s {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 20:53:03 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 20:53:03 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.139s {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 20:53:03 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 20:53:03 devstack sudo[75657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 20:53:03 devstack sudo[75657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:53:05 devstack sudo[75657]: pam_unix(sudo:session): session closed for user root Sep 10 20:53:05 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.070s {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 20:53:05 devstack cinder-volume[74854]: INFO cinder.volume.drivers.lvm [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 10 20:53:05 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 20:53:05 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.126s {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 20:53:05 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 20:53:05 devstack sudo[75683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 20:53:05 devstack sudo[75683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:53:08 devstack sudo[75683]: pam_unix(sudo:session): session closed for user root Sep 10 20:53:08 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.388s {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 20:53:08 devstack cinder-volume[74854]: DEBUG cinder.volume.drivers.lvm [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] Updating volume stats {{(pid=74854) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 10 20:53:08 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 20:53:08 devstack sudo[75779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 20:53:08 devstack sudo[75779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:53:10 devstack sudo[75779]: pam_unix(sudo:session): session closed for user root Sep 10 20:53:10 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.956s {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 20:53:10 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 20:53:10 devstack sudo[75919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 20:53:10 devstack sudo[75919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:53:12 devstack sudo[75919]: pam_unix(sudo:session): session closed for user root Sep 10 20:53:12 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.103s {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 20:53:12 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 20:53:12 devstack sudo[75923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 20:53:12 devstack sudo[75923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:53:14 devstack sudo[75923]: pam_unix(sudo:session): session closed for user root Sep 10 20:53:14 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.291s {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 20:53:14 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 20:53:14 devstack sudo[75927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 20:53:14 devstack sudo[75927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:53:16 devstack sudo[75927]: pam_unix(sudo:session): session closed for user root Sep 10 20:53:16 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.035s {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 20:53:16 devstack cinder-volume[74854]: INFO cinder.volume.driver [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] Driver hasn't implemented _init_vendor_properties() Sep 10 20:53:16 devstack cinder-volume[74854]: DEBUG cinder.volume.driver [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=74854) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:860}} Sep 10 20:53:16 devstack cinder-volume[74854]: DEBUG oslo_db.sqlalchemy.engines [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74854) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 10 20:53:16 devstack cinder-volume[74854]: DEBUG dbcounter [-] [74854] Writer thread running {{(pid=74854) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Sep 10 20:53:16 devstack cinder-volume[74854]: DEBUG cinder.db.sqlalchemy.api [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] Building query based on filter {{(pid=74854) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}} Sep 10 20:53:17 devstack cinder-volume[74854]: DEBUG cinder.image.image_utils [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=74854) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}} Sep 10 20:53:17 devstack cinder-volume[74854]: INFO cinder.keymgr.migration [None req-ae4472e5-ae92-42de-88a8-e31c8a0a0131 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 10 20:53:17 devstack cinder-volume[74854]: DEBUG cinder.volume.drivers.lvm [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] Updating volume stats {{(pid=74854) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 10 20:53:17 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 20:53:17 devstack sudo[75934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 20:53:17 devstack sudo[75934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:53:18 devstack sudo[75934]: pam_unix(sudo:session): session closed for user root Sep 10 20:53:18 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.904s {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 20:53:19 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 20:53:19 devstack sudo[75938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 20:53:19 devstack sudo[75938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:53:20 devstack sudo[75938]: pam_unix(sudo:session): session closed for user root Sep 10 20:53:21 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.983s {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 20:53:21 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 20:53:21 devstack sudo[76018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 20:53:21 devstack sudo[76018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:53:23 devstack sudo[76018]: pam_unix(sudo:session): session closed for user root Sep 10 20:53:23 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.130s {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 20:53:23 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 20:53:23 devstack sudo[76085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 20:53:23 devstack sudo[76085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:53:25 devstack sudo[76085]: pam_unix(sudo:session): session closed for user root Sep 10 20:53:25 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.435s {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 20:53:25 devstack cinder-volume[74854]: DEBUG cinder.manager [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] Notifying Schedulers of capabilities ... {{(pid=74854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 20:53:25 devstack cinder-volume[74854]: INFO cinder.volume.manager [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] Driver initialization completed successfully. Sep 10 20:53:25 devstack cinder-volume[74854]: INFO cinder.manager [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] Initiating service 2 cleanup Sep 10 20:53:25 devstack cinder-volume[74854]: INFO cinder.manager [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] Service 2 cleanup completed. Sep 10 20:53:25 devstack cinder-volume[74854]: DEBUG cinder.service [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] Creating RPC server for service cinder-volume {{(pid=74854) start /opt/stack/cinder/cinder/service.py:239}} Sep 10 20:53:26 devstack cinder-volume[74854]: DEBUG cinder.service [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=74854) start /opt/stack/cinder/cinder/service.py:245}} Sep 10 20:53:26 devstack cinder-volume[74854]: INFO cinder.volume.manager [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 10 20:53:26 devstack cinder-volume[74854]: DEBUG cinder.volume.drivers.lvm [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] Updating volume stats {{(pid=74854) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 10 20:53:26 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 20:53:26 devstack sudo[76089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 20:53:26 devstack sudo[76089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:53:28 devstack sudo[76089]: pam_unix(sudo:session): session closed for user root Sep 10 20:53:28 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.342s {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 20:53:28 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 20:53:28 devstack sudo[76092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 20:53:28 devstack sudo[76092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:53:30 devstack sudo[76092]: pam_unix(sudo:session): session closed for user root Sep 10 20:53:30 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.025s {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 20:53:30 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 20:53:30 devstack sudo[76100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 20:53:30 devstack sudo[76100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:53:32 devstack sudo[76100]: pam_unix(sudo:session): session closed for user root Sep 10 20:53:32 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.938s {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 20:53:32 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 20:53:32 devstack sudo[76104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 20:53:32 devstack sudo[76104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:53:34 devstack sudo[76104]: pam_unix(sudo:session): session closed for user root Sep 10 20:53:34 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.008s {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 20:53:34 devstack cinder-volume[74854]: INFO cinder.volume.manager [None req-49c9c0e6-320b-4d16-931d-49914cbb2a98 None None] Driver post RPC initialization completed successfully. Sep 10 20:53:44 devstack cinder-volume[74854]: DEBUG dbcounter [-] [74854] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=74854) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 20:53:44 devstack cinder-volume[74854]: DEBUG dbcounter [-] [74854] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=74854) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 20:54:06 devstack cinder-volume[74854]: DEBUG oslo_service.periodic_task [None req-7c09324b-f14c-448f-bdad-8653e7a222fa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=74854) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 20:54:06 devstack cinder-volume[74854]: DEBUG cinder.volume.drivers.lvm [None req-7c09324b-f14c-448f-bdad-8653e7a222fa None None] Updating volume stats {{(pid=74854) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 10 20:54:06 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-7c09324b-f14c-448f-bdad-8653e7a222fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 20:54:06 devstack sudo[77077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 20:54:06 devstack sudo[77077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:54:09 devstack sudo[77077]: pam_unix(sudo:session): session closed for user root Sep 10 20:54:09 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-7c09324b-f14c-448f-bdad-8653e7a222fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.347s {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 20:54:09 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-7c09324b-f14c-448f-bdad-8653e7a222fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 20:54:09 devstack sudo[77081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 20:54:09 devstack sudo[77081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:54:11 devstack sudo[77081]: pam_unix(sudo:session): session closed for user root Sep 10 20:54:11 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-7c09324b-f14c-448f-bdad-8653e7a222fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.079s {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 20:54:11 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-7c09324b-f14c-448f-bdad-8653e7a222fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 20:54:11 devstack sudo[77085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 20:54:11 devstack sudo[77085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:54:13 devstack sudo[77085]: pam_unix(sudo:session): session closed for user root Sep 10 20:54:13 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-7c09324b-f14c-448f-bdad-8653e7a222fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.975s {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 20:54:13 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-7c09324b-f14c-448f-bdad-8653e7a222fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 20:54:13 devstack sudo[77090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 20:54:13 devstack sudo[77090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:54:15 devstack sudo[77090]: pam_unix(sudo:session): session closed for user root Sep 10 20:54:15 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-7c09324b-f14c-448f-bdad-8653e7a222fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.245s {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 20:54:15 devstack cinder-volume[74854]: DEBUG cinder.manager [None req-7c09324b-f14c-448f-bdad-8653e7a222fa None None] Notifying Schedulers of capabilities ... {{(pid=74854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 20:55:06 devstack cinder-volume[74854]: DEBUG oslo_service.periodic_task [None req-7c09324b-f14c-448f-bdad-8653e7a222fa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=74854) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 20:55:06 devstack cinder-volume[74854]: DEBUG cinder.volume.drivers.lvm [None req-7c09324b-f14c-448f-bdad-8653e7a222fa None None] Updating volume stats {{(pid=74854) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 10 20:55:06 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-7c09324b-f14c-448f-bdad-8653e7a222fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 20:55:06 devstack sudo[77717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 20:55:06 devstack sudo[77717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:55:08 devstack sudo[77717]: pam_unix(sudo:session): session closed for user root Sep 10 20:55:08 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-7c09324b-f14c-448f-bdad-8653e7a222fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.034s {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 20:55:08 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-7c09324b-f14c-448f-bdad-8653e7a222fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 20:55:08 devstack sudo[77720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 20:55:08 devstack sudo[77720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:55:11 devstack sudo[77720]: pam_unix(sudo:session): session closed for user root Sep 10 20:55:11 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-7c09324b-f14c-448f-bdad-8653e7a222fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.693s {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 20:55:11 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-7c09324b-f14c-448f-bdad-8653e7a222fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 20:55:11 devstack sudo[77917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 20:55:11 devstack sudo[77917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:55:13 devstack sudo[77917]: pam_unix(sudo:session): session closed for user root Sep 10 20:55:13 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-7c09324b-f14c-448f-bdad-8653e7a222fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.355s {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 20:55:13 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-7c09324b-f14c-448f-bdad-8653e7a222fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 20:55:14 devstack sudo[78017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 20:55:14 devstack sudo[78017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:55:15 devstack sudo[78017]: pam_unix(sudo:session): session closed for user root Sep 10 20:55:16 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-7c09324b-f14c-448f-bdad-8653e7a222fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.090s {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 20:55:16 devstack cinder-volume[74854]: DEBUG cinder.manager [None req-7c09324b-f14c-448f-bdad-8653e7a222fa None None] Notifying Schedulers of capabilities ... {{(pid=74854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 20:55:44 devstack cinder-volume[74854]: DEBUG dbcounter [-] [74854] Writing DB stats cinder:SELECT=1 {{(pid=74854) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 20:55:44 devstack cinder-volume[74854]: DEBUG dbcounter [-] [74854] Writing DB stats cinder:UPDATE=1 {{(pid=74854) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 20:56:06 devstack cinder-volume[74854]: DEBUG oslo_service.periodic_task [None req-7c09324b-f14c-448f-bdad-8653e7a222fa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=74854) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 20:56:06 devstack cinder-volume[74854]: DEBUG cinder.volume.drivers.lvm [None req-7c09324b-f14c-448f-bdad-8653e7a222fa None None] Updating volume stats {{(pid=74854) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 10 20:56:06 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-7c09324b-f14c-448f-bdad-8653e7a222fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 20:56:06 devstack sudo[78755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 20:56:06 devstack sudo[78755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:56:08 devstack sudo[78755]: pam_unix(sudo:session): session closed for user root Sep 10 20:56:08 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-7c09324b-f14c-448f-bdad-8653e7a222fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.977s {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 20:56:08 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-7c09324b-f14c-448f-bdad-8653e7a222fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 20:56:08 devstack sudo[78758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 20:56:08 devstack sudo[78758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:56:10 devstack sudo[78758]: pam_unix(sudo:session): session closed for user root Sep 10 20:56:10 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-7c09324b-f14c-448f-bdad-8653e7a222fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.894s {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 20:56:10 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-7c09324b-f14c-448f-bdad-8653e7a222fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 20:56:10 devstack sudo[78761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 20:56:10 devstack sudo[78761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:56:12 devstack sudo[78761]: pam_unix(sudo:session): session closed for user root Sep 10 20:56:12 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-7c09324b-f14c-448f-bdad-8653e7a222fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.940s {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 20:56:12 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-7c09324b-f14c-448f-bdad-8653e7a222fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 20:56:12 devstack sudo[78842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 20:56:12 devstack sudo[78842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:56:14 devstack sudo[78842]: pam_unix(sudo:session): session closed for user root Sep 10 20:56:14 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-7c09324b-f14c-448f-bdad-8653e7a222fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.039s {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 20:56:14 devstack cinder-volume[74854]: DEBUG cinder.manager [None req-7c09324b-f14c-448f-bdad-8653e7a222fa None None] Notifying Schedulers of capabilities ... {{(pid=74854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 20:57:06 devstack cinder-volume[74854]: DEBUG oslo_service.periodic_task [None req-7c09324b-f14c-448f-bdad-8653e7a222fa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=74854) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 20:57:06 devstack cinder-volume[74854]: DEBUG cinder.volume.drivers.lvm [None req-7c09324b-f14c-448f-bdad-8653e7a222fa None None] Updating volume stats {{(pid=74854) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 10 20:57:06 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-7c09324b-f14c-448f-bdad-8653e7a222fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 20:57:06 devstack sudo[81286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 20:57:06 devstack sudo[81286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:57:08 devstack sudo[81286]: pam_unix(sudo:session): session closed for user root Sep 10 20:57:08 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-7c09324b-f14c-448f-bdad-8653e7a222fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.132s {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 20:57:08 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-7c09324b-f14c-448f-bdad-8653e7a222fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 20:57:09 devstack sudo[81290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 20:57:09 devstack sudo[81290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:57:10 devstack sudo[81290]: pam_unix(sudo:session): session closed for user root Sep 10 20:57:10 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-7c09324b-f14c-448f-bdad-8653e7a222fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.874s {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 20:57:10 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-7c09324b-f14c-448f-bdad-8653e7a222fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 20:57:10 devstack sudo[81297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 20:57:10 devstack sudo[81297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:57:12 devstack sudo[81297]: pam_unix(sudo:session): session closed for user root Sep 10 20:57:12 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-7c09324b-f14c-448f-bdad-8653e7a222fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.933s {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 20:57:12 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-7c09324b-f14c-448f-bdad-8653e7a222fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 20:57:12 devstack sudo[81308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 20:57:12 devstack sudo[81308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:57:14 devstack sudo[81308]: pam_unix(sudo:session): session closed for user root Sep 10 20:57:14 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-7c09324b-f14c-448f-bdad-8653e7a222fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.837s {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 20:57:14 devstack cinder-volume[74854]: DEBUG cinder.manager [None req-7c09324b-f14c-448f-bdad-8653e7a222fa None None] Notifying Schedulers of capabilities ... {{(pid=74854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 20:57:44 devstack cinder-volume[74854]: DEBUG dbcounter [-] [74854] Writing DB stats cinder:SELECT=1 {{(pid=74854) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 20:57:44 devstack cinder-volume[74854]: DEBUG dbcounter [-] [74854] Writing DB stats cinder:UPDATE=1 {{(pid=74854) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 20:58:06 devstack cinder-volume[74854]: DEBUG oslo_service.periodic_task [None req-7c09324b-f14c-448f-bdad-8653e7a222fa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=74854) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 20:58:06 devstack cinder-volume[74854]: DEBUG cinder.volume.drivers.lvm [None req-7c09324b-f14c-448f-bdad-8653e7a222fa None None] Updating volume stats {{(pid=74854) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 10 20:58:06 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-7c09324b-f14c-448f-bdad-8653e7a222fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 20:58:06 devstack sudo[81584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 20:58:06 devstack sudo[81584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:58:09 devstack sudo[81584]: pam_unix(sudo:session): session closed for user root Sep 10 20:58:09 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-7c09324b-f14c-448f-bdad-8653e7a222fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.446s {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 20:58:09 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-7c09324b-f14c-448f-bdad-8653e7a222fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 20:58:09 devstack sudo[81587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 20:58:09 devstack sudo[81587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:58:11 devstack sudo[81587]: pam_unix(sudo:session): session closed for user root Sep 10 20:58:11 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-7c09324b-f14c-448f-bdad-8653e7a222fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.861s {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 20:58:11 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-7c09324b-f14c-448f-bdad-8653e7a222fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 20:58:11 devstack sudo[81590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 20:58:11 devstack sudo[81590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:58:12 devstack sudo[81590]: pam_unix(sudo:session): session closed for user root Sep 10 20:58:12 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-7c09324b-f14c-448f-bdad-8653e7a222fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.795s {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 20:58:12 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-7c09324b-f14c-448f-bdad-8653e7a222fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 20:58:13 devstack sudo[81594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 20:58:13 devstack sudo[81594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:58:14 devstack sudo[81594]: pam_unix(sudo:session): session closed for user root Sep 10 20:58:14 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-7c09324b-f14c-448f-bdad-8653e7a222fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.850s {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 20:58:14 devstack cinder-volume[74854]: DEBUG cinder.manager [None req-7c09324b-f14c-448f-bdad-8653e7a222fa None None] Notifying Schedulers of capabilities ... {{(pid=74854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 20:59:06 devstack cinder-volume[74854]: DEBUG oslo_service.periodic_task [None req-7c09324b-f14c-448f-bdad-8653e7a222fa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=74854) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 20:59:06 devstack cinder-volume[74854]: DEBUG cinder.volume.drivers.lvm [None req-7c09324b-f14c-448f-bdad-8653e7a222fa None None] Updating volume stats {{(pid=74854) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 10 20:59:06 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-7c09324b-f14c-448f-bdad-8653e7a222fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 20:59:06 devstack sudo[82341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 20:59:06 devstack sudo[82341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:59:09 devstack sudo[82341]: pam_unix(sudo:session): session closed for user root Sep 10 20:59:09 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-7c09324b-f14c-448f-bdad-8653e7a222fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.348s {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 20:59:09 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-7c09324b-f14c-448f-bdad-8653e7a222fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 20:59:09 devstack sudo[82369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 20:59:09 devstack sudo[82369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:59:12 devstack sudo[82369]: pam_unix(sudo:session): session closed for user root Sep 10 20:59:12 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-7c09324b-f14c-448f-bdad-8653e7a222fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.980s {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 20:59:12 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-7c09324b-f14c-448f-bdad-8653e7a222fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 20:59:12 devstack sudo[82430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 20:59:12 devstack sudo[82430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:59:14 devstack sudo[82430]: pam_unix(sudo:session): session closed for user root Sep 10 20:59:14 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-7c09324b-f14c-448f-bdad-8653e7a222fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.774s {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 20:59:14 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-7c09324b-f14c-448f-bdad-8653e7a222fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 20:59:15 devstack sudo[82467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 20:59:15 devstack sudo[82467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:59:17 devstack sudo[82467]: pam_unix(sudo:session): session closed for user root Sep 10 20:59:17 devstack cinder-volume[74854]: DEBUG oslo_concurrency.processutils [None req-7c09324b-f14c-448f-bdad-8653e7a222fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.365s {{(pid=74854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 20:59:17 devstack cinder-volume[74854]: DEBUG cinder.manager [None req-7c09324b-f14c-448f-bdad-8653e7a222fa None None] Notifying Schedulers of capabilities ... {{(pid=74854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 20:59:18 devstack cinder-volume[74756]: INFO oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] Caught SIGTERM, stopping children Sep 10 20:59:18 devstack cinder-volume[74756]: DEBUG oslo_concurrency.lockutils [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] Acquiring lock "singleton_lock" {{(pid=74756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} Sep 10 20:59:18 devstack cinder-volume[74756]: DEBUG oslo_concurrency.lockutils [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] Acquired lock "singleton_lock" {{(pid=74756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} Sep 10 20:59:18 devstack cinder-volume[74756]: DEBUG oslo_concurrency.lockutils [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] Releasing lock "singleton_lock" {{(pid=74756) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} Sep 10 20:59:18 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] Stop services. {{(pid=74756) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:610}} Sep 10 20:59:18 devstack cinder-volume[74756]: DEBUG oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] Killing children. {{(pid=74756) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:615}} Sep 10 20:59:18 devstack cinder-volume[74756]: INFO oslo_service.backend._eventlet.service [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] Waiting on 1 children to exit Sep 10 20:59:23 devstack cinder-volume[74854]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Sep 10 20:59:31 devstack cinder-volume[74854]: DEBUG oslo_concurrency.lockutils [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] Acquiring lock "singleton_lock" {{(pid=74854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} Sep 10 20:59:31 devstack cinder-volume[74854]: DEBUG oslo_concurrency.lockutils [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] Acquired lock "singleton_lock" {{(pid=74854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} Sep 10 20:59:31 devstack cinder-volume[74854]: DEBUG oslo_concurrency.lockutils [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] Releasing lock "singleton_lock" {{(pid=74854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} Sep 10 20:59:31 devstack cinder-volume[74854]: WARNING amqp [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 10 20:59:31 devstack cinder-volume[74854]: WARNING amqp [None req-2edb4e8d-010e-4799-82ce-b3536bb00654 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 10 20:59:40 devstack cinder-volume[82574]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82574) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} Sep 10 20:59:40 devstack cinder-volume[82574]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82574) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} Sep 10 20:59:40 devstack cinder-volume[82574]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82574) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} Sep 10 20:59:43 devstack cinder-volume[82574]: INFO dbcounter [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] Registered counter for database cinder Sep 10 20:59:43 devstack cinder-volume[82574]: DEBUG oslo_db.sqlalchemy.engines [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82574) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG dbcounter [-] [82574] Writer thread running {{(pid=82574) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Sep 10 20:59:44 devstack cinder-volume[82574]: INFO cinder.rpc [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 10 20:59:44 devstack cinder-volume[82574]: INFO cinder.rpc [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_db.sqlalchemy.engines [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82574) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 10 20:59:44 devstack cinder-volume[82574]: INFO cinder.volume.manager [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] Determined volume DB was empty at startup. Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG cinder.volume.manager [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82574) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Sep 10 20:59:44 devstack cinder-volume[82574]: INFO cinder.volume.manager [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 10 20:59:44 devstack cinder-volume[82574]: WARNING stevedore.named [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 10 20:59:44 devstack cinder-volume[82574]: WARNING castellan.key_manager [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 10 20:59:44 devstack cinder-volume[82574]: WARNING cinder.keymgr.conf_key_mgr [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 10 20:59:44 devstack cinder-volume[82574]: INFO cinder.volume.manager [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_db.sqlalchemy.engines [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82574) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 10 20:59:44 devstack cinder-volume[82574]: INFO oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] Starting 1 workers Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] Started child 82780 {{(pid=82574) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] Full set of CONF: {{(pid=82574) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] ******************************************************************************** {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] Configuration options gathered from: {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] ================================================================================ {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] allow_availability_zone_fallback = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] allow_compression_on_image_upload = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82780]: INFO cinder.service [-] Starting cinder-volume node (version 26.1.0) Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] allowed_direct_url_schemes = [] {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] api_rate_limit = True {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] auth_strategy = keystone {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_availability_zone = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_host = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_name = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_stats_polling_interval = 60 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backup_api_class = cinder.backup.api.API {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backup_name_template = backup-%s {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backup_use_same_host = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backup_use_temp_snapshot = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] chap_password = **** {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] chap_username = {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] cinder_internal_tenant_project_id = e91b0372797e44e88c001e972f3b491a {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] cinder_internal_tenant_user_id = ca0d4e41d48b4aa985382270977fda16 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] cluster = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] compression_format = gzip {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] compute_api_class = cinder.compute.nova.API {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] config_dir = [] {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] config_source = [] {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] control_exchange = openstack {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] debug = True {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] default_availability_zone = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] default_group_type = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] default_volume_type = QuobyteHD {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] driver_client_cert = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] driver_client_cert_key = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] driver_data_namespace = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] driver_ssl_cert_path = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] driver_ssl_cert_verify = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] driver_use_ssl = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] enable_new_services = True {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] enable_unsupported_driver = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] enabled_backends = ['QuobyteHD'] {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] enforce_multipath_for_image_xfer = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] filter_function = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] glance_api_insecure = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] glance_api_servers = ['http://192.168.122.32/image'] {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] glance_api_ssl_compression = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] glance_ca_certificates_file = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] glance_catalog_info = image:glance:publicURL {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] glance_certfile = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] glance_keyfile = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] glance_num_retries = 3 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] glance_request_timeout = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] goodness_function = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] graceful_shutdown_timeout = 5 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] group_api_class = cinder.group.api.API {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] host = devstack {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] image_compress_on_upload = True {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] image_conversion_address_space_limit = 1 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] image_conversion_cpu_limit = 60 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] image_conversion_disable = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] image_upload_use_cinder_backend = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] image_upload_use_internal_tenant = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] image_volume_cache_enabled = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] image_volume_cache_max_count = 0 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] image_volume_cache_max_size_gb = 0 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] init_host_max_objects_retrieval = 0 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] instance_format = [instance: %(uuid)s] {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] iscsi_iotype = fileio {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] iscsi_target_flags = {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] iscsi_write_cache = on {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] iser_helper = tgtadm {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] iser_ip_address = 192.168.122.32 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] iser_port = 3260 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] log_color = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] log_config_append = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] log_dir = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] log_file = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] log_options = True {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] log_rotate_interval = 1 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] log_rotate_interval_type = days {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] log_rotation_type = none {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] max_age = 0 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] max_logfile_count = 30 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] max_logfile_size_mb = 200 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] max_over_subscription_ratio = 20.0 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] message_reap_interval = 86400 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] message_ttl = 2592000 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] migration_create_volume_timeout_secs = 300 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] monkey_patch = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] monkey_patch_modules = [] {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] my_ip = 192.168.122.32 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] no_snapshot_gb_quota = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] num_iser_scan_tries = 3 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] num_shell_tries = 3 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] num_volume_device_scan_tries = 3 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] nvmeof_conn_info_version = 1 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] nvmet_ns_id = 10 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] nvmet_port_id = 1 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] osapi_max_limit = 1000 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] osapi_volume_ext_list = [] {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] osapi_volume_listen_port = 8776 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] osapi_volume_use_ssl = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] osapi_volume_workers = 2 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] per_volume_size_limit = -1 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] periodic_fuzzy_delay = 60 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] periodic_interval = 60 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] public_endpoint = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] publish_errors = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] quota_backup_gigabytes = 1000 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] quota_backups = 10 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] quota_gigabytes = 1000 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] quota_groups = 10 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] quota_snapshots = 10 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] quota_volumes = 10 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] rate_limit_burst = 0 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] rate_limit_except_level = CRITICAL {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] rate_limit_interval = 0 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] reinit_driver_count = 3 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] replication_device = **** {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] report_discard_supported = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] report_interval = 120 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] reservation_clean_interval = 86400 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] reservation_expire = 86400 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] reserved_image_namespaces = [] {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] reserved_percentage = 0 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] rpc_response_timeout = 120 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] run_external_periodic_tasks = True {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] scst_target_driver = iscsi {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] scst_target_iqn_name = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] service_down_time = 720 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] shell_completion = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] snapshot_name_template = snapshot-%s {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] split_loggers = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] state_path = /opt/stack/data/cinder {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] storage_availability_zone = nova {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] storage_protocol = iSCSI {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] syslog_log_facility = LOG_USER {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] target_helper = lioadm {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] target_ip_address = 192.168.122.32 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] target_port = 3260 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] target_protocol = iscsi {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] target_secondary_ip_addresses = [] {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] trace_flags = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] transport_url = **** {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] until_refresh = 0 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] use_chap_auth = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] use_default_quota_class = True {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] use_journal = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] use_json = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] use_multipath_for_image_xfer = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] use_stderr = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] use_syslog = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] verify_glance_signatures = enabled {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] volume_api_class = cinder.volume.api.API {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] volume_backend_name = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] volume_clear = zero {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] volume_clear_ionice = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] volume_clear_size = 0 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] volume_copy_bps_limit = 0 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] volume_dd_blocksize = 1M {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] volume_name_template = volume-%s {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] volume_service_inithost_offload = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] volume_usage_audit_period = month {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] watch_log_file = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] zoning_mode = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] os_brick.lock_path = /opt/stack/data/cinder {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] oslo_concurrency.disable_process_locking = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] keystone_authtoken.admin_password = **** {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] keystone_authtoken.admin_token = **** {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] keystone_authtoken.admin_user = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] keystone_authtoken.auth_admin_prefix = {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] keystone_authtoken.auth_port = 35357 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] keystone_authtoken.auth_protocol = https {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] keystone_authtoken.auth_section = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] keystone_authtoken.auth_type = password {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] keystone_authtoken.auth_uri = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] keystone_authtoken.auth_version = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] keystone_authtoken.cache = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] keystone_authtoken.certfile = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] keystone_authtoken.identity_uri = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] keystone_authtoken.include_service_catalog = True {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] keystone_authtoken.insecure = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] keystone_authtoken.interface = public {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] keystone_authtoken.keyfile = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] keystone_authtoken.memcache_password = {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] keystone_authtoken.memcache_username = {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] keystone_authtoken.region_name = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] keystone_authtoken.service_type = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] cache.backend = dogpile.cache.null {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] cache.backend_argument = **** {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] cache.backend_expiration_time = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:44 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] cache.config_prefix = cache.oslo {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] cache.dead_timeout = 60.0 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] cache.debug_cache_backend = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] cache.enable_retry_client = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] cache.enable_socket_keepalive = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] cache.enabled = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] cache.enforce_fips_mode = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] cache.expiration_time = 600 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] cache.hashclient_retry_attempts = 2 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] cache.hashclient_retry_delay = 1.0 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] cache.memcache_dead_retry = 300 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] cache.memcache_password = **** {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] cache.memcache_pool_maxsize = 10 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] cache.memcache_sasl_enabled = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] cache.memcache_socket_timeout = 1.0 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] cache.memcache_username = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] cache.proxies = [] {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] cache.redis_db = 0 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] cache.redis_password = **** {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] cache.redis_server = localhost:6379 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] cache.redis_socket_timeout = 1.0 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] cache.redis_username = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] cache.retry_attempts = 2 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] cache.retry_delay = 0.0 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] cache.socket_keepalive_count = 1 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] cache.socket_keepalive_idle = 1 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] cache.socket_keepalive_interval = 1 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] cache.tls_allowed_ciphers = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] cache.tls_cafile = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] cache.tls_certfile = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] cache.tls_enabled = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] cache.tls_keyfile = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] coordination.backend_url = **** {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] database.asyncio_connection = **** {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] database.asyncio_slave_connection = **** {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] database.backend = sqlalchemy {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] database.connection = **** {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] database.connection_debug = 0 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] database.connection_parameters = {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] database.connection_recycle_time = 3600 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] database.connection_trace = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] database.db_inc_retry_interval = True {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] database.db_max_retries = 20 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] database.db_max_retry_interval = 10 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] database.db_retry_interval = 1 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] database.max_overflow = 50 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] database.max_pool_size = 5 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] database.max_retries = 10 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] database.mysql_wsrep_sync_wait = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] database.pool_timeout = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] database.retry_interval = 10 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] database.slave_connection = **** {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] database.sqlite_synchronous = True {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] database.use_db_reconnect = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] profiler.connection_string = messaging:// {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] profiler.enabled = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] profiler.es_doc_type = notification {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] profiler.es_scroll_size = 10000 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] profiler.es_scroll_time = 2m {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] profiler.filter_error_trace = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] profiler.hmac_keys = **** {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] profiler.sentinel_service_name = mymaster {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] profiler.socket_timeout = 0.1 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] profiler.trace_requests = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] profiler.trace_sqlalchemy = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] profiler_jaeger.process_tags = {} {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] profiler_jaeger.service_name_prefix = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] profiler_otlp.service_name_prefix = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] oslo_policy.enforce_new_defaults = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: WARNING oslo_config.cfg [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] oslo_policy.enforce_scope = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] oslo_policy.policy_default_rule = default {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] oslo_policy.policy_file = policy.yaml {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] privsep_osbrick.group = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] privsep_osbrick.helper_command = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] privsep_osbrick.logger_name = os_brick.privileged {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] privsep_osbrick.thread_pool_size = 3 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] privsep_osbrick.user = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] cinder_sys_admin.group = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] cinder_sys_admin.helper_command = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] cinder_sys_admin.thread_pool_size = 3 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] cinder_sys_admin.user = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] service_user.auth_section = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] service_user.auth_type = password {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] service_user.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] service_user.certfile = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] service_user.collect_timing = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] service_user.insecure = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] service_user.keyfile = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] service_user.send_service_user_token = True {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] service_user.split_loggers = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] service_user.timeout = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.backend_availability_zone = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.chap_password = **** {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.chap_username = {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.driver_client_cert = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.driver_client_cert_key = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.driver_data_namespace = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.driver_use_ssl = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.extra_capabilities = {} {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.filter_function = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.goodness_function = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.iscsi_iotype = fileio {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.iscsi_target_flags = {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.iscsi_write_cache = on {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.iser_helper = tgtadm {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.iser_ip_address = 192.168.122.32 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.iser_port = 3260 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.nas_host = {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.nas_login = admin {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.nas_mount_options = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.nas_password = **** {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.nas_private_key = {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.nas_share_path = {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.nas_ssh_port = 22 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.num_shell_tries = 3 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.quobyte_volume_url = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.replication_device = **** {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.report_discard_supported = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.reserved_percentage = 0 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.target_helper = tgtadm {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.target_ip_address = 192.168.122.32 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.target_port = 3260 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.target_protocol = iscsi {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.trace_flags = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.unique_fqdn_network = True {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.use_chap_auth = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.volume_backend_name = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.volume_clear = zero {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.volume_clear_ionice = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.volume_clear_size = 0 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] oslo_reports.file_event_handler = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] oslo_reports.log_dir = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.backend_availability_zone = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.backend_host = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.chap_password = **** {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.chap_username = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.chiscsi_conf = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.driver_client_cert = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.driver_data_namespace = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.driver_use_ssl = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.extra_capabilities = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.filter_function = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.goodness_function = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [-] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.iscsi_iotype = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.iscsi_target_flags = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.iscsi_write_cache = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.iser_helper = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.iser_ip_address = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.iser_port = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.iser_target_prefix = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.nas_host = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-f76f415e-e1d9-49dc-b25a-1d6d6b209dec None None] Starting volume driver QuobyteDriver (1.1.13) Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.nas_login = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.nas_mount_options = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.nas_password = **** {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.nas_private_key = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.nas_secure_file_operations = true {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.nas_secure_file_permissions = true {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-f76f415e-e1d9-49dc-b25a-1d6d6b209dec None None] NAS config: {'nas_secure_file_permissions': 'true', 'nas_secure_file_operations': 'true'} {{(pid=82780) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:223}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.nas_share_path = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.nas_ssh_port = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.num_shell_tries = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.nvmet_ns_id = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.nvmet_port_id = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.quobyte_volume_url = quobyte://10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.replication_device = **** {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.report_discard_supported = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.reserved_percentage = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.scst_target_driver = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.storage_protocol = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.target_helper = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.target_ip_address = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.target_port = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.target_prefix = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.target_protocol = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.trace_flags = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.unique_fqdn_network = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.use_chap_auth = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.volume_clear = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.volume_clear_ionice = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.volume_clear_size = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] QuobyteHD.volumes_dir = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] oslo_messaging_rabbit.ssl = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] oslo_messaging_notifications.driver = [] {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] oslo_messaging_notifications.retry = -1 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] key_manager.fixed_key = **** {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] barbican.barbican_api_version = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] barbican.barbican_endpoint = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] barbican.barbican_endpoint_type = public {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] barbican.barbican_region_name = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] barbican.cafile = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] barbican.certfile = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] barbican.collect_timing = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] barbican.insecure = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] barbican.keyfile = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] barbican.number_of_retries = 60 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] barbican.retry_delay = 1 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] barbican.send_service_user_token = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] barbican.split_loggers = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] barbican.timeout = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] barbican.verify_ssl = True {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] barbican.verify_ssl_path = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] barbican_service_user.auth_section = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] barbican_service_user.auth_type = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] barbican_service_user.cafile = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] barbican_service_user.certfile = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] barbican_service_user.collect_timing = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] barbican_service_user.insecure = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] barbican_service_user.keyfile = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] barbican_service_user.split_loggers = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] barbican_service_user.timeout = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] vault.approle_role_id = **** {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] vault.approle_secret_id = **** {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] vault.kv_mountpoint = secret {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] vault.kv_path = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] vault.kv_version = 2 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] vault.namespace = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] vault.root_token_id = **** {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] vault.ssl_ca_crt_file = None {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] vault.timeout = 60.0 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] vault.use_ssl = False {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 20:59:45 devstack cinder-volume[82574]: DEBUG oslo_service.backend._eventlet.service [None req-f10ae1ac-733e-4713-8eff-8078b5f5f818 None None] ******************************************************************************** {{(pid=82574) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} Sep 10 20:59:45 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-f76f415e-e1d9-49dc-b25a-1d6d6b209dec None None] nas_secure_file_* settings are true (ownership) and true (permissions). {{(pid=82780) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Sep 10 20:59:45 devstack cinder-volume[82780]: INFO cinder.volume.drivers.quobyte [None req-f76f415e-e1d9-49dc-b25a-1d6d6b209dec None None] The NAS file operations will be run as non privileged user in secure mode. Please ensure your libvirtd settings have been configured accordingly (see section 'OpenStack' in the Quobyte Manual. Sep 10 20:59:45 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f76f415e-e1d9-49dc-b25a-1d6d6b209dec None None] Running cmd (subprocess): mount.quobyte {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 20:59:46 devstack quobyte-client[82791]: Reading configuration file: /etc/quobyte/client.cfg Sep 10 20:59:46 devstack quobyte-client[82791]: Invalid parameters found, error: missing mount point. Sep 10 20:59:46 devstack quobyte-client[82791]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 10 20:59:46 devstack quobyte-client[82791]: Failed to parse all commandline parameters, please use -h/--help to see available options. Sep 10 20:59:46 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f76f415e-e1d9-49dc-b25a-1d6d6b209dec None None] CMD "mount.quobyte" returned: 1 in 0.682s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 20:59:46 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-f76f415e-e1d9-49dc-b25a-1d6d6b209dec None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 20:59:46 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-f76f415e-e1d9-49dc-b25a-1d6d6b209dec None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.028s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 20:59:46 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-f76f415e-e1d9-49dc-b25a-1d6d6b209dec None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 20:59:46 devstack cinder-volume[82780]: INFO cinder.volume.drivers.quobyte [None req-f76f415e-e1d9-49dc-b25a-1d6d6b209dec None None] Mounting volume: 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b ... Sep 10 20:59:46 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f76f415e-e1d9-49dc-b25a-1d6d6b209dec None None] Running cmd (subprocess): mount.quobyte --disable-xattrs 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 -c /etc/quobyte/client-cinder.cfg {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 20:59:46 devstack quobyte-client[82805]: Reading configuration file: /etc/quobyte/client-cinder.cfg Sep 10 20:59:46 devstack quobyte-client[82805]: Reading configuration file: /etc/quobyte/client.cfg Sep 10 20:59:46 devstack quobyte-client[82805]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44' to display the log. Sep 10 20:59:46 devstack quobyte-client[82807]: OptimizeSystemPlacement: Increasing priority of client. If your workload does not perform well, please disable the process placement heuristic (remove --enable_process_placement_heuristic). Sep 10 20:59:46 devstack quobyte-client[82807]: mount.quobyte 3.25 (4fbbd59204) Sep 10 20:59:46 devstack quobyte-client[82807]: Client UUID: YxKUCLKL-k8Ys-gFvM-KBCd-vxRKScVfxIA3 Sep 10 20:59:46 devstack quobyte-client[82807]: Registry: osci01.corp.quobyte.com:7861 Sep 10 20:59:46 devstack quobyte-client[82807]: Volume: cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 20:59:46 devstack quobyte-client[82807]: FUSE version: 316 Sep 10 20:59:46 devstack quobyte-client[82807]: Breakpad initialized (dumping to /home/quobyte/.quobyte/minidumps) Sep 10 20:59:46 devstack quobyte-client[82807]: Could not set oom_score_adj to default value: Failed to set oom_score_adj -700: 13: Permission denied Sep 10 20:59:46 devstack quobyte-client[82807]: Setting total object cache size to 3352297472 bytes Sep 10 20:59:46 devstack quobyte-client[82807]: Using FUSE low-level API Sep 10 20:59:46 devstack quobyte-client[82807]: Caching of uid/gid to user/group name mappings is enabled Sep 10 20:59:46 devstack quobyte-client[82807]: Setting up sockets network client, connect timeout (s): 2 linger timeout (s): 1200 request timeout granularity (s): 10 Sep 10 20:59:46 devstack quobyte-client[82807]: Your limit for concurrently opened files ("ulimit -n") is set to 2048. This is too low for the Quobyte client to function properly, and should be set to at least 16384. You can use ulimit, change the system settings or try to use the limit-nofile= option when trying to mount using /etc/fstab. Sep 10 20:59:46 devstack quobyte-client[82807]: HTTP server start failed on port 55000: Address already in use. Trying a different port Sep 10 20:59:46 devstack quobyte-client[82807]: HTTP server started on port 55001 Sep 10 20:59:46 devstack quobyte-client[82807]: Caching mappings from uid/gid to user/group name and group membership temporarily. Sep 10 20:59:46 devstack quobyte-client[82807]: Mount point /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 established Sep 10 20:59:46 devstack quobyte-client[82807]: TimeSync is running and remote sync every 60 seconds Sep 10 20:59:46 devstack quobyte-client[82807]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 10 20:59:47 devstack quobyte-client[82807]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 10 20:59:47 devstack quobyte-client[82807]: Opening volume cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b (7b04abac-7a61-4324-a576-f55b59bf30a9) Sep 10 20:59:47 devstack quobyte-client[82807]: Setting metadata cache size to 500000 based on available system memory of 16 GiB Sep 10 20:59:47 devstack quobyte-client[82807]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 10 20:59:47 devstack quobyte-client[82807]: Failed to invalidate inode: 38: Function not implemented Sep 10 20:59:47 devstack quobyte-client[82807]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 10 20:59:47 devstack quobyte-client[82807]: Automatic minidump upload enabled by global system configuration Sep 10 20:59:47 devstack quobyte-client[82807]: Announcing HTTP status server address 172.24.4.1 Sep 10 20:59:47 devstack quobyte-client[82807]: Registered as service (uuid YxKUCLKL-k8Ys-gFvM-KBCd-vxRKScVfxIA3) Sep 10 20:59:47 devstack quobyte-client[82807]: Quobyte Client running as pid 82807 Sep 10 20:59:47 devstack quobyte-client[82807]: FUSE announces support for async read, posix locks, atomic O_TRUNC, export support, don't mask, splice write, splice move, splice read, flock, directory ioctl, auto invalidate data, readdir plus, readdir plus auto, async direct IO, writeback cache, no open support, parallel dirops, posix acl, handle killpriv, handle killpriv2 Sep 10 20:59:47 devstack quobyte-client[82807]: FUSE capabilities enabled: async read, posix locks, atomic O_TRUNC, don't mask, flock, readdir plus, async direct IO, posix acl Sep 10 20:59:47 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f76f415e-e1d9-49dc-b25a-1d6d6b209dec None None] CMD "mount.quobyte --disable-xattrs 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.836s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 20:59:47 devstack cinder-volume[82780]: INFO cinder.volume.drivers.quobyte [None req-f76f415e-e1d9-49dc-b25a-1d6d6b209dec None None] Mounting volume: 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b succeeded Sep 10 20:59:47 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-f76f415e-e1d9-49dc-b25a-1d6d6b209dec None None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 20:59:47 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-f76f415e-e1d9-49dc-b25a-1d6d6b209dec None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.935s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 20:59:47 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f76f415e-e1d9-49dc-b25a-1d6d6b209dec None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 20:59:47 devstack quobyte-client[82807]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 10 20:59:47 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f76f415e-e1d9-49dc-b25a-1d6d6b209dec None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.147s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 20:59:47 devstack cinder-volume[82780]: INFO cinder.volume.driver [None req-f76f415e-e1d9-49dc-b25a-1d6d6b209dec None None] Driver hasn't implemented _init_vendor_properties() Sep 10 20:59:47 devstack cinder-volume[82780]: DEBUG cinder.volume.driver [None req-f76f415e-e1d9-49dc-b25a-1d6d6b209dec None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.9144744873047, 'free_capacity_gb': 924.9144744873047, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82780) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:860}} Sep 10 20:59:47 devstack cinder-volume[82780]: DEBUG oslo_db.sqlalchemy.engines [None req-f76f415e-e1d9-49dc-b25a-1d6d6b209dec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82780) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 10 20:59:47 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writer thread running {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Sep 10 20:59:47 devstack cinder-volume[82780]: DEBUG cinder.db.sqlalchemy.api [None req-f76f415e-e1d9-49dc-b25a-1d6d6b209dec None None] Building query based on filter {{(pid=82780) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}} Sep 10 20:59:47 devstack cinder-volume[82780]: DEBUG cinder.image.image_utils [None req-f76f415e-e1d9-49dc-b25a-1d6d6b209dec None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82780) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}} Sep 10 20:59:47 devstack cinder-volume[82780]: INFO cinder.keymgr.migration [None req-6f21f664-34d8-4d10-b93f-c8560647c574 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 10 20:59:47 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-f76f415e-e1d9-49dc-b25a-1d6d6b209dec None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 20:59:47 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-f76f415e-e1d9-49dc-b25a-1d6d6b209dec None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 20:59:47 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-f76f415e-e1d9-49dc-b25a-1d6d6b209dec None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 20:59:48 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-f76f415e-e1d9-49dc-b25a-1d6d6b209dec None None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 20:59:48 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-f76f415e-e1d9-49dc-b25a-1d6d6b209dec None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 20:59:48 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f76f415e-e1d9-49dc-b25a-1d6d6b209dec None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 20:59:48 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f76f415e-e1d9-49dc-b25a-1d6d6b209dec None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.149s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 20:59:48 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-f76f415e-e1d9-49dc-b25a-1d6d6b209dec None None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 20:59:48 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-f76f415e-e1d9-49dc-b25a-1d6d6b209dec None None] Driver initialization completed successfully. Sep 10 20:59:48 devstack cinder-volume[82780]: INFO cinder.manager [None req-f76f415e-e1d9-49dc-b25a-1d6d6b209dec None None] Initiating service 3 cleanup Sep 10 20:59:48 devstack cinder-volume[82780]: INFO cinder.manager [None req-f76f415e-e1d9-49dc-b25a-1d6d6b209dec None None] Service 3 cleanup completed. Sep 10 20:59:48 devstack cinder-volume[82780]: DEBUG cinder.service [None req-f76f415e-e1d9-49dc-b25a-1d6d6b209dec None None] Creating RPC server for service cinder-volume {{(pid=82780) start /opt/stack/cinder/cinder/service.py:239}} Sep 10 20:59:48 devstack cinder-volume[82780]: DEBUG cinder.service [None req-f76f415e-e1d9-49dc-b25a-1d6d6b209dec None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82780) start /opt/stack/cinder/cinder/service.py:245}} Sep 10 20:59:48 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-f76f415e-e1d9-49dc-b25a-1d6d6b209dec None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.13) Sep 10 20:59:48 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-f76f415e-e1d9-49dc-b25a-1d6d6b209dec None None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 20:59:48 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-f76f415e-e1d9-49dc-b25a-1d6d6b209dec None None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 20:59:48 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-f76f415e-e1d9-49dc-b25a-1d6d6b209dec None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 20:59:48 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-f76f415e-e1d9-49dc-b25a-1d6d6b209dec None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 20:59:48 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-f76f415e-e1d9-49dc-b25a-1d6d6b209dec None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 20:59:48 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-f76f415e-e1d9-49dc-b25a-1d6d6b209dec None None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 20:59:48 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-f76f415e-e1d9-49dc-b25a-1d6d6b209dec None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 20:59:48 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f76f415e-e1d9-49dc-b25a-1d6d6b209dec None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 20:59:49 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f76f415e-e1d9-49dc-b25a-1d6d6b209dec None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.168s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 20:59:49 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-f76f415e-e1d9-49dc-b25a-1d6d6b209dec None None] Driver post RPC initialization completed successfully. Sep 10 20:59:49 devstack quobyte-client[82807]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 10 20:59:54 devstack cinder-volume[82574]: DEBUG dbcounter [-] [82574] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=82574) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 20:59:59 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 20:59:59 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:00:47 devstack quobyte-client[82807]: Global clock drift changed by 258 ms Sep 10 21:00:56 devstack cinder-volume[82780]: DEBUG oslo_service.periodic_task [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82780) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 21:00:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:00:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:00:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:00:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:00:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:00:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:00:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.131s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:00:56 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:01:16 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-895468a6-e1ac-44ba-b3b3-b4842725cd96 tempest-VolumesAssistedSnapshotsTest-1162376033 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:01:16 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-895468a6-e1ac-44ba-b3b3-b4842725cd96 tempest-VolumesAssistedSnapshotsTest-1162376033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:01:17 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-895468a6-e1ac-44ba-b3b3-b4842725cd96 tempest-VolumesAssistedSnapshotsTest-1162376033 None] Flow 'volume_create_manager' (5554f383-0b0e-48b5-ab64-8b793d0d40b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:01:17 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-895468a6-e1ac-44ba-b3b3-b4842725cd96 tempest-VolumesAssistedSnapshotsTest-1162376033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58b5892a-df32-464a-a4e9-d25454d1af5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:01:18 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-895468a6-e1ac-44ba-b3b3-b4842725cd96 tempest-VolumesAssistedSnapshotsTest-1162376033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58b5892a-df32-464a-a4e9-d25454d1af5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:01:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-257605315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=427956fa-d4a1-4e24-9b01-becd9d15f7c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebbd3fe7df0b41aeb80984a6fa44f658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:01:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:01:16Z,use_quota=True,user_id='c3cb99ad3c77459987461655eeef654a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:01:18 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-895468a6-e1ac-44ba-b3b3-b4842725cd96 tempest-VolumesAssistedSnapshotsTest-1162376033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daf22b66-2343-4802-973e-d151e156e814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:01:18 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-895468a6-e1ac-44ba-b3b3-b4842725cd96 tempest-VolumesAssistedSnapshotsTest-1162376033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daf22b66-2343-4802-973e-d151e156e814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:01:18 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-895468a6-e1ac-44ba-b3b3-b4842725cd96 tempest-VolumesAssistedSnapshotsTest-1162376033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa8d3420-ea52-41af-9430-b5a0a8acd835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:01:18 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-895468a6-e1ac-44ba-b3b3-b4842725cd96 tempest-VolumesAssistedSnapshotsTest-1162376033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa8d3420-ea52-41af-9430-b5a0a8acd835) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '427956fa-d4a1-4e24-9b01-becd9d15f7c5', 'volume_name': 'volume-427956fa-d4a1-4e24-9b01-becd9d15f7c5', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:01:18 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-895468a6-e1ac-44ba-b3b3-b4842725cd96 tempest-VolumesAssistedSnapshotsTest-1162376033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9f02866-b066-4bb9-9b9e-231d06a2a816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:01:18 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-895468a6-e1ac-44ba-b3b3-b4842725cd96 tempest-VolumesAssistedSnapshotsTest-1162376033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9f02866-b066-4bb9-9b9e-231d06a2a816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:01:18 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-895468a6-e1ac-44ba-b3b3-b4842725cd96 tempest-VolumesAssistedSnapshotsTest-1162376033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0e9388c-2b34-4e67-8815-793a080f88cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:01:18 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-895468a6-e1ac-44ba-b3b3-b4842725cd96 tempest-VolumesAssistedSnapshotsTest-1162376033 None] Volume 427956fa-d4a1-4e24-9b01-becd9d15f7c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-427956fa-d4a1-4e24-9b01-becd9d15f7c5', 'volume_size': 1} Sep 10 21:01:18 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-895468a6-e1ac-44ba-b3b3-b4842725cd96 tempest-VolumesAssistedSnapshotsTest-1162376033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:01:18 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-895468a6-e1ac-44ba-b3b3-b4842725cd96 tempest-VolumesAssistedSnapshotsTest-1162376033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.013s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:01:18 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-895468a6-e1ac-44ba-b3b3-b4842725cd96 tempest-VolumesAssistedSnapshotsTest-1162376033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:01:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-257605315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=427956fa-d4a1-4e24-9b01-becd9d15f7c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebbd3fe7df0b41aeb80984a6fa44f658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:01:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:01:16Z,use_quota=True,user_id='c3cb99ad3c77459987461655eeef654a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:01:18 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-895468a6-e1ac-44ba-b3b3-b4842725cd96 tempest-VolumesAssistedSnapshotsTest-1162376033 None] Creating volume 427956fa-d4a1-4e24-9b01-becd9d15f7c5 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:01:18 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-895468a6-e1ac-44ba-b3b3-b4842725cd96 tempest-VolumesAssistedSnapshotsTest-1162376033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:01:18 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-895468a6-e1ac-44ba-b3b3-b4842725cd96 tempest-VolumesAssistedSnapshotsTest-1162376033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:01:18 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-895468a6-e1ac-44ba-b3b3-b4842725cd96 tempest-VolumesAssistedSnapshotsTest-1162376033 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:01:18 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-895468a6-e1ac-44ba-b3b3-b4842725cd96 tempest-VolumesAssistedSnapshotsTest-1162376033 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:01:18 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-895468a6-e1ac-44ba-b3b3-b4842725cd96 tempest-VolumesAssistedSnapshotsTest-1162376033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:01:18 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-895468a6-e1ac-44ba-b3b3-b4842725cd96 tempest-VolumesAssistedSnapshotsTest-1162376033 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:01:18 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-895468a6-e1ac-44ba-b3b3-b4842725cd96 tempest-VolumesAssistedSnapshotsTest-1162376033 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:01:18 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-895468a6-e1ac-44ba-b3b3-b4842725cd96 tempest-VolumesAssistedSnapshotsTest-1162376033 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-427956fa-d4a1-4e24-9b01-becd9d15f7c5 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:01:18 devstack quobyte-client[82807]: System call of process 83262 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:01:19 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=2, name=volume-427956fa-d4a1-4e24-9b01-becd9d15f7c5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:01:19 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-895468a6-e1ac-44ba-b3b3-b4842725cd96 tempest-VolumesAssistedSnapshotsTest-1162376033 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-427956fa-d4a1-4e24-9b01-becd9d15f7c5 1073741824" returned: 0 in 1.118s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:01:19 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-895468a6-e1ac-44ba-b3b3-b4842725cd96 tempest-VolumesAssistedSnapshotsTest-1162376033 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-427956fa-d4a1-4e24-9b01-becd9d15f7c5 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:01:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-895468a6-e1ac-44ba-b3b3-b4842725cd96 tempest-VolumesAssistedSnapshotsTest-1162376033 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-427956fa-d4a1-4e24-9b01-becd9d15f7c5" returned: 0 in 0.213s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:01:20 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-895468a6-e1ac-44ba-b3b3-b4842725cd96 tempest-VolumesAssistedSnapshotsTest-1162376033 None] <== create_volume: return (1670ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:01:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-895468a6-e1ac-44ba-b3b3-b4842725cd96 tempest-VolumesAssistedSnapshotsTest-1162376033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.778s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:01:20 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-895468a6-e1ac-44ba-b3b3-b4842725cd96 tempest-VolumesAssistedSnapshotsTest-1162376033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0e9388c-2b34-4e67-8815-793a080f88cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-427956fa-d4a1-4e24-9b01-becd9d15f7c5', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:01:20 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-895468a6-e1ac-44ba-b3b3-b4842725cd96 tempest-VolumesAssistedSnapshotsTest-1162376033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (653fe451-a0c1-457b-ac15-e16c5cfe513a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:01:20 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-895468a6-e1ac-44ba-b3b3-b4842725cd96 tempest-VolumesAssistedSnapshotsTest-1162376033 None] Volume volume-427956fa-d4a1-4e24-9b01-becd9d15f7c5 (427956fa-d4a1-4e24-9b01-becd9d15f7c5): created successfully Sep 10 21:01:20 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-895468a6-e1ac-44ba-b3b3-b4842725cd96 tempest-VolumesAssistedSnapshotsTest-1162376033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (653fe451-a0c1-457b-ac15-e16c5cfe513a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:01:20 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-895468a6-e1ac-44ba-b3b3-b4842725cd96 tempest-VolumesAssistedSnapshotsTest-1162376033 None] Flow 'volume_create_manager' (5554f383-0b0e-48b5-ab64-8b793d0d40b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:01:20 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-895468a6-e1ac-44ba-b3b3-b4842725cd96 tempest-VolumesAssistedSnapshotsTest-1162376033 None] Created volume successfully. Sep 10 21:01:24 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-44df54fc-5594-48e9-bf15-3d4c22e89c45 tempest-DeleteServersTestJSON-153764293 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:01:24 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-44df54fc-5594-48e9-bf15-3d4c22e89c45 tempest-DeleteServersTestJSON-153764293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:01:24 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-44df54fc-5594-48e9-bf15-3d4c22e89c45 tempest-DeleteServersTestJSON-153764293 None] Flow 'volume_create_manager' (8ec1f874-5c3f-471a-b6f9-c0080e60611e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:01:24 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-44df54fc-5594-48e9-bf15-3d4c22e89c45 tempest-DeleteServersTestJSON-153764293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1510a804-373e-4c49-8127-847be5b19cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:01:25 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-44df54fc-5594-48e9-bf15-3d4c22e89c45 tempest-DeleteServersTestJSON-153764293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1510a804-373e-4c49-8127-847be5b19cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:01:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-785466532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ec3b7a7-0551-45de-afff-3bf0386e641d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39882d735d704e8b9e5b47931f2dde25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:01:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:01:24Z,use_quota=True,user_id='e5a8cd0f49894e5cb246ecef2171fc3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:01:25 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-44df54fc-5594-48e9-bf15-3d4c22e89c45 tempest-DeleteServersTestJSON-153764293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cbd338f-13e4-4e26-b8e5-36c0fe711444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:01:25 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-44df54fc-5594-48e9-bf15-3d4c22e89c45 tempest-DeleteServersTestJSON-153764293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cbd338f-13e4-4e26-b8e5-36c0fe711444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:01:25 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-44df54fc-5594-48e9-bf15-3d4c22e89c45 tempest-DeleteServersTestJSON-153764293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0e636d6-bf35-4fd4-a1ba-57f014d5ea11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:01:25 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-44df54fc-5594-48e9-bf15-3d4c22e89c45 tempest-DeleteServersTestJSON-153764293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0e636d6-bf35-4fd4-a1ba-57f014d5ea11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ec3b7a7-0551-45de-afff-3bf0386e641d', 'volume_name': 'volume-5ec3b7a7-0551-45de-afff-3bf0386e641d', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:01:25 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-44df54fc-5594-48e9-bf15-3d4c22e89c45 tempest-DeleteServersTestJSON-153764293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (828224b5-fe98-4c7b-948a-6b739edcaf4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:01:25 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-44df54fc-5594-48e9-bf15-3d4c22e89c45 tempest-DeleteServersTestJSON-153764293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (828224b5-fe98-4c7b-948a-6b739edcaf4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:01:25 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-44df54fc-5594-48e9-bf15-3d4c22e89c45 tempest-DeleteServersTestJSON-153764293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (587966e1-02bf-464d-92ba-097359adb70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:01:25 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-44df54fc-5594-48e9-bf15-3d4c22e89c45 tempest-DeleteServersTestJSON-153764293 None] Volume 5ec3b7a7-0551-45de-afff-3bf0386e641d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ec3b7a7-0551-45de-afff-3bf0386e641d', 'volume_size': 1} Sep 10 21:01:25 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-44df54fc-5594-48e9-bf15-3d4c22e89c45 tempest-DeleteServersTestJSON-153764293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:01:25 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-44df54fc-5594-48e9-bf15-3d4c22e89c45 tempest-DeleteServersTestJSON-153764293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.013s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:01:25 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-44df54fc-5594-48e9-bf15-3d4c22e89c45 tempest-DeleteServersTestJSON-153764293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:01:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-785466532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ec3b7a7-0551-45de-afff-3bf0386e641d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39882d735d704e8b9e5b47931f2dde25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:01:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:01:24Z,use_quota=True,user_id='e5a8cd0f49894e5cb246ecef2171fc3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:01:25 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-44df54fc-5594-48e9-bf15-3d4c22e89c45 tempest-DeleteServersTestJSON-153764293 None] Creating volume 5ec3b7a7-0551-45de-afff-3bf0386e641d {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:01:25 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-44df54fc-5594-48e9-bf15-3d4c22e89c45 tempest-DeleteServersTestJSON-153764293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:01:25 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-44df54fc-5594-48e9-bf15-3d4c22e89c45 tempest-DeleteServersTestJSON-153764293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:01:25 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-44df54fc-5594-48e9-bf15-3d4c22e89c45 tempest-DeleteServersTestJSON-153764293 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:01:25 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-44df54fc-5594-48e9-bf15-3d4c22e89c45 tempest-DeleteServersTestJSON-153764293 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:01:25 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-44df54fc-5594-48e9-bf15-3d4c22e89c45 tempest-DeleteServersTestJSON-153764293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.086s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:01:25 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-44df54fc-5594-48e9-bf15-3d4c22e89c45 tempest-DeleteServersTestJSON-153764293 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:01:25 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-44df54fc-5594-48e9-bf15-3d4c22e89c45 tempest-DeleteServersTestJSON-153764293 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:01:25 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-44df54fc-5594-48e9-bf15-3d4c22e89c45 tempest-DeleteServersTestJSON-153764293 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5ec3b7a7-0551-45de-afff-3bf0386e641d 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:01:26 devstack quobyte-client[82807]: System call of process 83598 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:01:26 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=3, name=volume-5ec3b7a7-0551-45de-afff-3bf0386e641d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:01:27 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-44df54fc-5594-48e9-bf15-3d4c22e89c45 tempest-DeleteServersTestJSON-153764293 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5ec3b7a7-0551-45de-afff-3bf0386e641d 1073741824" returned: 0 in 1.689s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:01:27 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-44df54fc-5594-48e9-bf15-3d4c22e89c45 tempest-DeleteServersTestJSON-153764293 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5ec3b7a7-0551-45de-afff-3bf0386e641d {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:01:28 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-44df54fc-5594-48e9-bf15-3d4c22e89c45 tempest-DeleteServersTestJSON-153764293 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5ec3b7a7-0551-45de-afff-3bf0386e641d" returned: 0 in 0.691s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:01:28 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-44df54fc-5594-48e9-bf15-3d4c22e89c45 tempest-DeleteServersTestJSON-153764293 None] <== create_volume: return (2779ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:01:28 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-44df54fc-5594-48e9-bf15-3d4c22e89c45 tempest-DeleteServersTestJSON-153764293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.828s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:01:29 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-44df54fc-5594-48e9-bf15-3d4c22e89c45 tempest-DeleteServersTestJSON-153764293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (587966e1-02bf-464d-92ba-097359adb70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ec3b7a7-0551-45de-afff-3bf0386e641d', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:01:29 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-44df54fc-5594-48e9-bf15-3d4c22e89c45 tempest-DeleteServersTestJSON-153764293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d6ebc4c-863f-4f53-b9c4-c22c43d896a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:01:29 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-44df54fc-5594-48e9-bf15-3d4c22e89c45 tempest-DeleteServersTestJSON-153764293 None] Volume volume-5ec3b7a7-0551-45de-afff-3bf0386e641d (5ec3b7a7-0551-45de-afff-3bf0386e641d): created successfully Sep 10 21:01:29 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-44df54fc-5594-48e9-bf15-3d4c22e89c45 tempest-DeleteServersTestJSON-153764293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d6ebc4c-863f-4f53-b9c4-c22c43d896a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:01:29 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-44df54fc-5594-48e9-bf15-3d4c22e89c45 tempest-DeleteServersTestJSON-153764293 None] Flow 'volume_create_manager' (8ec1f874-5c3f-471a-b6f9-c0080e60611e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:01:29 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-44df54fc-5594-48e9-bf15-3d4c22e89c45 tempest-DeleteServersTestJSON-153764293 None] Created volume successfully. Sep 10 21:01:39 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:UPDATE=4,cinder:SELECT=1 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:01:39 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=3,cinder:UPDATE=4,cinder:DELETE=2 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:01:47 devstack quobyte-client[82807]: Global clock drift changed by -261 ms Sep 10 21:01:56 devstack cinder-volume[82780]: DEBUG oslo_service.periodic_task [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82780) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 21:01:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:01:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.014s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:01:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:01:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:01:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.060s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:01:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:01:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.553s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:01:57 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:01:59 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:02:12 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-af1416c9-c6e5-4ba3-9a7b-0809d7d6c53d req-0ec12695-b2cd-4d42-8791-63f5a07a92ec tempest-DeleteServersTestJSON-153764293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:02:12 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-af1416c9-c6e5-4ba3-9a7b-0809d7d6c53d req-0ec12695-b2cd-4d42-8791-63f5a07a92ec tempest-DeleteServersTestJSON-153764293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:02:12 devstack cinder-volume[82780]: INFO oslo.privsep.daemon [req-af1416c9-c6e5-4ba3-9a7b-0809d7d6c53d req-0ec12695-b2cd-4d42-8791-63f5a07a92ec tempest-DeleteServersTestJSON-153764293 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpubitispx/privsep.sock'] Sep 10 21:02:13 devstack sudo[83827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpubitispx/privsep.sock Sep 10 21:02:13 devstack sudo[83827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 21:02:22 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=2 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:02:25 devstack sudo[83827]: pam_unix(sudo:session): session closed for user root Sep 10 21:02:25 devstack cinder-volume[82780]: INFO oslo.privsep.daemon [req-af1416c9-c6e5-4ba3-9a7b-0809d7d6c53d req-0ec12695-b2cd-4d42-8791-63f5a07a92ec tempest-DeleteServersTestJSON-153764293 None] Spawned new privsep daemon via rootwrap Sep 10 21:02:25 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [req-af1416c9-c6e5-4ba3-9a7b-0809d7d6c53d req-0ec12695-b2cd-4d42-8791-63f5a07a92ec tempest-DeleteServersTestJSON-153764293 None] Accepted privsep connection to /tmp/tmpubitispx/privsep.sock {{(pid=82780) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:377}} Sep 10 21:02:25 devstack cinder-volume[82780]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 10 21:02:25 devstack cinder-volume[82780]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 10 21:02:25 devstack cinder-volume[82780]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 10 21:02:25 devstack cinder-volume[82780]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83915 Sep 10 21:02:25 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f829baf6-104c-48dd-bd5c-01981148e256]: (2,) {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:02:25 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1d53d7-10e0-42cd-96de-b7ff1cba4e57]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:02:25 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-af1416c9-c6e5-4ba3-9a7b-0809d7d6c53d req-0ec12695-b2cd-4d42-8791-63f5a07a92ec tempest-DeleteServersTestJSON-153764293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5ec3b7a7-0551-45de-afff-3bf0386e641d {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:02:26 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-af1416c9-c6e5-4ba3-9a7b-0809d7d6c53d req-0ec12695-b2cd-4d42-8791-63f5a07a92ec tempest-DeleteServersTestJSON-153764293 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5ec3b7a7-0551-45de-afff-3bf0386e641d" returned: 0 in 1.031s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:02:26 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-af1416c9-c6e5-4ba3-9a7b-0809d7d6c53d req-0ec12695-b2cd-4d42-8791-63f5a07a92ec tempest-DeleteServersTestJSON-153764293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 13.634s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:02:26 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-af1416c9-c6e5-4ba3-9a7b-0809d7d6c53d req-0ec12695-b2cd-4d42-8791-63f5a07a92ec tempest-DeleteServersTestJSON-153764293 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b', 'name': 'volume-5ec3b7a7-0551-45de-afff-3bf0386e641d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cae8c9a3-90ce-4b9b-b385-f205384eb4a4', 'enforce_multipath': True} {{(pid=82780) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 21:02:26 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-af1416c9-c6e5-4ba3-9a7b-0809d7d6c53d req-0ec12695-b2cd-4d42-8791-63f5a07a92ec tempest-DeleteServersTestJSON-153764293 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:02:27 devstack cinder-volume[82780]: INFO cinder.volume.manager [req-af1416c9-c6e5-4ba3-9a7b-0809d7d6c53d req-0ec12695-b2cd-4d42-8791-63f5a07a92ec tempest-DeleteServersTestJSON-153764293 None] attachment_update completed successfully. Sep 10 21:02:37 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:02:37 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:02:46 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-a14dad03-4ba5-4086-9e11-465144807dbe req-79eb8935-15e4-4aee-bced-ff37a51d1828 tempest-DeleteServersTestJSON-153764293 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:02:46 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-a14dad03-4ba5-4086-9e11-465144807dbe req-79eb8935-15e4-4aee-bced-ff37a51d1828 tempest-DeleteServersTestJSON-153764293 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:02:46 devstack cinder-volume[82780]: INFO cinder.volume.manager [req-a14dad03-4ba5-4086-9e11-465144807dbe req-79eb8935-15e4-4aee-bced-ff37a51d1828 tempest-DeleteServersTestJSON-153764293 None] Terminate volume connection completed successfully. Sep 10 21:02:46 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-a14dad03-4ba5-4086-9e11-465144807dbe req-79eb8935-15e4-4aee-bced-ff37a51d1828 tempest-DeleteServersTestJSON-153764293 None] Deleting attachment cae8c9a3-90ce-4b9b-b385-f205384eb4a4. {{(pid=82780) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 21:02:51 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-eeaee7db-5ce1-4c8c-9605-1e3195bd8927 tempest-DeleteServersTestJSON-153764293 None] Acquiring lock "cinder-5ec3b7a7-0551-45de-afff-3bf0386e641d-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:02:51 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-eeaee7db-5ce1-4c8c-9605-1e3195bd8927 tempest-DeleteServersTestJSON-153764293 None] Lock "cinder-5ec3b7a7-0551-45de-afff-3bf0386e641d-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:02:51 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-eeaee7db-5ce1-4c8c-9605-1e3195bd8927 tempest-DeleteServersTestJSON-153764293 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:02:51 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-eeaee7db-5ce1-4c8c-9605-1e3195bd8927 tempest-DeleteServersTestJSON-153764293 None] Acquiring lock "cinder-quobyte-5ec3b7a7-0551-45de-afff-3bf0386e641d" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:02:51 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-eeaee7db-5ce1-4c8c-9605-1e3195bd8927 tempest-DeleteServersTestJSON-153764293 None] Lock "cinder-quobyte-5ec3b7a7-0551-45de-afff-3bf0386e641d" acquired by "delete_volume" :: waited 0.025s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:02:51 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e0f8c5-5b05-4bf3-b2a0-b75358869df1]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:02:51 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-eeaee7db-5ce1-4c8c-9605-1e3195bd8927 tempest-DeleteServersTestJSON-153764293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5ec3b7a7-0551-45de-afff-3bf0386e641d {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:02:51 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-eeaee7db-5ce1-4c8c-9605-1e3195bd8927 tempest-DeleteServersTestJSON-153764293 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5ec3b7a7-0551-45de-afff-3bf0386e641d" returned: 0 in 0.454s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:02:51 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-eeaee7db-5ce1-4c8c-9605-1e3195bd8927 tempest-DeleteServersTestJSON-153764293 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5ec3b7a7-0551-45de-afff-3bf0386e641d {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:02:52 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-eeaee7db-5ce1-4c8c-9605-1e3195bd8927 tempest-DeleteServersTestJSON-153764293 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5ec3b7a7-0551-45de-afff-3bf0386e641d" returned: 0 in 0.120s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:02:52 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-eeaee7db-5ce1-4c8c-9605-1e3195bd8927 tempest-DeleteServersTestJSON-153764293 None] Lock "cinder-quobyte-5ec3b7a7-0551-45de-afff-3bf0386e641d" released by "delete_volume" :: held 0.726s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:02:52 devstack cinder-volume[82780]: WARNING cinder.quota [None req-eeaee7db-5ce1-4c8c-9605-1e3195bd8927 tempest-DeleteServersTestJSON-153764293 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 10 21:02:52 devstack cinder-volume[82780]: WARNING cinder.quota [None req-eeaee7db-5ce1-4c8c-9605-1e3195bd8927 tempest-DeleteServersTestJSON-153764293 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 10 21:02:52 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-eeaee7db-5ce1-4c8c-9605-1e3195bd8927 tempest-DeleteServersTestJSON-153764293 None] Created reservations ['be1f6295-0f73-45f3-b526-c15ece67f479', '0d446aa2-89b2-451a-a574-172192083cb8', '60d45a1f-adce-4c63-8b47-bd8104a74f07', '17556c32-cd7c-4465-86af-d7669744745c'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:02:52 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-eeaee7db-5ce1-4c8c-9605-1e3195bd8927 tempest-DeleteServersTestJSON-153764293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:02:52 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-eeaee7db-5ce1-4c8c-9605-1e3195bd8927 tempest-DeleteServersTestJSON-153764293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:02:52 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-eeaee7db-5ce1-4c8c-9605-1e3195bd8927 tempest-DeleteServersTestJSON-153764293 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:02:52 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-eeaee7db-5ce1-4c8c-9605-1e3195bd8927 tempest-DeleteServersTestJSON-153764293 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:02:52 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-eeaee7db-5ce1-4c8c-9605-1e3195bd8927 tempest-DeleteServersTestJSON-153764293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:02:52 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-eeaee7db-5ce1-4c8c-9605-1e3195bd8927 tempest-DeleteServersTestJSON-153764293 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:02:52 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-eeaee7db-5ce1-4c8c-9605-1e3195bd8927 tempest-DeleteServersTestJSON-153764293 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.097s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:02:52 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-eeaee7db-5ce1-4c8c-9605-1e3195bd8927 tempest-DeleteServersTestJSON-153764293 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:02:52 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-eeaee7db-5ce1-4c8c-9605-1e3195bd8927 tempest-DeleteServersTestJSON-153764293 None] Deleted volume successfully. Sep 10 21:02:53 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-eeaee7db-5ce1-4c8c-9605-1e3195bd8927 tempest-DeleteServersTestJSON-153764293 None] Lock "cinder-5ec3b7a7-0551-45de-afff-3bf0386e641d-delete_volume" released by "delete_volume" :: held 1.784s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:02:56 devstack cinder-volume[82780]: DEBUG oslo_service.periodic_task [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82780) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 21:02:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:02:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:02:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:02:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:02:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:02:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:02:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.164s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:02:56 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:03:02 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:UPDATE=7,cinder:SELECT=3 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:03:03 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=9,cinder:INSERT=4,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:03:13 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-e4eba347-08c7-4ab0-bdc0-597d39c6ee13 tempest-AttachSCSIVolumeTestJSON-1482538539 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:03:14 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4eba347-08c7-4ab0-bdc0-597d39c6ee13 tempest-AttachSCSIVolumeTestJSON-1482538539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:03:14 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-e4eba347-08c7-4ab0-bdc0-597d39c6ee13 tempest-AttachSCSIVolumeTestJSON-1482538539 None] Flow 'volume_create_manager' (a409e0e8-eaf5-4cf3-9b18-dcfd87ca9d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:03:14 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-e4eba347-08c7-4ab0-bdc0-597d39c6ee13 tempest-AttachSCSIVolumeTestJSON-1482538539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30444d7a-ca60-4157-86d9-c03d038a2b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:03:14 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-e4eba347-08c7-4ab0-bdc0-597d39c6ee13 tempest-AttachSCSIVolumeTestJSON-1482538539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30444d7a-ca60-4157-86d9-c03d038a2b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:03:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-2007775548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71c10021-06bb-4748-8067-dac36714dd7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09700849225342bc88aba684fcbdb7be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:03:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:03:13Z,use_quota=True,user_id='d1b669ab74a6405db03a5ca660c7d44a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:03:14 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-e4eba347-08c7-4ab0-bdc0-597d39c6ee13 tempest-AttachSCSIVolumeTestJSON-1482538539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e71f5ceb-cd3b-42e8-b88e-462c313a7ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:03:14 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-e4eba347-08c7-4ab0-bdc0-597d39c6ee13 tempest-AttachSCSIVolumeTestJSON-1482538539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e71f5ceb-cd3b-42e8-b88e-462c313a7ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:03:14 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-e4eba347-08c7-4ab0-bdc0-597d39c6ee13 tempest-AttachSCSIVolumeTestJSON-1482538539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c67bb770-03f1-4418-a706-de20c2fed7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:03:14 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-e4eba347-08c7-4ab0-bdc0-597d39c6ee13 tempest-AttachSCSIVolumeTestJSON-1482538539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c67bb770-03f1-4418-a706-de20c2fed7e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71c10021-06bb-4748-8067-dac36714dd7c', 'volume_name': 'volume-71c10021-06bb-4748-8067-dac36714dd7c', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:03:14 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-e4eba347-08c7-4ab0-bdc0-597d39c6ee13 tempest-AttachSCSIVolumeTestJSON-1482538539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2089f957-ff91-4992-b8bc-48ba0c101cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:03:14 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-e4eba347-08c7-4ab0-bdc0-597d39c6ee13 tempest-AttachSCSIVolumeTestJSON-1482538539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2089f957-ff91-4992-b8bc-48ba0c101cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:03:14 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-e4eba347-08c7-4ab0-bdc0-597d39c6ee13 tempest-AttachSCSIVolumeTestJSON-1482538539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cc6881b-9f13-4448-a7db-7dfbaa32c037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:03:14 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-e4eba347-08c7-4ab0-bdc0-597d39c6ee13 tempest-AttachSCSIVolumeTestJSON-1482538539 None] Volume 71c10021-06bb-4748-8067-dac36714dd7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71c10021-06bb-4748-8067-dac36714dd7c', 'volume_size': 1} Sep 10 21:03:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-e4eba347-08c7-4ab0-bdc0-597d39c6ee13 tempest-AttachSCSIVolumeTestJSON-1482538539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:03:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-e4eba347-08c7-4ab0-bdc0-597d39c6ee13 tempest-AttachSCSIVolumeTestJSON-1482538539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:03:14 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-e4eba347-08c7-4ab0-bdc0-597d39c6ee13 tempest-AttachSCSIVolumeTestJSON-1482538539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:03:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-2007775548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71c10021-06bb-4748-8067-dac36714dd7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09700849225342bc88aba684fcbdb7be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:03:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:03:13Z,use_quota=True,user_id='d1b669ab74a6405db03a5ca660c7d44a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:03:14 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-e4eba347-08c7-4ab0-bdc0-597d39c6ee13 tempest-AttachSCSIVolumeTestJSON-1482538539 None] Creating volume 71c10021-06bb-4748-8067-dac36714dd7c {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:03:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-e4eba347-08c7-4ab0-bdc0-597d39c6ee13 tempest-AttachSCSIVolumeTestJSON-1482538539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:03:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-e4eba347-08c7-4ab0-bdc0-597d39c6ee13 tempest-AttachSCSIVolumeTestJSON-1482538539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:03:14 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-e4eba347-08c7-4ab0-bdc0-597d39c6ee13 tempest-AttachSCSIVolumeTestJSON-1482538539 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:03:14 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-e4eba347-08c7-4ab0-bdc0-597d39c6ee13 tempest-AttachSCSIVolumeTestJSON-1482538539 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:03:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-e4eba347-08c7-4ab0-bdc0-597d39c6ee13 tempest-AttachSCSIVolumeTestJSON-1482538539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:03:14 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-e4eba347-08c7-4ab0-bdc0-597d39c6ee13 tempest-AttachSCSIVolumeTestJSON-1482538539 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:03:14 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-e4eba347-08c7-4ab0-bdc0-597d39c6ee13 tempest-AttachSCSIVolumeTestJSON-1482538539 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:03:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e4eba347-08c7-4ab0-bdc0-597d39c6ee13 tempest-AttachSCSIVolumeTestJSON-1482538539 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-71c10021-06bb-4748-8067-dac36714dd7c 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:03:14 devstack quobyte-client[82807]: System call of process 84568 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:03:14 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=4, name=volume-71c10021-06bb-4748-8067-dac36714dd7c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:03:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e4eba347-08c7-4ab0-bdc0-597d39c6ee13 tempest-AttachSCSIVolumeTestJSON-1482538539 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-71c10021-06bb-4748-8067-dac36714dd7c 1073741824" returned: 0 in 0.590s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:03:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e4eba347-08c7-4ab0-bdc0-597d39c6ee13 tempest-AttachSCSIVolumeTestJSON-1482538539 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-71c10021-06bb-4748-8067-dac36714dd7c {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:03:15 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e4eba347-08c7-4ab0-bdc0-597d39c6ee13 tempest-AttachSCSIVolumeTestJSON-1482538539 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-71c10021-06bb-4748-8067-dac36714dd7c" returned: 0 in 0.273s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:03:15 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-e4eba347-08c7-4ab0-bdc0-597d39c6ee13 tempest-AttachSCSIVolumeTestJSON-1482538539 None] <== create_volume: return (1013ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:03:15 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-e4eba347-08c7-4ab0-bdc0-597d39c6ee13 tempest-AttachSCSIVolumeTestJSON-1482538539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:03:15 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-e4eba347-08c7-4ab0-bdc0-597d39c6ee13 tempest-AttachSCSIVolumeTestJSON-1482538539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cc6881b-9f13-4448-a7db-7dfbaa32c037) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71c10021-06bb-4748-8067-dac36714dd7c', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:03:15 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-e4eba347-08c7-4ab0-bdc0-597d39c6ee13 tempest-AttachSCSIVolumeTestJSON-1482538539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2e82e2b-c931-4b7f-acb0-2d5510104f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:03:15 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-e4eba347-08c7-4ab0-bdc0-597d39c6ee13 tempest-AttachSCSIVolumeTestJSON-1482538539 None] Volume volume-71c10021-06bb-4748-8067-dac36714dd7c (71c10021-06bb-4748-8067-dac36714dd7c): created successfully Sep 10 21:03:15 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-e4eba347-08c7-4ab0-bdc0-597d39c6ee13 tempest-AttachSCSIVolumeTestJSON-1482538539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2e82e2b-c931-4b7f-acb0-2d5510104f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:03:15 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-e4eba347-08c7-4ab0-bdc0-597d39c6ee13 tempest-AttachSCSIVolumeTestJSON-1482538539 None] Flow 'volume_create_manager' (a409e0e8-eaf5-4cf3-9b18-dcfd87ca9d1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:03:15 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-e4eba347-08c7-4ab0-bdc0-597d39c6ee13 tempest-AttachSCSIVolumeTestJSON-1482538539 None] Created volume successfully. Sep 10 21:03:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-207f3170-20b3-4489-907b-7ec17cea16f6 req-402e7283-094d-4953-a3dd-69f71a448306 tempest-AttachSCSIVolumeTestJSON-1482538539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:03:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-207f3170-20b3-4489-907b-7ec17cea16f6 req-402e7283-094d-4953-a3dd-69f71a448306 tempest-AttachSCSIVolumeTestJSON-1482538539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:03:20 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[134a5073-0aa8-417d-8496-71e7cff33551]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:03:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-207f3170-20b3-4489-907b-7ec17cea16f6 req-402e7283-094d-4953-a3dd-69f71a448306 tempest-AttachSCSIVolumeTestJSON-1482538539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-71c10021-06bb-4748-8067-dac36714dd7c {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:03:21 devstack quobyte-client[82807]: System call of process 84583 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:03:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-207f3170-20b3-4489-907b-7ec17cea16f6 req-402e7283-094d-4953-a3dd-69f71a448306 tempest-AttachSCSIVolumeTestJSON-1482538539 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-71c10021-06bb-4748-8067-dac36714dd7c" returned: 0 in 0.621s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:03:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-207f3170-20b3-4489-907b-7ec17cea16f6 req-402e7283-094d-4953-a3dd-69f71a448306 tempest-AttachSCSIVolumeTestJSON-1482538539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.705s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:03:21 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-207f3170-20b3-4489-907b-7ec17cea16f6 req-402e7283-094d-4953-a3dd-69f71a448306 tempest-AttachSCSIVolumeTestJSON-1482538539 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b', 'name': 'volume-71c10021-06bb-4748-8067-dac36714dd7c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '34a904b9-2685-4ac0-80b1-bcc716c117d1', 'enforce_multipath': True} {{(pid=82780) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 21:03:21 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-207f3170-20b3-4489-907b-7ec17cea16f6 req-402e7283-094d-4953-a3dd-69f71a448306 tempest-AttachSCSIVolumeTestJSON-1482538539 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:03:21 devstack cinder-volume[82780]: INFO cinder.volume.manager [req-207f3170-20b3-4489-907b-7ec17cea16f6 req-402e7283-094d-4953-a3dd-69f71a448306 tempest-AttachSCSIVolumeTestJSON-1482538539 None] attachment_update completed successfully. Sep 10 21:03:31 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:03:31 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:UPDATE=6,cinder:DELETE=1,cinder:SELECT=5 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:03:44 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-fbd3ae0d-298f-4506-ae14-6fff6f0e28a0 req-8017f293-8c01-4ad4-9488-3af59c1cce58 tempest-VolumesAssistedSnapshotsTest-1162376033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:03:44 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-fbd3ae0d-298f-4506-ae14-6fff6f0e28a0 req-8017f293-8c01-4ad4-9488-3af59c1cce58 tempest-VolumesAssistedSnapshotsTest-1162376033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.012s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:03:44 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b594dfa5-27d9-4b54-9f0f-a3877348d0e9]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:03:44 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-fbd3ae0d-298f-4506-ae14-6fff6f0e28a0 req-8017f293-8c01-4ad4-9488-3af59c1cce58 tempest-VolumesAssistedSnapshotsTest-1162376033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-427956fa-d4a1-4e24-9b01-becd9d15f7c5 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:03:45 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-fbd3ae0d-298f-4506-ae14-6fff6f0e28a0 req-8017f293-8c01-4ad4-9488-3af59c1cce58 tempest-VolumesAssistedSnapshotsTest-1162376033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-427956fa-d4a1-4e24-9b01-becd9d15f7c5" returned: 0 in 0.916s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:03:45 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-fbd3ae0d-298f-4506-ae14-6fff6f0e28a0 req-8017f293-8c01-4ad4-9488-3af59c1cce58 tempest-VolumesAssistedSnapshotsTest-1162376033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.166s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:03:46 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-fbd3ae0d-298f-4506-ae14-6fff6f0e28a0 req-8017f293-8c01-4ad4-9488-3af59c1cce58 tempest-VolumesAssistedSnapshotsTest-1162376033 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b', 'name': 'volume-427956fa-d4a1-4e24-9b01-becd9d15f7c5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5a8b51ed-409f-47d3-9e6e-b1a70f90e7f8', 'enforce_multipath': True} {{(pid=82780) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 21:03:46 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-fbd3ae0d-298f-4506-ae14-6fff6f0e28a0 req-8017f293-8c01-4ad4-9488-3af59c1cce58 tempest-VolumesAssistedSnapshotsTest-1162376033 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:03:47 devstack cinder-volume[82780]: INFO cinder.volume.manager [req-fbd3ae0d-298f-4506-ae14-6fff6f0e28a0 req-8017f293-8c01-4ad4-9488-3af59c1cce58 tempest-VolumesAssistedSnapshotsTest-1162376033 None] attachment_update completed successfully. Sep 10 21:03:51 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-e6f5eac7-04b1-4480-8cc4-852d98f053ca req-c5f28a6f-bc24-4c53-ac64-6045dc4d51d1 tempest-AttachSCSIVolumeTestJSON-1482538539 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:03:51 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-e6f5eac7-04b1-4480-8cc4-852d98f053ca req-c5f28a6f-bc24-4c53-ac64-6045dc4d51d1 tempest-AttachSCSIVolumeTestJSON-1482538539 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:03:51 devstack cinder-volume[82780]: INFO cinder.volume.manager [req-e6f5eac7-04b1-4480-8cc4-852d98f053ca req-c5f28a6f-bc24-4c53-ac64-6045dc4d51d1 tempest-AttachSCSIVolumeTestJSON-1482538539 None] Terminate volume connection completed successfully. Sep 10 21:03:51 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-e6f5eac7-04b1-4480-8cc4-852d98f053ca req-c5f28a6f-bc24-4c53-ac64-6045dc4d51d1 tempest-AttachSCSIVolumeTestJSON-1482538539 None] Deleting attachment 34a904b9-2685-4ac0-80b1-bcc716c117d1. {{(pid=82780) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 21:03:56 devstack cinder-volume[82780]: DEBUG oslo_service.periodic_task [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82780) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 21:03:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:03:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.035s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:03:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:03:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:03:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.100s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:03:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:03:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.335s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:03:57 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:03:59 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:04:01 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:04:08 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-8d79bc7c-00e2-4889-a3d1-e9f736ef3674 tempest-AttachSCSIVolumeTestJSON-1482538539 None] Acquiring lock "cinder-71c10021-06bb-4748-8067-dac36714dd7c-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:04:08 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-8d79bc7c-00e2-4889-a3d1-e9f736ef3674 tempest-AttachSCSIVolumeTestJSON-1482538539 None] Lock "cinder-71c10021-06bb-4748-8067-dac36714dd7c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:04:08 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-8d79bc7c-00e2-4889-a3d1-e9f736ef3674 tempest-AttachSCSIVolumeTestJSON-1482538539 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:04:08 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-8d79bc7c-00e2-4889-a3d1-e9f736ef3674 tempest-AttachSCSIVolumeTestJSON-1482538539 None] Acquiring lock "cinder-quobyte-71c10021-06bb-4748-8067-dac36714dd7c" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:04:09 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-8d79bc7c-00e2-4889-a3d1-e9f736ef3674 tempest-AttachSCSIVolumeTestJSON-1482538539 None] Lock "cinder-quobyte-71c10021-06bb-4748-8067-dac36714dd7c" acquired by "delete_volume" :: waited 0.013s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:04:09 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81fe869-8e1a-4b95-afb5-6de84cb9c501]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:04:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-8d79bc7c-00e2-4889-a3d1-e9f736ef3674 tempest-AttachSCSIVolumeTestJSON-1482538539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-71c10021-06bb-4748-8067-dac36714dd7c {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:04:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-8d79bc7c-00e2-4889-a3d1-e9f736ef3674 tempest-AttachSCSIVolumeTestJSON-1482538539 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-71c10021-06bb-4748-8067-dac36714dd7c" returned: 0 in 0.492s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:04:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-8d79bc7c-00e2-4889-a3d1-e9f736ef3674 tempest-AttachSCSIVolumeTestJSON-1482538539 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-71c10021-06bb-4748-8067-dac36714dd7c {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:04:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-8d79bc7c-00e2-4889-a3d1-e9f736ef3674 tempest-AttachSCSIVolumeTestJSON-1482538539 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-71c10021-06bb-4748-8067-dac36714dd7c" returned: 0 in 0.092s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:04:09 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-8d79bc7c-00e2-4889-a3d1-e9f736ef3674 tempest-AttachSCSIVolumeTestJSON-1482538539 None] Lock "cinder-quobyte-71c10021-06bb-4748-8067-dac36714dd7c" released by "delete_volume" :: held 0.739s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:04:09 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-8d79bc7c-00e2-4889-a3d1-e9f736ef3674 tempest-AttachSCSIVolumeTestJSON-1482538539 None] Created reservations ['df78c8d9-0c45-4b99-8692-fb4c9ff79435', '102b7ceb-4b81-451e-99c1-a173b20b18e2', 'e7db0936-fee2-4d40-be0d-aa596ab2b220', '19c3343d-fd20-48d8-9d80-476420a5cc11'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:04:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-8d79bc7c-00e2-4889-a3d1-e9f736ef3674 tempest-AttachSCSIVolumeTestJSON-1482538539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:04:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-8d79bc7c-00e2-4889-a3d1-e9f736ef3674 tempest-AttachSCSIVolumeTestJSON-1482538539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:04:10 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-8d79bc7c-00e2-4889-a3d1-e9f736ef3674 tempest-AttachSCSIVolumeTestJSON-1482538539 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:04:10 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-8d79bc7c-00e2-4889-a3d1-e9f736ef3674 tempest-AttachSCSIVolumeTestJSON-1482538539 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:04:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-8d79bc7c-00e2-4889-a3d1-e9f736ef3674 tempest-AttachSCSIVolumeTestJSON-1482538539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:04:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-8d79bc7c-00e2-4889-a3d1-e9f736ef3674 tempest-AttachSCSIVolumeTestJSON-1482538539 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:04:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-8d79bc7c-00e2-4889-a3d1-e9f736ef3674 tempest-AttachSCSIVolumeTestJSON-1482538539 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.100s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:04:10 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-8d79bc7c-00e2-4889-a3d1-e9f736ef3674 tempest-AttachSCSIVolumeTestJSON-1482538539 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:04:10 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-8d79bc7c-00e2-4889-a3d1-e9f736ef3674 tempest-AttachSCSIVolumeTestJSON-1482538539 None] Deleted volume successfully. Sep 10 21:04:10 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-8d79bc7c-00e2-4889-a3d1-e9f736ef3674 tempest-AttachSCSIVolumeTestJSON-1482538539 None] Lock "cinder-71c10021-06bb-4748-8067-dac36714dd7c-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:04:19 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-51bff3b5-d711-4f42-997a-184448f2c32b req-073837d9-91d5-44bb-a2de-e0aa5b7f0d64 tempest-VolumesAssistedSnapshotsTest-1162376033 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:04:19 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-51bff3b5-d711-4f42-997a-184448f2c32b req-073837d9-91d5-44bb-a2de-e0aa5b7f0d64 tempest-VolumesAssistedSnapshotsTest-1162376033 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:04:19 devstack cinder-volume[82780]: INFO cinder.volume.manager [req-51bff3b5-d711-4f42-997a-184448f2c32b req-073837d9-91d5-44bb-a2de-e0aa5b7f0d64 tempest-VolumesAssistedSnapshotsTest-1162376033 None] Terminate volume connection completed successfully. Sep 10 21:04:19 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-51bff3b5-d711-4f42-997a-184448f2c32b req-073837d9-91d5-44bb-a2de-e0aa5b7f0d64 tempest-VolumesAssistedSnapshotsTest-1162376033 None] Deleting attachment 5a8b51ed-409f-47d3-9e6e-b1a70f90e7f8. {{(pid=82780) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 21:04:21 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-e071ab0a-0131-4d6f-aa0c-330c351ac92e tempest-VolumesAssistedSnapshotsTest-1162376033 None] Acquiring lock "cinder-427956fa-d4a1-4e24-9b01-becd9d15f7c5-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:04:21 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-e071ab0a-0131-4d6f-aa0c-330c351ac92e tempest-VolumesAssistedSnapshotsTest-1162376033 None] Lock "cinder-427956fa-d4a1-4e24-9b01-becd9d15f7c5-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:04:21 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-e071ab0a-0131-4d6f-aa0c-330c351ac92e tempest-VolumesAssistedSnapshotsTest-1162376033 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:04:21 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-e071ab0a-0131-4d6f-aa0c-330c351ac92e tempest-VolumesAssistedSnapshotsTest-1162376033 None] Acquiring lock "cinder-quobyte-427956fa-d4a1-4e24-9b01-becd9d15f7c5" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:04:21 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-e071ab0a-0131-4d6f-aa0c-330c351ac92e tempest-VolumesAssistedSnapshotsTest-1162376033 None] Lock "cinder-quobyte-427956fa-d4a1-4e24-9b01-becd9d15f7c5" acquired by "delete_volume" :: waited 0.042s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:04:21 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b4125fa-73d2-4f70-be8e-7c3eb2e55424]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:04:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e071ab0a-0131-4d6f-aa0c-330c351ac92e tempest-VolumesAssistedSnapshotsTest-1162376033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-427956fa-d4a1-4e24-9b01-becd9d15f7c5 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:04:22 devstack quobyte-client[82807]: System call of process 85259 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:04:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e071ab0a-0131-4d6f-aa0c-330c351ac92e tempest-VolumesAssistedSnapshotsTest-1162376033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-427956fa-d4a1-4e24-9b01-becd9d15f7c5" returned: 0 in 0.649s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:04:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e071ab0a-0131-4d6f-aa0c-330c351ac92e tempest-VolumesAssistedSnapshotsTest-1162376033 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-427956fa-d4a1-4e24-9b01-becd9d15f7c5 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:04:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e071ab0a-0131-4d6f-aa0c-330c351ac92e tempest-VolumesAssistedSnapshotsTest-1162376033 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-427956fa-d4a1-4e24-9b01-becd9d15f7c5" returned: 0 in 0.205s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:04:22 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-e071ab0a-0131-4d6f-aa0c-330c351ac92e tempest-VolumesAssistedSnapshotsTest-1162376033 None] Lock "cinder-quobyte-427956fa-d4a1-4e24-9b01-becd9d15f7c5" released by "delete_volume" :: held 1.045s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:04:22 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-e071ab0a-0131-4d6f-aa0c-330c351ac92e tempest-VolumesAssistedSnapshotsTest-1162376033 None] Created reservations ['eff445a3-926a-4d53-802e-70d9d57e2e61', 'c0d590f3-1c40-48c6-83ad-f50a09b8d9d3', 'fd0cb11e-869e-4456-992d-a19492dca0ce', '188a46cb-7cdc-487b-81a5-0fe2a6627caf'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:04:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-e071ab0a-0131-4d6f-aa0c-330c351ac92e tempest-VolumesAssistedSnapshotsTest-1162376033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:04:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-e071ab0a-0131-4d6f-aa0c-330c351ac92e tempest-VolumesAssistedSnapshotsTest-1162376033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:04:22 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-e071ab0a-0131-4d6f-aa0c-330c351ac92e tempest-VolumesAssistedSnapshotsTest-1162376033 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:04:22 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-e071ab0a-0131-4d6f-aa0c-330c351ac92e tempest-VolumesAssistedSnapshotsTest-1162376033 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:04:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-e071ab0a-0131-4d6f-aa0c-330c351ac92e tempest-VolumesAssistedSnapshotsTest-1162376033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:04:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e071ab0a-0131-4d6f-aa0c-330c351ac92e tempest-VolumesAssistedSnapshotsTest-1162376033 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:04:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e071ab0a-0131-4d6f-aa0c-330c351ac92e tempest-VolumesAssistedSnapshotsTest-1162376033 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.114s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:04:23 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-e071ab0a-0131-4d6f-aa0c-330c351ac92e tempest-VolumesAssistedSnapshotsTest-1162376033 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:04:23 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-e071ab0a-0131-4d6f-aa0c-330c351ac92e tempest-VolumesAssistedSnapshotsTest-1162376033 None] Deleted volume successfully. Sep 10 21:04:23 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-e071ab0a-0131-4d6f-aa0c-330c351ac92e tempest-VolumesAssistedSnapshotsTest-1162376033 None] Lock "cinder-427956fa-d4a1-4e24-9b01-becd9d15f7c5-delete_volume" released by "delete_volume" :: held 2.263s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:04:32 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=9,cinder:INSERT=4,cinder:UPDATE=24 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:04:33 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=13,cinder:UPDATE=8,cinder:INSERT=4,cinder:DELETE=2 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:04:56 devstack cinder-volume[82780]: DEBUG oslo_service.periodic_task [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82780) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 21:04:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:04:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:04:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:04:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:04:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:04:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:04:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.178s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:04:56 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:05:08 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-6db9a302-a4d3-4811-8eb3-32a8fa4548f4 tempest-AttachVolumeShelveTestJSON-724512628 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:05:08 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-6db9a302-a4d3-4811-8eb3-32a8fa4548f4 tempest-AttachVolumeShelveTestJSON-724512628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:05:08 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-6db9a302-a4d3-4811-8eb3-32a8fa4548f4 tempest-AttachVolumeShelveTestJSON-724512628 None] Flow 'volume_create_manager' (d616ba4e-2736-4128-b314-198c69a56ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:05:08 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-6db9a302-a4d3-4811-8eb3-32a8fa4548f4 tempest-AttachVolumeShelveTestJSON-724512628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7af16499-290f-4c51-a0cf-3aa736858180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:05:08 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-6db9a302-a4d3-4811-8eb3-32a8fa4548f4 tempest-AttachVolumeShelveTestJSON-724512628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7af16499-290f-4c51-a0cf-3aa736858180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:05:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-981056709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1820ef43-e278-4739-b51e-e108ae69eccb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06ae1def70ed442192bcf8ca613309fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:05:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:05:08Z,use_quota=True,user_id='1462b8525363425e8a3614d59533c5a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:05:08 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-6db9a302-a4d3-4811-8eb3-32a8fa4548f4 tempest-AttachVolumeShelveTestJSON-724512628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14e861fd-9e96-432c-a060-fc9b1beca8d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:05:08 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-6db9a302-a4d3-4811-8eb3-32a8fa4548f4 tempest-AttachVolumeShelveTestJSON-724512628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14e861fd-9e96-432c-a060-fc9b1beca8d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:05:08 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-6db9a302-a4d3-4811-8eb3-32a8fa4548f4 tempest-AttachVolumeShelveTestJSON-724512628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (859487a5-3410-4e4a-bf8d-f104d2fcac73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:05:08 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-6db9a302-a4d3-4811-8eb3-32a8fa4548f4 tempest-AttachVolumeShelveTestJSON-724512628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (859487a5-3410-4e4a-bf8d-f104d2fcac73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1820ef43-e278-4739-b51e-e108ae69eccb', 'volume_name': 'volume-1820ef43-e278-4739-b51e-e108ae69eccb', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:05:08 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-6db9a302-a4d3-4811-8eb3-32a8fa4548f4 tempest-AttachVolumeShelveTestJSON-724512628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eb18299-8d66-4fb9-8ab3-65676e2a317a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:05:08 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-6db9a302-a4d3-4811-8eb3-32a8fa4548f4 tempest-AttachVolumeShelveTestJSON-724512628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eb18299-8d66-4fb9-8ab3-65676e2a317a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:05:08 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-6db9a302-a4d3-4811-8eb3-32a8fa4548f4 tempest-AttachVolumeShelveTestJSON-724512628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0564a87e-fdaf-4c05-9ec5-45289f8e6926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:05:08 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-6db9a302-a4d3-4811-8eb3-32a8fa4548f4 tempest-AttachVolumeShelveTestJSON-724512628 None] Volume 1820ef43-e278-4739-b51e-e108ae69eccb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1820ef43-e278-4739-b51e-e108ae69eccb', 'volume_size': 1} Sep 10 21:05:08 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-6db9a302-a4d3-4811-8eb3-32a8fa4548f4 tempest-AttachVolumeShelveTestJSON-724512628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:05:08 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-6db9a302-a4d3-4811-8eb3-32a8fa4548f4 tempest-AttachVolumeShelveTestJSON-724512628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:05:08 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-6db9a302-a4d3-4811-8eb3-32a8fa4548f4 tempest-AttachVolumeShelveTestJSON-724512628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:05:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-981056709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1820ef43-e278-4739-b51e-e108ae69eccb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06ae1def70ed442192bcf8ca613309fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:05:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:05:08Z,use_quota=True,user_id='1462b8525363425e8a3614d59533c5a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:05:08 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-6db9a302-a4d3-4811-8eb3-32a8fa4548f4 tempest-AttachVolumeShelveTestJSON-724512628 None] Creating volume 1820ef43-e278-4739-b51e-e108ae69eccb {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:05:08 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-6db9a302-a4d3-4811-8eb3-32a8fa4548f4 tempest-AttachVolumeShelveTestJSON-724512628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:05:08 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-6db9a302-a4d3-4811-8eb3-32a8fa4548f4 tempest-AttachVolumeShelveTestJSON-724512628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:05:08 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-6db9a302-a4d3-4811-8eb3-32a8fa4548f4 tempest-AttachVolumeShelveTestJSON-724512628 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:05:08 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-6db9a302-a4d3-4811-8eb3-32a8fa4548f4 tempest-AttachVolumeShelveTestJSON-724512628 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:05:08 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-6db9a302-a4d3-4811-8eb3-32a8fa4548f4 tempest-AttachVolumeShelveTestJSON-724512628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:05:08 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-6db9a302-a4d3-4811-8eb3-32a8fa4548f4 tempest-AttachVolumeShelveTestJSON-724512628 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:05:08 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-6db9a302-a4d3-4811-8eb3-32a8fa4548f4 tempest-AttachVolumeShelveTestJSON-724512628 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:05:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-6db9a302-a4d3-4811-8eb3-32a8fa4548f4 tempest-AttachVolumeShelveTestJSON-724512628 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1820ef43-e278-4739-b51e-e108ae69eccb 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:05:09 devstack quobyte-client[82807]: System call of process 85407 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:05:09 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=5, name=volume-1820ef43-e278-4739-b51e-e108ae69eccb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:05:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-6db9a302-a4d3-4811-8eb3-32a8fa4548f4 tempest-AttachVolumeShelveTestJSON-724512628 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1820ef43-e278-4739-b51e-e108ae69eccb 1073741824" returned: 0 in 0.712s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:05:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-6db9a302-a4d3-4811-8eb3-32a8fa4548f4 tempest-AttachVolumeShelveTestJSON-724512628 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1820ef43-e278-4739-b51e-e108ae69eccb {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:05:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-6db9a302-a4d3-4811-8eb3-32a8fa4548f4 tempest-AttachVolumeShelveTestJSON-724512628 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1820ef43-e278-4739-b51e-e108ae69eccb" returned: 0 in 0.148s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:05:09 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-6db9a302-a4d3-4811-8eb3-32a8fa4548f4 tempest-AttachVolumeShelveTestJSON-724512628 None] <== create_volume: return (989ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:05:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-6db9a302-a4d3-4811-8eb3-32a8fa4548f4 tempest-AttachVolumeShelveTestJSON-724512628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:05:10 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-6db9a302-a4d3-4811-8eb3-32a8fa4548f4 tempest-AttachVolumeShelveTestJSON-724512628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0564a87e-fdaf-4c05-9ec5-45289f8e6926) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1820ef43-e278-4739-b51e-e108ae69eccb', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:05:10 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-6db9a302-a4d3-4811-8eb3-32a8fa4548f4 tempest-AttachVolumeShelveTestJSON-724512628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7665d874-b6f0-4874-99de-b203af02679d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:05:10 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-6db9a302-a4d3-4811-8eb3-32a8fa4548f4 tempest-AttachVolumeShelveTestJSON-724512628 None] Volume volume-1820ef43-e278-4739-b51e-e108ae69eccb (1820ef43-e278-4739-b51e-e108ae69eccb): created successfully Sep 10 21:05:10 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-6db9a302-a4d3-4811-8eb3-32a8fa4548f4 tempest-AttachVolumeShelveTestJSON-724512628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7665d874-b6f0-4874-99de-b203af02679d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:05:10 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-6db9a302-a4d3-4811-8eb3-32a8fa4548f4 tempest-AttachVolumeShelveTestJSON-724512628 None] Flow 'volume_create_manager' (d616ba4e-2736-4128-b314-198c69a56ba9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:05:10 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-6db9a302-a4d3-4811-8eb3-32a8fa4548f4 tempest-AttachVolumeShelveTestJSON-724512628 None] Created volume successfully. Sep 10 21:05:20 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:05:20 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:UPDATE=2,cinder:DELETE=1 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:05:44 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-1eb8b089-af0e-455c-85bc-50173c7cf0b6 req-847eb532-d9ad-4c66-82ea-5037a8ebed67 tempest-AttachVolumeShelveTestJSON-724512628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:05:44 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-1eb8b089-af0e-455c-85bc-50173c7cf0b6 req-847eb532-d9ad-4c66-82ea-5037a8ebed67 tempest-AttachVolumeShelveTestJSON-724512628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.006s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:05:44 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee326170-e95d-48fe-a2b7-b8620d2e7909]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:05:44 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-1eb8b089-af0e-455c-85bc-50173c7cf0b6 req-847eb532-d9ad-4c66-82ea-5037a8ebed67 tempest-AttachVolumeShelveTestJSON-724512628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1820ef43-e278-4739-b51e-e108ae69eccb {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:05:45 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-1eb8b089-af0e-455c-85bc-50173c7cf0b6 req-847eb532-d9ad-4c66-82ea-5037a8ebed67 tempest-AttachVolumeShelveTestJSON-724512628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1820ef43-e278-4739-b51e-e108ae69eccb" returned: 0 in 0.580s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:05:45 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-1eb8b089-af0e-455c-85bc-50173c7cf0b6 req-847eb532-d9ad-4c66-82ea-5037a8ebed67 tempest-AttachVolumeShelveTestJSON-724512628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.663s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:05:45 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-1eb8b089-af0e-455c-85bc-50173c7cf0b6 req-847eb532-d9ad-4c66-82ea-5037a8ebed67 tempest-AttachVolumeShelveTestJSON-724512628 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b', 'name': 'volume-1820ef43-e278-4739-b51e-e108ae69eccb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '624ffe18-bef5-499c-aefa-d2e7f969ed07', 'enforce_multipath': True} {{(pid=82780) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 21:05:45 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-1eb8b089-af0e-455c-85bc-50173c7cf0b6 req-847eb532-d9ad-4c66-82ea-5037a8ebed67 tempest-AttachVolumeShelveTestJSON-724512628 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:05:45 devstack cinder-volume[82780]: INFO cinder.volume.manager [req-1eb8b089-af0e-455c-85bc-50173c7cf0b6 req-847eb532-d9ad-4c66-82ea-5037a8ebed67 tempest-AttachVolumeShelveTestJSON-724512628 None] attachment_update completed successfully. Sep 10 21:05:56 devstack cinder-volume[82780]: DEBUG oslo_service.periodic_task [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82780) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 21:05:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:05:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:05:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:05:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:05:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:05:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:05:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.268s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:05:56 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:05:59 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:05:59 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:06:10 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-7434e98c-fae2-4205-ba7e-d85e78ab8a8e tempest-VolumesAdminNegativeTest-983874253 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:06:10 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-7434e98c-fae2-4205-ba7e-d85e78ab8a8e tempest-VolumesAdminNegativeTest-983874253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:06:11 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-7434e98c-fae2-4205-ba7e-d85e78ab8a8e tempest-VolumesAdminNegativeTest-983874253 None] Flow 'volume_create_manager' (123c3ead-1f83-4578-8371-86d8879f0924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:06:11 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-7434e98c-fae2-4205-ba7e-d85e78ab8a8e tempest-VolumesAdminNegativeTest-983874253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11d3ceff-e0fc-4c1d-b90f-cb44a46f3407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:06:11 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-7434e98c-fae2-4205-ba7e-d85e78ab8a8e tempest-VolumesAdminNegativeTest-983874253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11d3ceff-e0fc-4c1d-b90f-cb44a46f3407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:06:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2039081287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f78daec9-075c-414e-8c28-7b1a5edcf4ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc45fc6de17b4404a448ef339abfea60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:06:11Z,use_quota=True,user_id='dd201dfb01054100b0d0f65f0c97fbd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:06:11 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-7434e98c-fae2-4205-ba7e-d85e78ab8a8e tempest-VolumesAdminNegativeTest-983874253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd14930c-04c7-4c7a-8470-d84db8de77ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:06:11 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-7434e98c-fae2-4205-ba7e-d85e78ab8a8e tempest-VolumesAdminNegativeTest-983874253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd14930c-04c7-4c7a-8470-d84db8de77ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:06:11 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-7434e98c-fae2-4205-ba7e-d85e78ab8a8e tempest-VolumesAdminNegativeTest-983874253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7295b04-942e-48cf-bdfd-2a0ee5303371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:06:11 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-7434e98c-fae2-4205-ba7e-d85e78ab8a8e tempest-VolumesAdminNegativeTest-983874253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7295b04-942e-48cf-bdfd-2a0ee5303371) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f78daec9-075c-414e-8c28-7b1a5edcf4ff', 'volume_name': 'volume-f78daec9-075c-414e-8c28-7b1a5edcf4ff', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:06:11 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-7434e98c-fae2-4205-ba7e-d85e78ab8a8e tempest-VolumesAdminNegativeTest-983874253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c77daadd-cb5a-4cc2-b1c2-99f226fc8839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:06:11 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-7434e98c-fae2-4205-ba7e-d85e78ab8a8e tempest-VolumesAdminNegativeTest-983874253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c77daadd-cb5a-4cc2-b1c2-99f226fc8839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:06:11 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-7434e98c-fae2-4205-ba7e-d85e78ab8a8e tempest-VolumesAdminNegativeTest-983874253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a25343b-2d84-43eb-b903-0feef54321aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:06:11 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-7434e98c-fae2-4205-ba7e-d85e78ab8a8e tempest-VolumesAdminNegativeTest-983874253 None] Volume f78daec9-075c-414e-8c28-7b1a5edcf4ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f78daec9-075c-414e-8c28-7b1a5edcf4ff', 'volume_size': 1} Sep 10 21:06:11 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-7434e98c-fae2-4205-ba7e-d85e78ab8a8e tempest-VolumesAdminNegativeTest-983874253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:06:11 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-7434e98c-fae2-4205-ba7e-d85e78ab8a8e tempest-VolumesAdminNegativeTest-983874253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:06:11 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-7434e98c-fae2-4205-ba7e-d85e78ab8a8e tempest-VolumesAdminNegativeTest-983874253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:06:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2039081287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f78daec9-075c-414e-8c28-7b1a5edcf4ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc45fc6de17b4404a448ef339abfea60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:06:11Z,use_quota=True,user_id='dd201dfb01054100b0d0f65f0c97fbd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:06:11 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-7434e98c-fae2-4205-ba7e-d85e78ab8a8e tempest-VolumesAdminNegativeTest-983874253 None] Creating volume f78daec9-075c-414e-8c28-7b1a5edcf4ff {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:06:11 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-7434e98c-fae2-4205-ba7e-d85e78ab8a8e tempest-VolumesAdminNegativeTest-983874253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:06:11 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-7434e98c-fae2-4205-ba7e-d85e78ab8a8e tempest-VolumesAdminNegativeTest-983874253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:06:11 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-7434e98c-fae2-4205-ba7e-d85e78ab8a8e tempest-VolumesAdminNegativeTest-983874253 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:06:11 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-7434e98c-fae2-4205-ba7e-d85e78ab8a8e tempest-VolumesAdminNegativeTest-983874253 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:06:11 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-7434e98c-fae2-4205-ba7e-d85e78ab8a8e tempest-VolumesAdminNegativeTest-983874253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:06:11 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-7434e98c-fae2-4205-ba7e-d85e78ab8a8e tempest-VolumesAdminNegativeTest-983874253 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:06:11 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-7434e98c-fae2-4205-ba7e-d85e78ab8a8e tempest-VolumesAdminNegativeTest-983874253 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:06:11 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-7434e98c-fae2-4205-ba7e-d85e78ab8a8e tempest-VolumesAdminNegativeTest-983874253 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-f78daec9-075c-414e-8c28-7b1a5edcf4ff 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:06:11 devstack quobyte-client[82807]: System call of process 85661 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:06:11 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=6, name=volume-f78daec9-075c-414e-8c28-7b1a5edcf4ff, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:06:12 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-7434e98c-fae2-4205-ba7e-d85e78ab8a8e tempest-VolumesAdminNegativeTest-983874253 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-f78daec9-075c-414e-8c28-7b1a5edcf4ff 1073741824" returned: 0 in 0.742s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:06:12 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-7434e98c-fae2-4205-ba7e-d85e78ab8a8e tempest-VolumesAdminNegativeTest-983874253 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-f78daec9-075c-414e-8c28-7b1a5edcf4ff {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:06:12 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-75c66ff6-a302-4fad-8bf0-ab53a3127379 tempest-TaggedAttachmentsTest-1829613531 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:06:12 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-75c66ff6-a302-4fad-8bf0-ab53a3127379 tempest-TaggedAttachmentsTest-1829613531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:06:12 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-75c66ff6-a302-4fad-8bf0-ab53a3127379 tempest-TaggedAttachmentsTest-1829613531 None] Flow 'volume_create_manager' (4844d73f-44c1-4661-bbd2-70de1e63a466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:06:12 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-75c66ff6-a302-4fad-8bf0-ab53a3127379 tempest-TaggedAttachmentsTest-1829613531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f15159c-b3cf-4e9e-97a1-b140e5f6b0b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:06:13 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-75c66ff6-a302-4fad-8bf0-ab53a3127379 tempest-TaggedAttachmentsTest-1829613531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f15159c-b3cf-4e9e-97a1-b140e5f6b0b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1973315358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=385526ea-b39f-4919-b353-56e7f269b8e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6002df3168c54c2d8e47a52f99c35724',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:06:11Z,use_quota=True,user_id='4f68032ddfaf42eb96a786a83588bc39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:06:13 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-75c66ff6-a302-4fad-8bf0-ab53a3127379 tempest-TaggedAttachmentsTest-1829613531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3d0ae13-b1aa-4fe5-a097-eda6db51e95f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:06:13 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-75c66ff6-a302-4fad-8bf0-ab53a3127379 tempest-TaggedAttachmentsTest-1829613531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3d0ae13-b1aa-4fe5-a097-eda6db51e95f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:06:13 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-75c66ff6-a302-4fad-8bf0-ab53a3127379 tempest-TaggedAttachmentsTest-1829613531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91fb1dbd-36d7-4bc9-a6f0-6fefa28c60ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:06:13 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-75c66ff6-a302-4fad-8bf0-ab53a3127379 tempest-TaggedAttachmentsTest-1829613531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91fb1dbd-36d7-4bc9-a6f0-6fefa28c60ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '385526ea-b39f-4919-b353-56e7f269b8e2', 'volume_name': 'volume-385526ea-b39f-4919-b353-56e7f269b8e2', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:06:13 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-75c66ff6-a302-4fad-8bf0-ab53a3127379 tempest-TaggedAttachmentsTest-1829613531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11bbeac3-d6d2-4d69-9e1d-00040a9a1048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:06:13 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-75c66ff6-a302-4fad-8bf0-ab53a3127379 tempest-TaggedAttachmentsTest-1829613531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11bbeac3-d6d2-4d69-9e1d-00040a9a1048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:06:13 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-75c66ff6-a302-4fad-8bf0-ab53a3127379 tempest-TaggedAttachmentsTest-1829613531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b02f1ffb-8ec1-435d-82b5-19a954b25aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:06:13 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-75c66ff6-a302-4fad-8bf0-ab53a3127379 tempest-TaggedAttachmentsTest-1829613531 None] Volume 385526ea-b39f-4919-b353-56e7f269b8e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-385526ea-b39f-4919-b353-56e7f269b8e2', 'volume_size': 1} Sep 10 21:06:13 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-75c66ff6-a302-4fad-8bf0-ab53a3127379 tempest-TaggedAttachmentsTest-1829613531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:06:13 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-7434e98c-fae2-4205-ba7e-d85e78ab8a8e tempest-VolumesAdminNegativeTest-983874253 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-f78daec9-075c-414e-8c28-7b1a5edcf4ff" returned: 0 in 0.881s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:06:13 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-7434e98c-fae2-4205-ba7e-d85e78ab8a8e tempest-VolumesAdminNegativeTest-983874253 None] <== create_volume: return (1683ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:06:13 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-7434e98c-fae2-4205-ba7e-d85e78ab8a8e tempest-VolumesAdminNegativeTest-983874253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.690s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:06:13 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-75c66ff6-a302-4fad-8bf0-ab53a3127379 tempest-TaggedAttachmentsTest-1829613531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.028s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:06:13 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-75c66ff6-a302-4fad-8bf0-ab53a3127379 tempest-TaggedAttachmentsTest-1829613531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1973315358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=385526ea-b39f-4919-b353-56e7f269b8e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6002df3168c54c2d8e47a52f99c35724',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:06:11Z,use_quota=True,user_id='4f68032ddfaf42eb96a786a83588bc39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:06:13 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-75c66ff6-a302-4fad-8bf0-ab53a3127379 tempest-TaggedAttachmentsTest-1829613531 None] Creating volume 385526ea-b39f-4919-b353-56e7f269b8e2 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:06:13 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-75c66ff6-a302-4fad-8bf0-ab53a3127379 tempest-TaggedAttachmentsTest-1829613531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:06:13 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-75c66ff6-a302-4fad-8bf0-ab53a3127379 tempest-TaggedAttachmentsTest-1829613531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:06:13 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-75c66ff6-a302-4fad-8bf0-ab53a3127379 tempest-TaggedAttachmentsTest-1829613531 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:06:13 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-75c66ff6-a302-4fad-8bf0-ab53a3127379 tempest-TaggedAttachmentsTest-1829613531 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:06:13 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-75c66ff6-a302-4fad-8bf0-ab53a3127379 tempest-TaggedAttachmentsTest-1829613531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:06:13 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-75c66ff6-a302-4fad-8bf0-ab53a3127379 tempest-TaggedAttachmentsTest-1829613531 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:06:13 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-75c66ff6-a302-4fad-8bf0-ab53a3127379 tempest-TaggedAttachmentsTest-1829613531 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:06:13 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-75c66ff6-a302-4fad-8bf0-ab53a3127379 tempest-TaggedAttachmentsTest-1829613531 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-385526ea-b39f-4919-b353-56e7f269b8e2 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:06:13 devstack quobyte-client[82807]: System call of process 85671 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:06:13 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=7, name=volume-385526ea-b39f-4919-b353-56e7f269b8e2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:06:13 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-7434e98c-fae2-4205-ba7e-d85e78ab8a8e tempest-VolumesAdminNegativeTest-983874253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a25343b-2d84-43eb-b903-0feef54321aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f78daec9-075c-414e-8c28-7b1a5edcf4ff', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:06:13 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-7434e98c-fae2-4205-ba7e-d85e78ab8a8e tempest-VolumesAdminNegativeTest-983874253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (242c2b48-66cc-49d5-b4dc-4be2b3ce3705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:06:13 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-7434e98c-fae2-4205-ba7e-d85e78ab8a8e tempest-VolumesAdminNegativeTest-983874253 None] Volume volume-f78daec9-075c-414e-8c28-7b1a5edcf4ff (f78daec9-075c-414e-8c28-7b1a5edcf4ff): created successfully Sep 10 21:06:13 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-7434e98c-fae2-4205-ba7e-d85e78ab8a8e tempest-VolumesAdminNegativeTest-983874253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (242c2b48-66cc-49d5-b4dc-4be2b3ce3705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:06:13 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-7434e98c-fae2-4205-ba7e-d85e78ab8a8e tempest-VolumesAdminNegativeTest-983874253 None] Flow 'volume_create_manager' (123c3ead-1f83-4578-8371-86d8879f0924) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:06:13 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-75c66ff6-a302-4fad-8bf0-ab53a3127379 tempest-TaggedAttachmentsTest-1829613531 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-385526ea-b39f-4919-b353-56e7f269b8e2 1073741824" returned: 0 in 0.592s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:06:13 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-75c66ff6-a302-4fad-8bf0-ab53a3127379 tempest-TaggedAttachmentsTest-1829613531 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-385526ea-b39f-4919-b353-56e7f269b8e2 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:06:13 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-7434e98c-fae2-4205-ba7e-d85e78ab8a8e tempest-VolumesAdminNegativeTest-983874253 None] Created volume successfully. Sep 10 21:06:13 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-75c66ff6-a302-4fad-8bf0-ab53a3127379 tempest-TaggedAttachmentsTest-1829613531 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-385526ea-b39f-4919-b353-56e7f269b8e2" returned: 0 in 0.274s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:06:13 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-75c66ff6-a302-4fad-8bf0-ab53a3127379 tempest-TaggedAttachmentsTest-1829613531 None] <== create_volume: return (885ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:06:13 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-75c66ff6-a302-4fad-8bf0-ab53a3127379 tempest-TaggedAttachmentsTest-1829613531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:06:14 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-75c66ff6-a302-4fad-8bf0-ab53a3127379 tempest-TaggedAttachmentsTest-1829613531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b02f1ffb-8ec1-435d-82b5-19a954b25aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-385526ea-b39f-4919-b353-56e7f269b8e2', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:06:14 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-75c66ff6-a302-4fad-8bf0-ab53a3127379 tempest-TaggedAttachmentsTest-1829613531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc096093-c658-4ad9-80ab-7e886db669ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:06:14 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-75c66ff6-a302-4fad-8bf0-ab53a3127379 tempest-TaggedAttachmentsTest-1829613531 None] Volume volume-385526ea-b39f-4919-b353-56e7f269b8e2 (385526ea-b39f-4919-b353-56e7f269b8e2): created successfully Sep 10 21:06:14 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-75c66ff6-a302-4fad-8bf0-ab53a3127379 tempest-TaggedAttachmentsTest-1829613531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc096093-c658-4ad9-80ab-7e886db669ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:06:14 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-75c66ff6-a302-4fad-8bf0-ab53a3127379 tempest-TaggedAttachmentsTest-1829613531 None] Flow 'volume_create_manager' (4844d73f-44c1-4661-bbd2-70de1e63a466) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:06:14 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-75c66ff6-a302-4fad-8bf0-ab53a3127379 tempest-TaggedAttachmentsTest-1829613531 None] Created volume successfully. Sep 10 21:06:16 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-7c337f6d-96f3-4f26-a038-61b2ad82c96c tempest-VolumesAdminNegativeTest-983874253 None] Acquiring lock "cinder-f78daec9-075c-414e-8c28-7b1a5edcf4ff-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:06:16 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-7c337f6d-96f3-4f26-a038-61b2ad82c96c tempest-VolumesAdminNegativeTest-983874253 None] Lock "cinder-f78daec9-075c-414e-8c28-7b1a5edcf4ff-delete_volume" acquired by "delete_volume" :: waited 0.181s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:06:17 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-7c337f6d-96f3-4f26-a038-61b2ad82c96c tempest-VolumesAdminNegativeTest-983874253 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:06:17 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-7c337f6d-96f3-4f26-a038-61b2ad82c96c tempest-VolumesAdminNegativeTest-983874253 None] Acquiring lock "cinder-quobyte-f78daec9-075c-414e-8c28-7b1a5edcf4ff" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:06:17 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-7c337f6d-96f3-4f26-a038-61b2ad82c96c tempest-VolumesAdminNegativeTest-983874253 None] Lock "cinder-quobyte-f78daec9-075c-414e-8c28-7b1a5edcf4ff" acquired by "delete_volume" :: waited 0.025s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:06:17 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1c65e7-c402-40cc-b19a-0af1d4b14df1]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:06:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-7c337f6d-96f3-4f26-a038-61b2ad82c96c tempest-VolumesAdminNegativeTest-983874253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-f78daec9-075c-414e-8c28-7b1a5edcf4ff {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:06:18 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-7c337f6d-96f3-4f26-a038-61b2ad82c96c tempest-VolumesAdminNegativeTest-983874253 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-f78daec9-075c-414e-8c28-7b1a5edcf4ff" returned: 0 in 1.207s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:06:18 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-7c337f6d-96f3-4f26-a038-61b2ad82c96c tempest-VolumesAdminNegativeTest-983874253 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-f78daec9-075c-414e-8c28-7b1a5edcf4ff {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:06:18 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-7c337f6d-96f3-4f26-a038-61b2ad82c96c tempest-VolumesAdminNegativeTest-983874253 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-f78daec9-075c-414e-8c28-7b1a5edcf4ff" returned: 0 in 0.215s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:06:18 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-7c337f6d-96f3-4f26-a038-61b2ad82c96c tempest-VolumesAdminNegativeTest-983874253 None] Lock "cinder-quobyte-f78daec9-075c-414e-8c28-7b1a5edcf4ff" released by "delete_volume" :: held 1.646s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:06:19 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-7c337f6d-96f3-4f26-a038-61b2ad82c96c tempest-VolumesAdminNegativeTest-983874253 None] Created reservations ['2a488a50-5917-4352-92a9-6b534d94d094', 'c8b39554-c045-4c77-a5a9-2f55af2a3222', 'b39cc360-f076-4de7-83c1-9c53eda3acb9', '635cb991-b961-4dd9-8075-0ce436cd17a5'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:06:19 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-7c337f6d-96f3-4f26-a038-61b2ad82c96c tempest-VolumesAdminNegativeTest-983874253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:06:19 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-7c337f6d-96f3-4f26-a038-61b2ad82c96c tempest-VolumesAdminNegativeTest-983874253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:06:20 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-7c337f6d-96f3-4f26-a038-61b2ad82c96c tempest-VolumesAdminNegativeTest-983874253 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:06:20 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-7c337f6d-96f3-4f26-a038-61b2ad82c96c tempest-VolumesAdminNegativeTest-983874253 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:06:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-7c337f6d-96f3-4f26-a038-61b2ad82c96c tempest-VolumesAdminNegativeTest-983874253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:06:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-7c337f6d-96f3-4f26-a038-61b2ad82c96c tempest-VolumesAdminNegativeTest-983874253 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:06:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-7c337f6d-96f3-4f26-a038-61b2ad82c96c tempest-VolumesAdminNegativeTest-983874253 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.152s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:06:20 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-7c337f6d-96f3-4f26-a038-61b2ad82c96c tempest-VolumesAdminNegativeTest-983874253 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:06:20 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-7c337f6d-96f3-4f26-a038-61b2ad82c96c tempest-VolumesAdminNegativeTest-983874253 None] Deleted volume successfully. Sep 10 21:06:20 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-7c337f6d-96f3-4f26-a038-61b2ad82c96c tempest-VolumesAdminNegativeTest-983874253 None] Lock "cinder-f78daec9-075c-414e-8c28-7b1a5edcf4ff-delete_volume" released by "delete_volume" :: held 4.058s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:06:29 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=8,cinder:UPDATE=10,cinder:INSERT=3 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:06:30 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=6,cinder:UPDATE=14,cinder:DELETE=3,cinder:INSERT=1 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:06:56 devstack cinder-volume[82780]: DEBUG oslo_service.periodic_task [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82780) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 21:06:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:06:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:06:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:06:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:06:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.135s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:06:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:06:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.311s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:06:57 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:07:19 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-aeeb9c53-3b98-416d-a02e-df661a10f6a9 req-90f42802-fc9b-4155-85c1-aa2fbc4c043f tempest-VolumesSnapshotsTestJSON-515278275 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:07:19 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [req-aeeb9c53-3b98-416d-a02e-df661a10f6a9 req-90f42802-fc9b-4155-85c1-aa2fbc4c043f tempest-VolumesSnapshotsTestJSON-515278275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:07:19 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-aeeb9c53-3b98-416d-a02e-df661a10f6a9 req-90f42802-fc9b-4155-85c1-aa2fbc4c043f tempest-VolumesSnapshotsTestJSON-515278275 None] Flow 'volume_create_manager' (5bf3c7b2-cf7f-40b7-88c2-4875e207d515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:07:19 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-aeeb9c53-3b98-416d-a02e-df661a10f6a9 req-90f42802-fc9b-4155-85c1-aa2fbc4c043f tempest-VolumesSnapshotsTestJSON-515278275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2663dd6f-7f85-4124-a07c-7892668c75cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:07:20 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-aeeb9c53-3b98-416d-a02e-df661a10f6a9 req-90f42802-fc9b-4155-85c1-aa2fbc4c043f tempest-VolumesSnapshotsTestJSON-515278275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2663dd6f-7f85-4124-a07c-7892668c75cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:07:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1852041140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7893e45-bc24-4f44-b358-19b1d68996b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6465824befa435ab0e0443140da0077',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:07:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:07:19Z,use_quota=True,user_id='29e036f01b934082a149d413942eee90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:07:20 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-aeeb9c53-3b98-416d-a02e-df661a10f6a9 req-90f42802-fc9b-4155-85c1-aa2fbc4c043f tempest-VolumesSnapshotsTestJSON-515278275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aa19f36-3809-4b62-bd68-12e393191c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:07:20 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-aeeb9c53-3b98-416d-a02e-df661a10f6a9 req-90f42802-fc9b-4155-85c1-aa2fbc4c043f tempest-VolumesSnapshotsTestJSON-515278275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aa19f36-3809-4b62-bd68-12e393191c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:07:20 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-aeeb9c53-3b98-416d-a02e-df661a10f6a9 req-90f42802-fc9b-4155-85c1-aa2fbc4c043f tempest-VolumesSnapshotsTestJSON-515278275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40cbbc37-38f0-4c2b-aab5-3bac18b97ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:07:20 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-aeeb9c53-3b98-416d-a02e-df661a10f6a9 req-90f42802-fc9b-4155-85c1-aa2fbc4c043f tempest-VolumesSnapshotsTestJSON-515278275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40cbbc37-38f0-4c2b-aab5-3bac18b97ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7893e45-bc24-4f44-b358-19b1d68996b0', 'volume_name': 'volume-a7893e45-bc24-4f44-b358-19b1d68996b0', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:07:20 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-aeeb9c53-3b98-416d-a02e-df661a10f6a9 req-90f42802-fc9b-4155-85c1-aa2fbc4c043f tempest-VolumesSnapshotsTestJSON-515278275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9a60287-daa2-4a1d-93a0-a0c3c9189d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:07:20 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-aeeb9c53-3b98-416d-a02e-df661a10f6a9 req-90f42802-fc9b-4155-85c1-aa2fbc4c043f tempest-VolumesSnapshotsTestJSON-515278275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9a60287-daa2-4a1d-93a0-a0c3c9189d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:07:20 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-aeeb9c53-3b98-416d-a02e-df661a10f6a9 req-90f42802-fc9b-4155-85c1-aa2fbc4c043f tempest-VolumesSnapshotsTestJSON-515278275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c03b11d1-ab40-4c0e-b7eb-daf35bce8a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:07:20 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [req-aeeb9c53-3b98-416d-a02e-df661a10f6a9 req-90f42802-fc9b-4155-85c1-aa2fbc4c043f tempest-VolumesSnapshotsTestJSON-515278275 None] Volume a7893e45-bc24-4f44-b358-19b1d68996b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7893e45-bc24-4f44-b358-19b1d68996b0', 'volume_size': 1} Sep 10 21:07:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-aeeb9c53-3b98-416d-a02e-df661a10f6a9 req-90f42802-fc9b-4155-85c1-aa2fbc4c043f tempest-VolumesSnapshotsTestJSON-515278275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:07:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-aeeb9c53-3b98-416d-a02e-df661a10f6a9 req-90f42802-fc9b-4155-85c1-aa2fbc4c043f tempest-VolumesSnapshotsTestJSON-515278275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:07:20 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [req-aeeb9c53-3b98-416d-a02e-df661a10f6a9 req-90f42802-fc9b-4155-85c1-aa2fbc4c043f tempest-VolumesSnapshotsTestJSON-515278275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:07:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1852041140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7893e45-bc24-4f44-b358-19b1d68996b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6465824befa435ab0e0443140da0077',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:07:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:07:19Z,use_quota=True,user_id='29e036f01b934082a149d413942eee90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:07:20 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [req-aeeb9c53-3b98-416d-a02e-df661a10f6a9 req-90f42802-fc9b-4155-85c1-aa2fbc4c043f tempest-VolumesSnapshotsTestJSON-515278275 None] Creating volume a7893e45-bc24-4f44-b358-19b1d68996b0 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:07:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-aeeb9c53-3b98-416d-a02e-df661a10f6a9 req-90f42802-fc9b-4155-85c1-aa2fbc4c043f tempest-VolumesSnapshotsTestJSON-515278275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:07:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-aeeb9c53-3b98-416d-a02e-df661a10f6a9 req-90f42802-fc9b-4155-85c1-aa2fbc4c043f tempest-VolumesSnapshotsTestJSON-515278275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:07:20 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [req-aeeb9c53-3b98-416d-a02e-df661a10f6a9 req-90f42802-fc9b-4155-85c1-aa2fbc4c043f tempest-VolumesSnapshotsTestJSON-515278275 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:07:20 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [req-aeeb9c53-3b98-416d-a02e-df661a10f6a9 req-90f42802-fc9b-4155-85c1-aa2fbc4c043f tempest-VolumesSnapshotsTestJSON-515278275 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:07:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-aeeb9c53-3b98-416d-a02e-df661a10f6a9 req-90f42802-fc9b-4155-85c1-aa2fbc4c043f tempest-VolumesSnapshotsTestJSON-515278275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:07:20 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [req-aeeb9c53-3b98-416d-a02e-df661a10f6a9 req-90f42802-fc9b-4155-85c1-aa2fbc4c043f tempest-VolumesSnapshotsTestJSON-515278275 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:07:20 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [req-aeeb9c53-3b98-416d-a02e-df661a10f6a9 req-90f42802-fc9b-4155-85c1-aa2fbc4c043f tempest-VolumesSnapshotsTestJSON-515278275 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:07:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-aeeb9c53-3b98-416d-a02e-df661a10f6a9 req-90f42802-fc9b-4155-85c1-aa2fbc4c043f tempest-VolumesSnapshotsTestJSON-515278275 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a7893e45-bc24-4f44-b358-19b1d68996b0 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:07:20 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=8, name=volume-a7893e45-bc24-4f44-b358-19b1d68996b0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:07:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-aeeb9c53-3b98-416d-a02e-df661a10f6a9 req-90f42802-fc9b-4155-85c1-aa2fbc4c043f tempest-VolumesSnapshotsTestJSON-515278275 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a7893e45-bc24-4f44-b358-19b1d68996b0 1073741824" returned: 0 in 0.679s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:07:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-aeeb9c53-3b98-416d-a02e-df661a10f6a9 req-90f42802-fc9b-4155-85c1-aa2fbc4c043f tempest-VolumesSnapshotsTestJSON-515278275 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a7893e45-bc24-4f44-b358-19b1d68996b0 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:07:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-aeeb9c53-3b98-416d-a02e-df661a10f6a9 req-90f42802-fc9b-4155-85c1-aa2fbc4c043f tempest-VolumesSnapshotsTestJSON-515278275 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a7893e45-bc24-4f44-b358-19b1d68996b0" returned: 0 in 0.140s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:07:21 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [req-aeeb9c53-3b98-416d-a02e-df661a10f6a9 req-90f42802-fc9b-4155-85c1-aa2fbc4c043f tempest-VolumesSnapshotsTestJSON-515278275 None] <== create_volume: return (916ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:07:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-aeeb9c53-3b98-416d-a02e-df661a10f6a9 req-90f42802-fc9b-4155-85c1-aa2fbc4c043f tempest-VolumesSnapshotsTestJSON-515278275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:07:21 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-aeeb9c53-3b98-416d-a02e-df661a10f6a9 req-90f42802-fc9b-4155-85c1-aa2fbc4c043f tempest-VolumesSnapshotsTestJSON-515278275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c03b11d1-ab40-4c0e-b7eb-daf35bce8a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7893e45-bc24-4f44-b358-19b1d68996b0', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:07:21 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-aeeb9c53-3b98-416d-a02e-df661a10f6a9 req-90f42802-fc9b-4155-85c1-aa2fbc4c043f tempest-VolumesSnapshotsTestJSON-515278275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5137503-30e2-494a-b2fa-7ed39eb65204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:07:21 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [req-aeeb9c53-3b98-416d-a02e-df661a10f6a9 req-90f42802-fc9b-4155-85c1-aa2fbc4c043f tempest-VolumesSnapshotsTestJSON-515278275 None] Volume volume-a7893e45-bc24-4f44-b358-19b1d68996b0 (a7893e45-bc24-4f44-b358-19b1d68996b0): created successfully Sep 10 21:07:21 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-aeeb9c53-3b98-416d-a02e-df661a10f6a9 req-90f42802-fc9b-4155-85c1-aa2fbc4c043f tempest-VolumesSnapshotsTestJSON-515278275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5137503-30e2-494a-b2fa-7ed39eb65204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:07:21 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-aeeb9c53-3b98-416d-a02e-df661a10f6a9 req-90f42802-fc9b-4155-85c1-aa2fbc4c043f tempest-VolumesSnapshotsTestJSON-515278275 None] Flow 'volume_create_manager' (5bf3c7b2-cf7f-40b7-88c2-4875e207d515) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:07:21 devstack cinder-volume[82780]: INFO cinder.volume.manager [req-aeeb9c53-3b98-416d-a02e-df661a10f6a9 req-90f42802-fc9b-4155-85c1-aa2fbc4c043f tempest-VolumesSnapshotsTestJSON-515278275 None] Created volume successfully. Sep 10 21:07:22 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-5ab5e661-7d30-40b5-99ce-afa085d995e4 req-bfd4c837-e2f5-4d93-bc6a-f3d094a1c262 tempest-VolumesSnapshotsTestJSON-515278275 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:07:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-5ab5e661-7d30-40b5-99ce-afa085d995e4 req-bfd4c837-e2f5-4d93-bc6a-f3d094a1c262 tempest-VolumesSnapshotsTestJSON-515278275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:07:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-5ab5e661-7d30-40b5-99ce-afa085d995e4 req-bfd4c837-e2f5-4d93-bc6a-f3d094a1c262 tempest-VolumesSnapshotsTestJSON-515278275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.008s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:07:22 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [req-5ab5e661-7d30-40b5-99ce-afa085d995e4 req-bfd4c837-e2f5-4d93-bc6a-f3d094a1c262 tempest-VolumesSnapshotsTestJSON-515278275 None] Creating offline snapshot c097d695-276b-4b2a-b2d3-23254037833d of volume a7893e45-bc24-4f44-b358-19b1d68996b0 {{(pid=82780) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 21:07:22 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79f0e99-6a79-4aaa-82cf-b77a007fd3bd]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:07:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-5ab5e661-7d30-40b5-99ce-afa085d995e4 req-bfd4c837-e2f5-4d93-bc6a-f3d094a1c262 tempest-VolumesSnapshotsTestJSON-515278275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a7893e45-bc24-4f44-b358-19b1d68996b0 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:07:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-5ab5e661-7d30-40b5-99ce-afa085d995e4 req-bfd4c837-e2f5-4d93-bc6a-f3d094a1c262 tempest-VolumesSnapshotsTestJSON-515278275 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a7893e45-bc24-4f44-b358-19b1d68996b0" returned: 0 in 0.558s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:07:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-5ab5e661-7d30-40b5-99ce-afa085d995e4 req-bfd4c837-e2f5-4d93-bc6a-f3d094a1c262 tempest-VolumesSnapshotsTestJSON-515278275 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a7893e45-bc24-4f44-b358-19b1d68996b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a7893e45-bc24-4f44-b358-19b1d68996b0.c097d695-276b-4b2a-b2d3-23254037833d 1G {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:07:23 devstack quobyte-client[82807]: System call of process 86391 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:07:23 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=9, name=volume-a7893e45-bc24-4f44-b358-19b1d68996b0.c097d695-276b-4b2a-b2d3-23254037833d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:07:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-5ab5e661-7d30-40b5-99ce-afa085d995e4 req-bfd4c837-e2f5-4d93-bc6a-f3d094a1c262 tempest-VolumesSnapshotsTestJSON-515278275 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a7893e45-bc24-4f44-b358-19b1d68996b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a7893e45-bc24-4f44-b358-19b1d68996b0.c097d695-276b-4b2a-b2d3-23254037833d 1G" returned: 0 in 0.397s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:07:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-5ab5e661-7d30-40b5-99ce-afa085d995e4 req-bfd4c837-e2f5-4d93-bc6a-f3d094a1c262 tempest-VolumesSnapshotsTestJSON-515278275 None] Running cmd (subprocess): qemu-img rebase -u -b volume-a7893e45-bc24-4f44-b358-19b1d68996b0 -F qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a7893e45-bc24-4f44-b358-19b1d68996b0.c097d695-276b-4b2a-b2d3-23254037833d {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:07:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-5ab5e661-7d30-40b5-99ce-afa085d995e4 req-bfd4c837-e2f5-4d93-bc6a-f3d094a1c262 tempest-VolumesSnapshotsTestJSON-515278275 None] CMD "qemu-img rebase -u -b volume-a7893e45-bc24-4f44-b358-19b1d68996b0 -F qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a7893e45-bc24-4f44-b358-19b1d68996b0.c097d695-276b-4b2a-b2d3-23254037833d" returned: 0 in 0.300s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:07:23 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [req-5ab5e661-7d30-40b5-99ce-afa085d995e4 req-bfd4c837-e2f5-4d93-bc6a-f3d094a1c262 tempest-VolumesSnapshotsTestJSON-515278275 None] File path /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a7893e45-bc24-4f44-b358-19b1d68996b0.c097d695-276b-4b2a-b2d3-23254037833d is being set with permissions: 660 {{(pid=82780) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 21:07:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-5ab5e661-7d30-40b5-99ce-afa085d995e4 req-bfd4c837-e2f5-4d93-bc6a-f3d094a1c262 tempest-VolumesSnapshotsTestJSON-515278275 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a7893e45-bc24-4f44-b358-19b1d68996b0.c097d695-276b-4b2a-b2d3-23254037833d {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:07:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-5ab5e661-7d30-40b5-99ce-afa085d995e4 req-bfd4c837-e2f5-4d93-bc6a-f3d094a1c262 tempest-VolumesSnapshotsTestJSON-515278275 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a7893e45-bc24-4f44-b358-19b1d68996b0.c097d695-276b-4b2a-b2d3-23254037833d" returned: 0 in 0.087s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:07:24 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [req-5ab5e661-7d30-40b5-99ce-afa085d995e4 req-bfd4c837-e2f5-4d93-bc6a-f3d094a1c262 tempest-VolumesSnapshotsTestJSON-515278275 None] Setting permissions: /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a7893e45-bc24-4f44-b358-19b1d68996b0 -> 1000:1000 {{(pid=82780) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 21:07:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-5ab5e661-7d30-40b5-99ce-afa085d995e4 req-bfd4c837-e2f5-4d93-bc6a-f3d094a1c262 tempest-VolumesSnapshotsTestJSON-515278275 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a7893e45-bc24-4f44-b358-19b1d68996b0 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a7893e45-bc24-4f44-b358-19b1d68996b0.c097d695-276b-4b2a-b2d3-23254037833d {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:07:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-5ab5e661-7d30-40b5-99ce-afa085d995e4 req-bfd4c837-e2f5-4d93-bc6a-f3d094a1c262 tempest-VolumesSnapshotsTestJSON-515278275 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a7893e45-bc24-4f44-b358-19b1d68996b0 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a7893e45-bc24-4f44-b358-19b1d68996b0.c097d695-276b-4b2a-b2d3-23254037833d" returned: 0 in 0.116s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:07:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-5ab5e661-7d30-40b5-99ce-afa085d995e4 req-bfd4c837-e2f5-4d93-bc6a-f3d094a1c262 tempest-VolumesSnapshotsTestJSON-515278275 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a7893e45-bc24-4f44-b358-19b1d68996b0.info {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:07:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-5ab5e661-7d30-40b5-99ce-afa085d995e4 req-bfd4c837-e2f5-4d93-bc6a-f3d094a1c262 tempest-VolumesSnapshotsTestJSON-515278275 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a7893e45-bc24-4f44-b358-19b1d68996b0.info" returned: 0 in 0.131s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:07:24 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [req-5ab5e661-7d30-40b5-99ce-afa085d995e4 req-bfd4c837-e2f5-4d93-bc6a-f3d094a1c262 tempest-VolumesSnapshotsTestJSON-515278275 None] File path /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a7893e45-bc24-4f44-b358-19b1d68996b0.info is being set with permissions: 660 {{(pid=82780) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 21:07:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-5ab5e661-7d30-40b5-99ce-afa085d995e4 req-bfd4c837-e2f5-4d93-bc6a-f3d094a1c262 tempest-VolumesSnapshotsTestJSON-515278275 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a7893e45-bc24-4f44-b358-19b1d68996b0.info {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:07:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-5ab5e661-7d30-40b5-99ce-afa085d995e4 req-bfd4c837-e2f5-4d93-bc6a-f3d094a1c262 tempest-VolumesSnapshotsTestJSON-515278275 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a7893e45-bc24-4f44-b358-19b1d68996b0.info" returned: 0 in 0.096s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:07:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-5ab5e661-7d30-40b5-99ce-afa085d995e4 req-bfd4c837-e2f5-4d93-bc6a-f3d094a1c262 tempest-VolumesSnapshotsTestJSON-515278275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.100s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:07:24 devstack cinder-volume[82780]: INFO cinder.volume.manager [req-5ab5e661-7d30-40b5-99ce-afa085d995e4 req-bfd4c837-e2f5-4d93-bc6a-f3d094a1c262 tempest-VolumesSnapshotsTestJSON-515278275 None] Create snapshot completed successfully Sep 10 21:07:26 devstack cinder-volume[82780]: DEBUG cinder.coordination [req-49bb38d5-3e71-4328-82e0-c769227e2cf9 req-93a9c77a-f421-4e7d-a010-8b501ba62850 tempest-VolumesSnapshotsTestJSON-515278275 None] Acquiring lock "cinder-c097d695-276b-4b2a-b2d3-23254037833d-delete_snapshot" by "delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:07:26 devstack cinder-volume[82780]: DEBUG cinder.coordination [req-49bb38d5-3e71-4328-82e0-c769227e2cf9 req-93a9c77a-f421-4e7d-a010-8b501ba62850 tempest-VolumesSnapshotsTestJSON-515278275 None] Lock "cinder-c097d695-276b-4b2a-b2d3-23254037833d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.125s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:07:26 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-49bb38d5-3e71-4328-82e0-c769227e2cf9 req-93a9c77a-f421-4e7d-a010-8b501ba62850 tempest-VolumesSnapshotsTestJSON-515278275 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:07:26 devstack cinder-volume[82780]: DEBUG cinder.coordination [req-49bb38d5-3e71-4328-82e0-c769227e2cf9 req-93a9c77a-f421-4e7d-a010-8b501ba62850 tempest-VolumesSnapshotsTestJSON-515278275 None] Acquiring lock "cinder-quobyte-a7893e45-bc24-4f44-b358-19b1d68996b0" by "delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:07:26 devstack cinder-volume[82780]: DEBUG cinder.coordination [req-49bb38d5-3e71-4328-82e0-c769227e2cf9 req-93a9c77a-f421-4e7d-a010-8b501ba62850 tempest-VolumesSnapshotsTestJSON-515278275 None] Lock "cinder-quobyte-a7893e45-bc24-4f44-b358-19b1d68996b0" acquired by "delete_snapshot" :: waited 0.064s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:07:26 devstack cinder-volume[82780]: DEBUG cinder.coordination [req-49bb38d5-3e71-4328-82e0-c769227e2cf9 req-93a9c77a-f421-4e7d-a010-8b501ba62850 tempest-VolumesSnapshotsTestJSON-515278275 None] Acquiring lock "cinder-quobyte-c097d695-276b-4b2a-b2d3-23254037833d" by "_delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:07:26 devstack cinder-volume[82780]: DEBUG cinder.coordination [req-49bb38d5-3e71-4328-82e0-c769227e2cf9 req-93a9c77a-f421-4e7d-a010-8b501ba62850 tempest-VolumesSnapshotsTestJSON-515278275 None] Lock "cinder-quobyte-c097d695-276b-4b2a-b2d3-23254037833d" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:07:26 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [req-49bb38d5-3e71-4328-82e0-c769227e2cf9 req-93a9c77a-f421-4e7d-a010-8b501ba62850 tempest-VolumesSnapshotsTestJSON-515278275 None] Deleting offline snapshot c097d695-276b-4b2a-b2d3-23254037833d of volume a7893e45-bc24-4f44-b358-19b1d68996b0 {{(pid=82780) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 21:07:26 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [req-49bb38d5-3e71-4328-82e0-c769227e2cf9 req-93a9c77a-f421-4e7d-a010-8b501ba62850 tempest-VolumesSnapshotsTestJSON-515278275 None] snapshot_file for this snap is: volume-a7893e45-bc24-4f44-b358-19b1d68996b0.c097d695-276b-4b2a-b2d3-23254037833d {{(pid=82780) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 21:07:26 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e81cf72-9271-4568-990f-67a47917639c]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:07:26 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-49bb38d5-3e71-4328-82e0-c769227e2cf9 req-93a9c77a-f421-4e7d-a010-8b501ba62850 tempest-VolumesSnapshotsTestJSON-515278275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a7893e45-bc24-4f44-b358-19b1d68996b0.c097d695-276b-4b2a-b2d3-23254037833d {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:07:27 devstack quobyte-client[82807]: System call of process 86401 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:07:27 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-49bb38d5-3e71-4328-82e0-c769227e2cf9 req-93a9c77a-f421-4e7d-a010-8b501ba62850 tempest-VolumesSnapshotsTestJSON-515278275 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a7893e45-bc24-4f44-b358-19b1d68996b0.c097d695-276b-4b2a-b2d3-23254037833d" returned: 0 in 0.676s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:07:27 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [req-49bb38d5-3e71-4328-82e0-c769227e2cf9 req-93a9c77a-f421-4e7d-a010-8b501ba62850 tempest-VolumesSnapshotsTestJSON-515278275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7893e45-bc24-4f44-b358-19b1d68996b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82780) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 21:07:27 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf39ddd8-2460-4aae-ac52-2ec0eeb9cc4c]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:07:27 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-49bb38d5-3e71-4328-82e0-c769227e2cf9 req-93a9c77a-f421-4e7d-a010-8b501ba62850 tempest-VolumesSnapshotsTestJSON-515278275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a7893e45-bc24-4f44-b358-19b1d68996b0 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:07:27 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-49bb38d5-3e71-4328-82e0-c769227e2cf9 req-93a9c77a-f421-4e7d-a010-8b501ba62850 tempest-VolumesSnapshotsTestJSON-515278275 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a7893e45-bc24-4f44-b358-19b1d68996b0" returned: 0 in 0.550s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:07:27 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-49bb38d5-3e71-4328-82e0-c769227e2cf9 req-93a9c77a-f421-4e7d-a010-8b501ba62850 tempest-VolumesSnapshotsTestJSON-515278275 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a7893e45-bc24-4f44-b358-19b1d68996b0.c097d695-276b-4b2a-b2d3-23254037833d {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:07:28 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-49bb38d5-3e71-4328-82e0-c769227e2cf9 req-93a9c77a-f421-4e7d-a010-8b501ba62850 tempest-VolumesSnapshotsTestJSON-515278275 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a7893e45-bc24-4f44-b358-19b1d68996b0.c097d695-276b-4b2a-b2d3-23254037833d" returned: 0 in 0.521s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:07:28 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-49bb38d5-3e71-4328-82e0-c769227e2cf9 req-93a9c77a-f421-4e7d-a010-8b501ba62850 tempest-VolumesSnapshotsTestJSON-515278275 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a7893e45-bc24-4f44-b358-19b1d68996b0.c097d695-276b-4b2a-b2d3-23254037833d {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:07:28 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-49bb38d5-3e71-4328-82e0-c769227e2cf9 req-93a9c77a-f421-4e7d-a010-8b501ba62850 tempest-VolumesSnapshotsTestJSON-515278275 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a7893e45-bc24-4f44-b358-19b1d68996b0.c097d695-276b-4b2a-b2d3-23254037833d" returned: 0 in 0.177s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:07:28 devstack cinder-volume[82780]: DEBUG cinder.coordination [req-49bb38d5-3e71-4328-82e0-c769227e2cf9 req-93a9c77a-f421-4e7d-a010-8b501ba62850 tempest-VolumesSnapshotsTestJSON-515278275 None] Lock "cinder-quobyte-c097d695-276b-4b2a-b2d3-23254037833d" released by "_delete_snapshot" :: held 2.484s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:07:28 devstack cinder-volume[82780]: DEBUG cinder.coordination [req-49bb38d5-3e71-4328-82e0-c769227e2cf9 req-93a9c77a-f421-4e7d-a010-8b501ba62850 tempest-VolumesSnapshotsTestJSON-515278275 None] Lock "cinder-quobyte-a7893e45-bc24-4f44-b358-19b1d68996b0" released by "delete_snapshot" :: held 2.558s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:07:29 devstack cinder-volume[82780]: WARNING cinder.quota [req-49bb38d5-3e71-4328-82e0-c769227e2cf9 req-93a9c77a-f421-4e7d-a010-8b501ba62850 tempest-VolumesSnapshotsTestJSON-515278275 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 10 21:07:29 devstack cinder-volume[82780]: DEBUG cinder.quota [req-49bb38d5-3e71-4328-82e0-c769227e2cf9 req-93a9c77a-f421-4e7d-a010-8b501ba62850 tempest-VolumesSnapshotsTestJSON-515278275 None] Created reservations ['2331384f-0eae-4656-966b-f1d72218cb8a', '4f021931-e036-4a92-a8eb-89b81eb1fd11', '81ff9bc2-f3b9-4f47-8d73-a615be4f12ce', '5502e4ec-ee87-415f-9720-bcb4ff7e07d3'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:07:29 devstack cinder-volume[82780]: INFO cinder.volume.manager [req-49bb38d5-3e71-4328-82e0-c769227e2cf9 req-93a9c77a-f421-4e7d-a010-8b501ba62850 tempest-VolumesSnapshotsTestJSON-515278275 None] Delete snapshot completed successfully. Sep 10 21:07:29 devstack cinder-volume[82780]: DEBUG cinder.coordination [req-49bb38d5-3e71-4328-82e0-c769227e2cf9 req-93a9c77a-f421-4e7d-a010-8b501ba62850 tempest-VolumesSnapshotsTestJSON-515278275 None] Lock "cinder-c097d695-276b-4b2a-b2d3-23254037833d-delete_snapshot" released by "delete_snapshot" :: held 3.355s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:07:29 devstack cinder-volume[82780]: DEBUG cinder.coordination [req-35abbaa1-93c4-4a38-99bb-77e5b5a7168c req-0d9174b6-68f4-4515-a9ec-2089730373e5 tempest-VolumesSnapshotsTestJSON-515278275 None] Acquiring lock "cinder-a7893e45-bc24-4f44-b358-19b1d68996b0-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:07:29 devstack cinder-volume[82780]: DEBUG cinder.coordination [req-35abbaa1-93c4-4a38-99bb-77e5b5a7168c req-0d9174b6-68f4-4515-a9ec-2089730373e5 tempest-VolumesSnapshotsTestJSON-515278275 None] Lock "cinder-a7893e45-bc24-4f44-b358-19b1d68996b0-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:07:29 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-35abbaa1-93c4-4a38-99bb-77e5b5a7168c req-0d9174b6-68f4-4515-a9ec-2089730373e5 tempest-VolumesSnapshotsTestJSON-515278275 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:07:29 devstack cinder-volume[82780]: DEBUG cinder.coordination [req-35abbaa1-93c4-4a38-99bb-77e5b5a7168c req-0d9174b6-68f4-4515-a9ec-2089730373e5 tempest-VolumesSnapshotsTestJSON-515278275 None] Acquiring lock "cinder-quobyte-a7893e45-bc24-4f44-b358-19b1d68996b0" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:07:29 devstack cinder-volume[82780]: DEBUG cinder.coordination [req-35abbaa1-93c4-4a38-99bb-77e5b5a7168c req-0d9174b6-68f4-4515-a9ec-2089730373e5 tempest-VolumesSnapshotsTestJSON-515278275 None] Lock "cinder-quobyte-a7893e45-bc24-4f44-b358-19b1d68996b0" acquired by "delete_volume" :: waited 0.018s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:07:30 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e5a8c9-efe1-4f1e-83c7-ba0c09ab8315]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:07:30 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-35abbaa1-93c4-4a38-99bb-77e5b5a7168c req-0d9174b6-68f4-4515-a9ec-2089730373e5 tempest-VolumesSnapshotsTestJSON-515278275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a7893e45-bc24-4f44-b358-19b1d68996b0 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:07:30 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-35abbaa1-93c4-4a38-99bb-77e5b5a7168c req-0d9174b6-68f4-4515-a9ec-2089730373e5 tempest-VolumesSnapshotsTestJSON-515278275 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a7893e45-bc24-4f44-b358-19b1d68996b0" returned: 0 in 0.608s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:07:30 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-35abbaa1-93c4-4a38-99bb-77e5b5a7168c req-0d9174b6-68f4-4515-a9ec-2089730373e5 tempest-VolumesSnapshotsTestJSON-515278275 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a7893e45-bc24-4f44-b358-19b1d68996b0 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:07:30 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-35abbaa1-93c4-4a38-99bb-77e5b5a7168c req-0d9174b6-68f4-4515-a9ec-2089730373e5 tempest-VolumesSnapshotsTestJSON-515278275 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a7893e45-bc24-4f44-b358-19b1d68996b0" returned: 0 in 0.125s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:07:30 devstack cinder-volume[82780]: DEBUG cinder.coordination [req-35abbaa1-93c4-4a38-99bb-77e5b5a7168c req-0d9174b6-68f4-4515-a9ec-2089730373e5 tempest-VolumesSnapshotsTestJSON-515278275 None] Lock "cinder-quobyte-a7893e45-bc24-4f44-b358-19b1d68996b0" released by "delete_volume" :: held 0.939s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:07:31 devstack cinder-volume[82780]: DEBUG cinder.quota [req-35abbaa1-93c4-4a38-99bb-77e5b5a7168c req-0d9174b6-68f4-4515-a9ec-2089730373e5 tempest-VolumesSnapshotsTestJSON-515278275 None] Created reservations ['b4f68c8a-faf4-4a95-b2ca-fac1cac8f853', 'cf6c05a2-9153-4374-a2e0-9618a6dbb8ca', '656b5d48-53b1-46e1-b746-c3a12f40c5b4', '16346567-6754-44ae-b70d-ee3a6e46e9fd'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:07:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-35abbaa1-93c4-4a38-99bb-77e5b5a7168c req-0d9174b6-68f4-4515-a9ec-2089730373e5 tempest-VolumesSnapshotsTestJSON-515278275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:07:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-35abbaa1-93c4-4a38-99bb-77e5b5a7168c req-0d9174b6-68f4-4515-a9ec-2089730373e5 tempest-VolumesSnapshotsTestJSON-515278275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:07:31 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [req-35abbaa1-93c4-4a38-99bb-77e5b5a7168c req-0d9174b6-68f4-4515-a9ec-2089730373e5 tempest-VolumesSnapshotsTestJSON-515278275 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:07:31 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [req-35abbaa1-93c4-4a38-99bb-77e5b5a7168c req-0d9174b6-68f4-4515-a9ec-2089730373e5 tempest-VolumesSnapshotsTestJSON-515278275 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:07:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-35abbaa1-93c4-4a38-99bb-77e5b5a7168c req-0d9174b6-68f4-4515-a9ec-2089730373e5 tempest-VolumesSnapshotsTestJSON-515278275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:07:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-35abbaa1-93c4-4a38-99bb-77e5b5a7168c req-0d9174b6-68f4-4515-a9ec-2089730373e5 tempest-VolumesSnapshotsTestJSON-515278275 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:07:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-35abbaa1-93c4-4a38-99bb-77e5b5a7168c req-0d9174b6-68f4-4515-a9ec-2089730373e5 tempest-VolumesSnapshotsTestJSON-515278275 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.116s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:07:31 devstack cinder-volume[82780]: DEBUG cinder.manager [req-35abbaa1-93c4-4a38-99bb-77e5b5a7168c req-0d9174b6-68f4-4515-a9ec-2089730373e5 tempest-VolumesSnapshotsTestJSON-515278275 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:07:31 devstack cinder-volume[82780]: INFO cinder.volume.manager [req-35abbaa1-93c4-4a38-99bb-77e5b5a7168c req-0d9174b6-68f4-4515-a9ec-2089730373e5 tempest-VolumesSnapshotsTestJSON-515278275 None] Deleted volume successfully. Sep 10 21:07:31 devstack cinder-volume[82780]: DEBUG cinder.coordination [req-35abbaa1-93c4-4a38-99bb-77e5b5a7168c req-0d9174b6-68f4-4515-a9ec-2089730373e5 tempest-VolumesSnapshotsTestJSON-515278275 None] Lock "cinder-a7893e45-bc24-4f44-b358-19b1d68996b0-delete_volume" released by "delete_volume" :: held 2.146s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:07:41 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=14,cinder:UPDATE=13,cinder:DELETE=1,cinder:INSERT=8 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:07:41 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-847383c8-524e-41a5-9ea4-d69e652f021a tempest-GroupSnapshotsV319Test-1279547868 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:07:41 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-847383c8-524e-41a5-9ea4-d69e652f021a tempest-GroupSnapshotsV319Test-1279547868 None] Group tempest-GroupSnapshotsV319Test-Group-1869078252: creating Sep 10 21:07:41 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:UPDATE=20,cinder:SELECT=10,cinder:DELETE=2 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:07:41 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-847383c8-524e-41a5-9ea4-d69e652f021a tempest-GroupSnapshotsV319Test-1279547868 None] Group tempest-GroupSnapshotsV319Test-Group-1869078252: created successfully Sep 10 21:07:41 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-847383c8-524e-41a5-9ea4-d69e652f021a tempest-GroupSnapshotsV319Test-1279547868 None] Create group completed successfully. Sep 10 21:07:43 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-4e1a3062-3d04-45ff-88c7-eed8a6fdac58 tempest-GroupSnapshotsV319Test-1279547868 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:07:43 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e1a3062-3d04-45ff-88c7-eed8a6fdac58 tempest-GroupSnapshotsV319Test-1279547868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:07:43 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4e1a3062-3d04-45ff-88c7-eed8a6fdac58 tempest-GroupSnapshotsV319Test-1279547868 None] Flow 'volume_create_manager' (04afd020-eb5a-4d68-85ec-211fa26cb522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:07:43 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4e1a3062-3d04-45ff-88c7-eed8a6fdac58 tempest-GroupSnapshotsV319Test-1279547868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (071c28ff-dd3d-4f34-b2ab-2ddd638062e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:07:43 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4e1a3062-3d04-45ff-88c7-eed8a6fdac58 tempest-GroupSnapshotsV319Test-1279547868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (071c28ff-dd3d-4f34-b2ab-2ddd638062e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:07:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1307505048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=94e6f677-2bfa-4720-a0da-8e1ae2c89db1,host='devstack@QuobyteHD#QuobyteHD',id=76f5b057-534e-4c66-8a0e-9e50be276af2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41738b0162a04a29b3225df99859f762',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:07:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:07:43Z,use_quota=True,user_id='5a276ae3ba2b4c19a760ef1b091168e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c7b50a6-f6c8-4bf9-a328-36ef36734000),volume_type_id=6c7b50a6-f6c8-4bf9-a328-36ef36734000)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:07:43 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4e1a3062-3d04-45ff-88c7-eed8a6fdac58 tempest-GroupSnapshotsV319Test-1279547868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (922862da-6102-425c-996f-737a6213a431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:07:43 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4e1a3062-3d04-45ff-88c7-eed8a6fdac58 tempest-GroupSnapshotsV319Test-1279547868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (922862da-6102-425c-996f-737a6213a431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:07:43 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4e1a3062-3d04-45ff-88c7-eed8a6fdac58 tempest-GroupSnapshotsV319Test-1279547868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcea0832-3e6b-4c53-a58c-6b791ac8712c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:07:43 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4e1a3062-3d04-45ff-88c7-eed8a6fdac58 tempest-GroupSnapshotsV319Test-1279547868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcea0832-3e6b-4c53-a58c-6b791ac8712c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76f5b057-534e-4c66-8a0e-9e50be276af2', 'volume_name': 'volume-76f5b057-534e-4c66-8a0e-9e50be276af2', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:07:43 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4e1a3062-3d04-45ff-88c7-eed8a6fdac58 tempest-GroupSnapshotsV319Test-1279547868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6893d185-58cc-4b4b-ac83-93e17e0b2170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:07:43 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4e1a3062-3d04-45ff-88c7-eed8a6fdac58 tempest-GroupSnapshotsV319Test-1279547868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6893d185-58cc-4b4b-ac83-93e17e0b2170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:07:43 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4e1a3062-3d04-45ff-88c7-eed8a6fdac58 tempest-GroupSnapshotsV319Test-1279547868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e11d1482-6dd9-48a9-8f74-ffc1ab580c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:07:43 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-4e1a3062-3d04-45ff-88c7-eed8a6fdac58 tempest-GroupSnapshotsV319Test-1279547868 None] Volume 76f5b057-534e-4c66-8a0e-9e50be276af2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76f5b057-534e-4c66-8a0e-9e50be276af2', 'volume_size': 1} Sep 10 21:07:43 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-4e1a3062-3d04-45ff-88c7-eed8a6fdac58 tempest-GroupSnapshotsV319Test-1279547868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:07:43 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-4e1a3062-3d04-45ff-88c7-eed8a6fdac58 tempest-GroupSnapshotsV319Test-1279547868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:07:43 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-4e1a3062-3d04-45ff-88c7-eed8a6fdac58 tempest-GroupSnapshotsV319Test-1279547868 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=94e6f677-2bfa-4720-a0da-8e1ae2c89db1,created_at=2025-09-10T19:07:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1307505048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=94e6f677-2bfa-4720-a0da-8e1ae2c89db1,host='devstack@QuobyteHD#QuobyteHD',id=76f5b057-534e-4c66-8a0e-9e50be276af2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41738b0162a04a29b3225df99859f762',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:07:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:07:43Z,use_quota=True,user_id='5a276ae3ba2b4c19a760ef1b091168e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c7b50a6-f6c8-4bf9-a328-36ef36734000),volume_type_id=6c7b50a6-f6c8-4bf9-a328-36ef36734000)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:07:43 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-4e1a3062-3d04-45ff-88c7-eed8a6fdac58 tempest-GroupSnapshotsV319Test-1279547868 None] Creating volume 76f5b057-534e-4c66-8a0e-9e50be276af2 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:07:43 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-4e1a3062-3d04-45ff-88c7-eed8a6fdac58 tempest-GroupSnapshotsV319Test-1279547868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:07:43 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-4e1a3062-3d04-45ff-88c7-eed8a6fdac58 tempest-GroupSnapshotsV319Test-1279547868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:07:43 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-4e1a3062-3d04-45ff-88c7-eed8a6fdac58 tempest-GroupSnapshotsV319Test-1279547868 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:07:43 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-4e1a3062-3d04-45ff-88c7-eed8a6fdac58 tempest-GroupSnapshotsV319Test-1279547868 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:07:43 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-4e1a3062-3d04-45ff-88c7-eed8a6fdac58 tempest-GroupSnapshotsV319Test-1279547868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:07:43 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-4e1a3062-3d04-45ff-88c7-eed8a6fdac58 tempest-GroupSnapshotsV319Test-1279547868 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:07:43 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-4e1a3062-3d04-45ff-88c7-eed8a6fdac58 tempest-GroupSnapshotsV319Test-1279547868 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:07:43 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4e1a3062-3d04-45ff-88c7-eed8a6fdac58 tempest-GroupSnapshotsV319Test-1279547868 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-76f5b057-534e-4c66-8a0e-9e50be276af2 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:07:43 devstack quobyte-client[82807]: System call of process 86481 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:07:43 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=11, name=volume-76f5b057-534e-4c66-8a0e-9e50be276af2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:07:44 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4e1a3062-3d04-45ff-88c7-eed8a6fdac58 tempest-GroupSnapshotsV319Test-1279547868 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-76f5b057-534e-4c66-8a0e-9e50be276af2 1073741824" returned: 0 in 0.391s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:07:44 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4e1a3062-3d04-45ff-88c7-eed8a6fdac58 tempest-GroupSnapshotsV319Test-1279547868 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-76f5b057-534e-4c66-8a0e-9e50be276af2 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:07:44 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4e1a3062-3d04-45ff-88c7-eed8a6fdac58 tempest-GroupSnapshotsV319Test-1279547868 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-76f5b057-534e-4c66-8a0e-9e50be276af2" returned: 0 in 0.148s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:07:44 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-4e1a3062-3d04-45ff-88c7-eed8a6fdac58 tempest-GroupSnapshotsV319Test-1279547868 None] <== create_volume: return (607ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:07:44 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-4e1a3062-3d04-45ff-88c7-eed8a6fdac58 tempest-GroupSnapshotsV319Test-1279547868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.619s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:07:44 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4e1a3062-3d04-45ff-88c7-eed8a6fdac58 tempest-GroupSnapshotsV319Test-1279547868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e11d1482-6dd9-48a9-8f74-ffc1ab580c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76f5b057-534e-4c66-8a0e-9e50be276af2', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:07:44 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4e1a3062-3d04-45ff-88c7-eed8a6fdac58 tempest-GroupSnapshotsV319Test-1279547868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b724095-2313-46ea-9faa-84919fee2522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:07:44 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-4e1a3062-3d04-45ff-88c7-eed8a6fdac58 tempest-GroupSnapshotsV319Test-1279547868 None] Volume volume-76f5b057-534e-4c66-8a0e-9e50be276af2 (76f5b057-534e-4c66-8a0e-9e50be276af2): created successfully Sep 10 21:07:44 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4e1a3062-3d04-45ff-88c7-eed8a6fdac58 tempest-GroupSnapshotsV319Test-1279547868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b724095-2313-46ea-9faa-84919fee2522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:07:44 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4e1a3062-3d04-45ff-88c7-eed8a6fdac58 tempest-GroupSnapshotsV319Test-1279547868 None] Flow 'volume_create_manager' (04afd020-eb5a-4d68-85ec-211fa26cb522) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:07:44 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-4e1a3062-3d04-45ff-88c7-eed8a6fdac58 tempest-GroupSnapshotsV319Test-1279547868 None] Created volume successfully. Sep 10 21:07:46 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-876afd66-a3bf-49ca-98aa-112d3a48c84e tempest-GroupSnapshotsV319Test-1279547868 None] GroupSnapshot a876f18a-dfc7-4a91-94ab-3238371fad72: creating. Sep 10 21:07:46 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-876afd66-a3bf-49ca-98aa-112d3a48c84e tempest-GroupSnapshotsV319Test-1279547868 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:07:46 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-876afd66-a3bf-49ca-98aa-112d3a48c84e tempest-GroupSnapshotsV319Test-1279547868 None] Group snapshot a876f18a-dfc7-4a91-94ab-3238371fad72: creating. {{(pid=82780) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}} Sep 10 21:07:46 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-876afd66-a3bf-49ca-98aa-112d3a48c84e tempest-GroupSnapshotsV319Test-1279547868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:07:46 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-876afd66-a3bf-49ca-98aa-112d3a48c84e tempest-GroupSnapshotsV319Test-1279547868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:07:46 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-876afd66-a3bf-49ca-98aa-112d3a48c84e tempest-GroupSnapshotsV319Test-1279547868 None] Creating offline snapshot 80b36227-15ef-4fc9-a8ea-8fe26c435b84 of volume 76f5b057-534e-4c66-8a0e-9e50be276af2 {{(pid=82780) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 21:07:46 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b0bb7c-3451-40df-abbf-9cb0010addcc]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:07:46 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-876afd66-a3bf-49ca-98aa-112d3a48c84e tempest-GroupSnapshotsV319Test-1279547868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-76f5b057-534e-4c66-8a0e-9e50be276af2 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:07:46 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-876afd66-a3bf-49ca-98aa-112d3a48c84e tempest-GroupSnapshotsV319Test-1279547868 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-76f5b057-534e-4c66-8a0e-9e50be276af2" returned: 0 in 0.477s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:07:47 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-876afd66-a3bf-49ca-98aa-112d3a48c84e tempest-GroupSnapshotsV319Test-1279547868 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-76f5b057-534e-4c66-8a0e-9e50be276af2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-76f5b057-534e-4c66-8a0e-9e50be276af2.80b36227-15ef-4fc9-a8ea-8fe26c435b84 1G {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:07:47 devstack quobyte-client[82807]: System call of process 86492 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:07:47 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=12, name=volume-76f5b057-534e-4c66-8a0e-9e50be276af2.80b36227-15ef-4fc9-a8ea-8fe26c435b84, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:07:47 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-876afd66-a3bf-49ca-98aa-112d3a48c84e tempest-GroupSnapshotsV319Test-1279547868 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-76f5b057-534e-4c66-8a0e-9e50be276af2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-76f5b057-534e-4c66-8a0e-9e50be276af2.80b36227-15ef-4fc9-a8ea-8fe26c435b84 1G" returned: 0 in 0.363s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:07:47 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-876afd66-a3bf-49ca-98aa-112d3a48c84e tempest-GroupSnapshotsV319Test-1279547868 None] Running cmd (subprocess): qemu-img rebase -u -b volume-76f5b057-534e-4c66-8a0e-9e50be276af2 -F qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-76f5b057-534e-4c66-8a0e-9e50be276af2.80b36227-15ef-4fc9-a8ea-8fe26c435b84 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:07:47 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-876afd66-a3bf-49ca-98aa-112d3a48c84e tempest-GroupSnapshotsV319Test-1279547868 None] CMD "qemu-img rebase -u -b volume-76f5b057-534e-4c66-8a0e-9e50be276af2 -F qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-76f5b057-534e-4c66-8a0e-9e50be276af2.80b36227-15ef-4fc9-a8ea-8fe26c435b84" returned: 0 in 0.257s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:07:47 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-876afd66-a3bf-49ca-98aa-112d3a48c84e tempest-GroupSnapshotsV319Test-1279547868 None] File path /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-76f5b057-534e-4c66-8a0e-9e50be276af2.80b36227-15ef-4fc9-a8ea-8fe26c435b84 is being set with permissions: 660 {{(pid=82780) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 21:07:47 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-876afd66-a3bf-49ca-98aa-112d3a48c84e tempest-GroupSnapshotsV319Test-1279547868 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-76f5b057-534e-4c66-8a0e-9e50be276af2.80b36227-15ef-4fc9-a8ea-8fe26c435b84 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:07:47 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-876afd66-a3bf-49ca-98aa-112d3a48c84e tempest-GroupSnapshotsV319Test-1279547868 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-76f5b057-534e-4c66-8a0e-9e50be276af2.80b36227-15ef-4fc9-a8ea-8fe26c435b84" returned: 0 in 0.104s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:07:47 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-876afd66-a3bf-49ca-98aa-112d3a48c84e tempest-GroupSnapshotsV319Test-1279547868 None] Setting permissions: /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-76f5b057-534e-4c66-8a0e-9e50be276af2 -> 1000:1000 {{(pid=82780) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 21:07:47 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-876afd66-a3bf-49ca-98aa-112d3a48c84e tempest-GroupSnapshotsV319Test-1279547868 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-76f5b057-534e-4c66-8a0e-9e50be276af2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-76f5b057-534e-4c66-8a0e-9e50be276af2.80b36227-15ef-4fc9-a8ea-8fe26c435b84 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:07:48 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-876afd66-a3bf-49ca-98aa-112d3a48c84e tempest-GroupSnapshotsV319Test-1279547868 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-76f5b057-534e-4c66-8a0e-9e50be276af2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-76f5b057-534e-4c66-8a0e-9e50be276af2.80b36227-15ef-4fc9-a8ea-8fe26c435b84" returned: 0 in 0.106s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:07:48 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-876afd66-a3bf-49ca-98aa-112d3a48c84e tempest-GroupSnapshotsV319Test-1279547868 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-76f5b057-534e-4c66-8a0e-9e50be276af2.info {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:07:48 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-876afd66-a3bf-49ca-98aa-112d3a48c84e tempest-GroupSnapshotsV319Test-1279547868 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-76f5b057-534e-4c66-8a0e-9e50be276af2.info" returned: 0 in 0.113s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:07:48 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-876afd66-a3bf-49ca-98aa-112d3a48c84e tempest-GroupSnapshotsV319Test-1279547868 None] File path /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-76f5b057-534e-4c66-8a0e-9e50be276af2.info is being set with permissions: 660 {{(pid=82780) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 21:07:48 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-876afd66-a3bf-49ca-98aa-112d3a48c84e tempest-GroupSnapshotsV319Test-1279547868 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-76f5b057-534e-4c66-8a0e-9e50be276af2.info {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:07:48 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-876afd66-a3bf-49ca-98aa-112d3a48c84e tempest-GroupSnapshotsV319Test-1279547868 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-76f5b057-534e-4c66-8a0e-9e50be276af2.info" returned: 0 in 0.107s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:07:48 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-876afd66-a3bf-49ca-98aa-112d3a48c84e tempest-GroupSnapshotsV319Test-1279547868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.913s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:07:48 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-876afd66-a3bf-49ca-98aa-112d3a48c84e tempest-GroupSnapshotsV319Test-1279547868 None] group_snapshot a876f18a-dfc7-4a91-94ab-3238371fad72: created successfully Sep 10 21:07:50 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-0bdaa8ed-1e4a-4d49-bc03-c8cdd9886dc6 tempest-GroupSnapshotsV319Test-1279547868 None] group_snapshot a876f18a-dfc7-4a91-94ab-3238371fad72: deleting Sep 10 21:07:50 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-0bdaa8ed-1e4a-4d49-bc03-c8cdd9886dc6 tempest-GroupSnapshotsV319Test-1279547868 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:07:50 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0bdaa8ed-1e4a-4d49-bc03-c8cdd9886dc6 tempest-GroupSnapshotsV319Test-1279547868 None] group_snapshot a876f18a-dfc7-4a91-94ab-3238371fad72: deleting {{(pid=82780) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}} Sep 10 21:07:50 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-0bdaa8ed-1e4a-4d49-bc03-c8cdd9886dc6 tempest-GroupSnapshotsV319Test-1279547868 None] Acquiring lock "cinder-quobyte-76f5b057-534e-4c66-8a0e-9e50be276af2" by "delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:07:50 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-0bdaa8ed-1e4a-4d49-bc03-c8cdd9886dc6 tempest-GroupSnapshotsV319Test-1279547868 None] Lock "cinder-quobyte-76f5b057-534e-4c66-8a0e-9e50be276af2" acquired by "delete_snapshot" :: waited 0.076s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:07:50 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-0bdaa8ed-1e4a-4d49-bc03-c8cdd9886dc6 tempest-GroupSnapshotsV319Test-1279547868 None] Acquiring lock "cinder-quobyte-80b36227-15ef-4fc9-a8ea-8fe26c435b84" by "_delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:07:50 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-0bdaa8ed-1e4a-4d49-bc03-c8cdd9886dc6 tempest-GroupSnapshotsV319Test-1279547868 None] Lock "cinder-quobyte-80b36227-15ef-4fc9-a8ea-8fe26c435b84" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:07:50 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-0bdaa8ed-1e4a-4d49-bc03-c8cdd9886dc6 tempest-GroupSnapshotsV319Test-1279547868 None] Deleting offline snapshot 80b36227-15ef-4fc9-a8ea-8fe26c435b84 of volume 76f5b057-534e-4c66-8a0e-9e50be276af2 {{(pid=82780) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 21:07:50 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-0bdaa8ed-1e4a-4d49-bc03-c8cdd9886dc6 tempest-GroupSnapshotsV319Test-1279547868 None] snapshot_file for this snap is: volume-76f5b057-534e-4c66-8a0e-9e50be276af2.80b36227-15ef-4fc9-a8ea-8fe26c435b84 {{(pid=82780) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 21:07:50 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82c247e-30a4-47b4-83ee-62502b15966f]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:07:50 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0bdaa8ed-1e4a-4d49-bc03-c8cdd9886dc6 tempest-GroupSnapshotsV319Test-1279547868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-76f5b057-534e-4c66-8a0e-9e50be276af2.80b36227-15ef-4fc9-a8ea-8fe26c435b84 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:07:50 devstack quobyte-client[82807]: System call of process 86502 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:07:50 devstack quobyte-client[82807]: System call of process 86502 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:07:50 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0bdaa8ed-1e4a-4d49-bc03-c8cdd9886dc6 tempest-GroupSnapshotsV319Test-1279547868 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-76f5b057-534e-4c66-8a0e-9e50be276af2.80b36227-15ef-4fc9-a8ea-8fe26c435b84" returned: 0 in 0.557s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:07:50 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-0bdaa8ed-1e4a-4d49-bc03-c8cdd9886dc6 tempest-GroupSnapshotsV319Test-1279547868 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76f5b057-534e-4c66-8a0e-9e50be276af2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82780) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 21:07:51 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c50c27-14e6-4b96-86fb-e7bc8eedb73a]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:07:51 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0bdaa8ed-1e4a-4d49-bc03-c8cdd9886dc6 tempest-GroupSnapshotsV319Test-1279547868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-76f5b057-534e-4c66-8a0e-9e50be276af2 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:07:51 devstack quobyte-client[82807]: System call of process 86505 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:07:51 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0bdaa8ed-1e4a-4d49-bc03-c8cdd9886dc6 tempest-GroupSnapshotsV319Test-1279547868 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-76f5b057-534e-4c66-8a0e-9e50be276af2" returned: 0 in 0.537s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:07:51 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0bdaa8ed-1e4a-4d49-bc03-c8cdd9886dc6 tempest-GroupSnapshotsV319Test-1279547868 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-76f5b057-534e-4c66-8a0e-9e50be276af2.80b36227-15ef-4fc9-a8ea-8fe26c435b84 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:07:51 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0bdaa8ed-1e4a-4d49-bc03-c8cdd9886dc6 tempest-GroupSnapshotsV319Test-1279547868 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-76f5b057-534e-4c66-8a0e-9e50be276af2.80b36227-15ef-4fc9-a8ea-8fe26c435b84" returned: 0 in 0.245s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:07:51 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0bdaa8ed-1e4a-4d49-bc03-c8cdd9886dc6 tempest-GroupSnapshotsV319Test-1279547868 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-76f5b057-534e-4c66-8a0e-9e50be276af2.80b36227-15ef-4fc9-a8ea-8fe26c435b84 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:07:52 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0bdaa8ed-1e4a-4d49-bc03-c8cdd9886dc6 tempest-GroupSnapshotsV319Test-1279547868 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-76f5b057-534e-4c66-8a0e-9e50be276af2.80b36227-15ef-4fc9-a8ea-8fe26c435b84" returned: 0 in 0.160s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:07:52 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-0bdaa8ed-1e4a-4d49-bc03-c8cdd9886dc6 tempest-GroupSnapshotsV319Test-1279547868 None] Lock "cinder-quobyte-80b36227-15ef-4fc9-a8ea-8fe26c435b84" released by "_delete_snapshot" :: held 1.947s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:07:52 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-0bdaa8ed-1e4a-4d49-bc03-c8cdd9886dc6 tempest-GroupSnapshotsV319Test-1279547868 None] Lock "cinder-quobyte-76f5b057-534e-4c66-8a0e-9e50be276af2" released by "delete_snapshot" :: held 1.988s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:07:53 devstack cinder-volume[82780]: WARNING cinder.quota [None req-0bdaa8ed-1e4a-4d49-bc03-c8cdd9886dc6 tempest-GroupSnapshotsV319Test-1279547868 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-924745998 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-924745998, it is now deprecated. Please use the default quota class for default quota. Sep 10 21:07:53 devstack cinder-volume[82780]: WARNING cinder.quota [None req-0bdaa8ed-1e4a-4d49-bc03-c8cdd9886dc6 tempest-GroupSnapshotsV319Test-1279547868 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-924745998 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-924745998, it is now deprecated. Please use the default quota class for default quota. Sep 10 21:07:53 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-0bdaa8ed-1e4a-4d49-bc03-c8cdd9886dc6 tempest-GroupSnapshotsV319Test-1279547868 None] Created reservations ['27217b5e-7586-4547-947d-a61bea36ec4d', '2a43074d-e539-4750-90eb-c5b41a866e80', '6b9c98bb-6262-4394-8c29-a795480c57f7', 'b589dd07-c935-45d4-bcb3-20394b8896b8'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:07:53 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-0bdaa8ed-1e4a-4d49-bc03-c8cdd9886dc6 tempest-GroupSnapshotsV319Test-1279547868 None] group_snapshot a876f18a-dfc7-4a91-94ab-3238371fad72: deleted successfully Sep 10 21:07:54 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-f5e80286-e2cf-49dd-b209-f1b0964e4308 tempest-GroupSnapshotsV319Test-1279547868 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:07:54 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-f5e80286-e2cf-49dd-b209-f1b0964e4308 tempest-GroupSnapshotsV319Test-1279547868 None] Acquiring lock "cinder-quobyte-76f5b057-534e-4c66-8a0e-9e50be276af2" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:07:54 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-f5e80286-e2cf-49dd-b209-f1b0964e4308 tempest-GroupSnapshotsV319Test-1279547868 None] Lock "cinder-quobyte-76f5b057-534e-4c66-8a0e-9e50be276af2" acquired by "delete_volume" :: waited 0.079s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:07:54 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb5b1ff-225d-423c-9fd8-ab47cf88a38e]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:07:54 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f5e80286-e2cf-49dd-b209-f1b0964e4308 tempest-GroupSnapshotsV319Test-1279547868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-76f5b057-534e-4c66-8a0e-9e50be276af2 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:07:55 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f5e80286-e2cf-49dd-b209-f1b0964e4308 tempest-GroupSnapshotsV319Test-1279547868 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-76f5b057-534e-4c66-8a0e-9e50be276af2" returned: 0 in 0.968s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:07:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f5e80286-e2cf-49dd-b209-f1b0964e4308 tempest-GroupSnapshotsV319Test-1279547868 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-76f5b057-534e-4c66-8a0e-9e50be276af2 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:07:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f5e80286-e2cf-49dd-b209-f1b0964e4308 tempest-GroupSnapshotsV319Test-1279547868 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-76f5b057-534e-4c66-8a0e-9e50be276af2" returned: 0 in 0.258s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:07:56 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-f5e80286-e2cf-49dd-b209-f1b0964e4308 tempest-GroupSnapshotsV319Test-1279547868 None] Lock "cinder-quobyte-76f5b057-534e-4c66-8a0e-9e50be276af2" released by "delete_volume" :: held 1.753s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:07:56 devstack cinder-volume[82780]: DEBUG oslo_service.periodic_task [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82780) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 21:07:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:07:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:07:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:07:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:07:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:07:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:07:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.287s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:07:56 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:07:57 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-f5e80286-e2cf-49dd-b209-f1b0964e4308 tempest-GroupSnapshotsV319Test-1279547868 None] Created reservations ['0f306ae6-0df5-4b19-b9e7-f52cc7e25bbd'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:07:57 devstack cinder-volume[82780]: WARNING cinder.quota [None req-f5e80286-e2cf-49dd-b209-f1b0964e4308 tempest-GroupSnapshotsV319Test-1279547868 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-924745998 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-924745998, it is now deprecated. Please use the default quota class for default quota. Sep 10 21:07:57 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-f5e80286-e2cf-49dd-b209-f1b0964e4308 tempest-GroupSnapshotsV319Test-1279547868 None] Created reservations ['ec36be57-7956-4c34-92a2-3ff430a249a0', '651a4edb-d46f-4689-a2cd-243d955da36c', 'a3e31169-6c22-4a8f-8b28-af24b842fa22', 'd3d87119-7a70-4175-b043-89591e0b316d'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:07:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-f5e80286-e2cf-49dd-b209-f1b0964e4308 tempest-GroupSnapshotsV319Test-1279547868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:07:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-f5e80286-e2cf-49dd-b209-f1b0964e4308 tempest-GroupSnapshotsV319Test-1279547868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:07:57 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-f5e80286-e2cf-49dd-b209-f1b0964e4308 tempest-GroupSnapshotsV319Test-1279547868 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:07:57 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-f5e80286-e2cf-49dd-b209-f1b0964e4308 tempest-GroupSnapshotsV319Test-1279547868 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:07:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-f5e80286-e2cf-49dd-b209-f1b0964e4308 tempest-GroupSnapshotsV319Test-1279547868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:07:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f5e80286-e2cf-49dd-b209-f1b0964e4308 tempest-GroupSnapshotsV319Test-1279547868 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:07:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f5e80286-e2cf-49dd-b209-f1b0964e4308 tempest-GroupSnapshotsV319Test-1279547868 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.073s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:07:57 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-f5e80286-e2cf-49dd-b209-f1b0964e4308 tempest-GroupSnapshotsV319Test-1279547868 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:07:57 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-f5e80286-e2cf-49dd-b209-f1b0964e4308 tempest-GroupSnapshotsV319Test-1279547868 None] Delete group completed successfully. Sep 10 21:08:07 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=24,cinder:UPDATE=23,cinder:DELETE=1,cinder:INSERT=5 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:08:07 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=24,cinder:UPDATE=21,cinder:INSERT=4 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:08:16 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-6f3d7f95-03a8-4fda-8162-93a54485869e req-9a100afc-925b-442e-8a89-f881f9a4dace tempest-AttachVolumeShelveTestJSON-724512628 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:08:16 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-6f3d7f95-03a8-4fda-8162-93a54485869e req-9a100afc-925b-442e-8a89-f881f9a4dace tempest-AttachVolumeShelveTestJSON-724512628 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:08:16 devstack cinder-volume[82780]: INFO cinder.volume.manager [req-6f3d7f95-03a8-4fda-8162-93a54485869e req-9a100afc-925b-442e-8a89-f881f9a4dace tempest-AttachVolumeShelveTestJSON-724512628 None] Terminate volume connection completed successfully. Sep 10 21:08:16 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-6f3d7f95-03a8-4fda-8162-93a54485869e req-9a100afc-925b-442e-8a89-f881f9a4dace tempest-AttachVolumeShelveTestJSON-724512628 None] Deleting attachment 624ffe18-bef5-499c-aefa-d2e7f969ed07. {{(pid=82780) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 21:08:26 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=1 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:08:26 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=1 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:08:30 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-36034ead-9fc2-4964-97ee-9841c01ad0c2 tempest-VolumeRetypeWithoutMigrationTest-1534715399 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:08:30 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-36034ead-9fc2-4964-97ee-9841c01ad0c2 tempest-VolumeRetypeWithoutMigrationTest-1534715399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:08:31 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-36034ead-9fc2-4964-97ee-9841c01ad0c2 tempest-VolumeRetypeWithoutMigrationTest-1534715399 None] Flow 'volume_create_manager' (4161f915-11ff-480c-87db-576bb9608e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:08:31 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-36034ead-9fc2-4964-97ee-9841c01ad0c2 tempest-VolumeRetypeWithoutMigrationTest-1534715399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f063beaf-89f4-4215-9364-2849ccc8ee44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:08:31 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-36034ead-9fc2-4964-97ee-9841c01ad0c2 tempest-VolumeRetypeWithoutMigrationTest-1534715399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f063beaf-89f4-4215-9364-2849ccc8ee44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:08:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-65087656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a9c99fa-2e21-44ec-855a-7dd9b706c081,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a62a3056d7b445e681c4eb2b27ae47f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:08:31Z,use_quota=True,user_id='a036f0caf812467cad673850e8dbb5e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b65fe70c-170e-4fa4-9a44-ef9d20a93f89),volume_type_id=b65fe70c-170e-4fa4-9a44-ef9d20a93f89)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:08:31 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-36034ead-9fc2-4964-97ee-9841c01ad0c2 tempest-VolumeRetypeWithoutMigrationTest-1534715399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b347ff8-30ea-4661-a726-5dbf3f8256c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:08:31 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-36034ead-9fc2-4964-97ee-9841c01ad0c2 tempest-VolumeRetypeWithoutMigrationTest-1534715399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b347ff8-30ea-4661-a726-5dbf3f8256c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:08:31 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-36034ead-9fc2-4964-97ee-9841c01ad0c2 tempest-VolumeRetypeWithoutMigrationTest-1534715399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (989c9d46-3828-4be5-97e0-2cd1ab73642e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:08:31 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-36034ead-9fc2-4964-97ee-9841c01ad0c2 tempest-VolumeRetypeWithoutMigrationTest-1534715399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (989c9d46-3828-4be5-97e0-2cd1ab73642e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a9c99fa-2e21-44ec-855a-7dd9b706c081', 'volume_name': 'volume-9a9c99fa-2e21-44ec-855a-7dd9b706c081', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:08:31 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-36034ead-9fc2-4964-97ee-9841c01ad0c2 tempest-VolumeRetypeWithoutMigrationTest-1534715399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bba05d45-d42a-4445-972a-b0f8db964eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:08:31 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-36034ead-9fc2-4964-97ee-9841c01ad0c2 tempest-VolumeRetypeWithoutMigrationTest-1534715399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bba05d45-d42a-4445-972a-b0f8db964eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:08:31 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-36034ead-9fc2-4964-97ee-9841c01ad0c2 tempest-VolumeRetypeWithoutMigrationTest-1534715399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06326085-1cca-4f4d-84d2-107e78d0fc86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:08:31 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-36034ead-9fc2-4964-97ee-9841c01ad0c2 tempest-VolumeRetypeWithoutMigrationTest-1534715399 None] Volume 9a9c99fa-2e21-44ec-855a-7dd9b706c081: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a9c99fa-2e21-44ec-855a-7dd9b706c081', 'volume_size': 1} Sep 10 21:08:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-36034ead-9fc2-4964-97ee-9841c01ad0c2 tempest-VolumeRetypeWithoutMigrationTest-1534715399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:08:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-36034ead-9fc2-4964-97ee-9841c01ad0c2 tempest-VolumeRetypeWithoutMigrationTest-1534715399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:08:31 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-36034ead-9fc2-4964-97ee-9841c01ad0c2 tempest-VolumeRetypeWithoutMigrationTest-1534715399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:08:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-65087656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a9c99fa-2e21-44ec-855a-7dd9b706c081,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a62a3056d7b445e681c4eb2b27ae47f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:08:31Z,use_quota=True,user_id='a036f0caf812467cad673850e8dbb5e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b65fe70c-170e-4fa4-9a44-ef9d20a93f89),volume_type_id=b65fe70c-170e-4fa4-9a44-ef9d20a93f89)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:08:31 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-36034ead-9fc2-4964-97ee-9841c01ad0c2 tempest-VolumeRetypeWithoutMigrationTest-1534715399 None] Creating volume 9a9c99fa-2e21-44ec-855a-7dd9b706c081 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:08:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-36034ead-9fc2-4964-97ee-9841c01ad0c2 tempest-VolumeRetypeWithoutMigrationTest-1534715399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:08:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-36034ead-9fc2-4964-97ee-9841c01ad0c2 tempest-VolumeRetypeWithoutMigrationTest-1534715399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:08:31 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-36034ead-9fc2-4964-97ee-9841c01ad0c2 tempest-VolumeRetypeWithoutMigrationTest-1534715399 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:08:31 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-36034ead-9fc2-4964-97ee-9841c01ad0c2 tempest-VolumeRetypeWithoutMigrationTest-1534715399 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:08:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-36034ead-9fc2-4964-97ee-9841c01ad0c2 tempest-VolumeRetypeWithoutMigrationTest-1534715399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:08:31 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-36034ead-9fc2-4964-97ee-9841c01ad0c2 tempest-VolumeRetypeWithoutMigrationTest-1534715399 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:08:31 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-36034ead-9fc2-4964-97ee-9841c01ad0c2 tempest-VolumeRetypeWithoutMigrationTest-1534715399 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:08:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-36034ead-9fc2-4964-97ee-9841c01ad0c2 tempest-VolumeRetypeWithoutMigrationTest-1534715399 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-9a9c99fa-2e21-44ec-855a-7dd9b706c081 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:08:31 devstack quobyte-client[82807]: System call of process 86672 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:08:31 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=14, name=volume-9a9c99fa-2e21-44ec-855a-7dd9b706c081, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:08:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-36034ead-9fc2-4964-97ee-9841c01ad0c2 tempest-VolumeRetypeWithoutMigrationTest-1534715399 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-9a9c99fa-2e21-44ec-855a-7dd9b706c081 1073741824" returned: 0 in 0.566s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:08:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-36034ead-9fc2-4964-97ee-9841c01ad0c2 tempest-VolumeRetypeWithoutMigrationTest-1534715399 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-9a9c99fa-2e21-44ec-855a-7dd9b706c081 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:08:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-36034ead-9fc2-4964-97ee-9841c01ad0c2 tempest-VolumeRetypeWithoutMigrationTest-1534715399 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-9a9c99fa-2e21-44ec-855a-7dd9b706c081" returned: 0 in 0.179s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:08:32 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-36034ead-9fc2-4964-97ee-9841c01ad0c2 tempest-VolumeRetypeWithoutMigrationTest-1534715399 None] <== create_volume: return (829ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:08:32 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-36034ead-9fc2-4964-97ee-9841c01ad0c2 tempest-VolumeRetypeWithoutMigrationTest-1534715399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:08:32 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-36034ead-9fc2-4964-97ee-9841c01ad0c2 tempest-VolumeRetypeWithoutMigrationTest-1534715399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06326085-1cca-4f4d-84d2-107e78d0fc86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a9c99fa-2e21-44ec-855a-7dd9b706c081', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:08:32 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-36034ead-9fc2-4964-97ee-9841c01ad0c2 tempest-VolumeRetypeWithoutMigrationTest-1534715399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d3d31d8-4bed-41e0-bc2e-d38139e20820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:08:32 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-36034ead-9fc2-4964-97ee-9841c01ad0c2 tempest-VolumeRetypeWithoutMigrationTest-1534715399 None] Volume volume-9a9c99fa-2e21-44ec-855a-7dd9b706c081 (9a9c99fa-2e21-44ec-855a-7dd9b706c081): created successfully Sep 10 21:08:32 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-36034ead-9fc2-4964-97ee-9841c01ad0c2 tempest-VolumeRetypeWithoutMigrationTest-1534715399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d3d31d8-4bed-41e0-bc2e-d38139e20820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:08:32 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-36034ead-9fc2-4964-97ee-9841c01ad0c2 tempest-VolumeRetypeWithoutMigrationTest-1534715399 None] Flow 'volume_create_manager' (4161f915-11ff-480c-87db-576bb9608e61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:08:32 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-36034ead-9fc2-4964-97ee-9841c01ad0c2 tempest-VolumeRetypeWithoutMigrationTest-1534715399 None] Created volume successfully. Sep 10 21:08:34 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-3f5d82dc-36ed-434e-874c-8d7c2c267415 tempest-VolumeRetypeWithoutMigrationTest-1534715399 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:08:34 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-3f5d82dc-36ed-434e-874c-8d7c2c267415 tempest-VolumeRetypeWithoutMigrationTest-1534715399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:08:34 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-3f5d82dc-36ed-434e-874c-8d7c2c267415 tempest-VolumeRetypeWithoutMigrationTest-1534715399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:08:34 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-3f5d82dc-36ed-434e-874c-8d7c2c267415 tempest-VolumeRetypeWithoutMigrationTest-1534715399 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:08:34 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-3f5d82dc-36ed-434e-874c-8d7c2c267415 tempest-VolumeRetypeWithoutMigrationTest-1534715399 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:08:34 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-3f5d82dc-36ed-434e-874c-8d7c2c267415 tempest-VolumeRetypeWithoutMigrationTest-1534715399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:08:34 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-3f5d82dc-36ed-434e-874c-8d7c2c267415 tempest-VolumeRetypeWithoutMigrationTest-1534715399 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:08:35 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-3f5d82dc-36ed-434e-874c-8d7c2c267415 tempest-VolumeRetypeWithoutMigrationTest-1534715399 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.326s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:08:35 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-3f5d82dc-36ed-434e-874c-8d7c2c267415 tempest-VolumeRetypeWithoutMigrationTest-1534715399 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:08:35 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-3f5d82dc-36ed-434e-874c-8d7c2c267415 tempest-VolumeRetypeWithoutMigrationTest-1534715399 None] Retype volume completed successfully. Sep 10 21:08:36 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-0457e428-ecd1-494b-bf5a-b382cf3c0f4b tempest-VolumeRetypeWithoutMigrationTest-1534715399 None] Acquiring lock "cinder-9a9c99fa-2e21-44ec-855a-7dd9b706c081-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:08:36 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-0457e428-ecd1-494b-bf5a-b382cf3c0f4b tempest-VolumeRetypeWithoutMigrationTest-1534715399 None] Lock "cinder-9a9c99fa-2e21-44ec-855a-7dd9b706c081-delete_volume" acquired by "delete_volume" :: waited 0.121s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:08:36 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-0457e428-ecd1-494b-bf5a-b382cf3c0f4b tempest-VolumeRetypeWithoutMigrationTest-1534715399 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:08:36 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-0457e428-ecd1-494b-bf5a-b382cf3c0f4b tempest-VolumeRetypeWithoutMigrationTest-1534715399 None] Acquiring lock "cinder-quobyte-9a9c99fa-2e21-44ec-855a-7dd9b706c081" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:08:36 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-0457e428-ecd1-494b-bf5a-b382cf3c0f4b tempest-VolumeRetypeWithoutMigrationTest-1534715399 None] Lock "cinder-quobyte-9a9c99fa-2e21-44ec-855a-7dd9b706c081" acquired by "delete_volume" :: waited 0.060s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:08:36 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[92846659-5563-412f-9351-db5587245ec8]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:08:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0457e428-ecd1-494b-bf5a-b382cf3c0f4b tempest-VolumeRetypeWithoutMigrationTest-1534715399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-9a9c99fa-2e21-44ec-855a-7dd9b706c081 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:08:37 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0457e428-ecd1-494b-bf5a-b382cf3c0f4b tempest-VolumeRetypeWithoutMigrationTest-1534715399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-9a9c99fa-2e21-44ec-855a-7dd9b706c081" returned: 0 in 0.681s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:08:37 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0457e428-ecd1-494b-bf5a-b382cf3c0f4b tempest-VolumeRetypeWithoutMigrationTest-1534715399 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-9a9c99fa-2e21-44ec-855a-7dd9b706c081 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:08:37 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0457e428-ecd1-494b-bf5a-b382cf3c0f4b tempest-VolumeRetypeWithoutMigrationTest-1534715399 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-9a9c99fa-2e21-44ec-855a-7dd9b706c081" returned: 0 in 0.129s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:08:37 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-0457e428-ecd1-494b-bf5a-b382cf3c0f4b tempest-VolumeRetypeWithoutMigrationTest-1534715399 None] Lock "cinder-quobyte-9a9c99fa-2e21-44ec-855a-7dd9b706c081" released by "delete_volume" :: held 1.140s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:08:38 devstack cinder-volume[82780]: WARNING cinder.quota [None req-0457e428-ecd1-494b-bf5a-b382cf3c0f4b tempest-VolumeRetypeWithoutMigrationTest-1534715399 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 10 21:08:38 devstack cinder-volume[82780]: WARNING cinder.quota [None req-0457e428-ecd1-494b-bf5a-b382cf3c0f4b tempest-VolumeRetypeWithoutMigrationTest-1534715399 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 10 21:08:38 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-0457e428-ecd1-494b-bf5a-b382cf3c0f4b tempest-VolumeRetypeWithoutMigrationTest-1534715399 None] Created reservations ['363ae121-4b0b-4027-b6e8-fc86532f1c03', 'b23deb25-f48b-49fa-8c2a-53f5371da5f6', '6cb4da23-0fbb-4e2f-83d7-73a9ddf6a4e6', 'fdb79fcb-1edc-44ff-9c1f-f10e5a2492bc'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:08:38 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-0457e428-ecd1-494b-bf5a-b382cf3c0f4b tempest-VolumeRetypeWithoutMigrationTest-1534715399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:08:38 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-0457e428-ecd1-494b-bf5a-b382cf3c0f4b tempest-VolumeRetypeWithoutMigrationTest-1534715399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:08:38 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-0457e428-ecd1-494b-bf5a-b382cf3c0f4b tempest-VolumeRetypeWithoutMigrationTest-1534715399 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:08:38 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-0457e428-ecd1-494b-bf5a-b382cf3c0f4b tempest-VolumeRetypeWithoutMigrationTest-1534715399 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:08:38 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-0457e428-ecd1-494b-bf5a-b382cf3c0f4b tempest-VolumeRetypeWithoutMigrationTest-1534715399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:08:38 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0457e428-ecd1-494b-bf5a-b382cf3c0f4b tempest-VolumeRetypeWithoutMigrationTest-1534715399 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:08:38 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0457e428-ecd1-494b-bf5a-b382cf3c0f4b tempest-VolumeRetypeWithoutMigrationTest-1534715399 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.148s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:08:38 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-0457e428-ecd1-494b-bf5a-b382cf3c0f4b tempest-VolumeRetypeWithoutMigrationTest-1534715399 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:08:38 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-0457e428-ecd1-494b-bf5a-b382cf3c0f4b tempest-VolumeRetypeWithoutMigrationTest-1534715399 None] Deleted volume successfully. Sep 10 21:08:38 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-0457e428-ecd1-494b-bf5a-b382cf3c0f4b tempest-VolumeRetypeWithoutMigrationTest-1534715399 None] Lock "cinder-9a9c99fa-2e21-44ec-855a-7dd9b706c081-delete_volume" released by "delete_volume" :: held 2.627s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:08:39 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-bcea9e04-c16d-4cee-a2a4-fc7126185733 req-759e9bef-0bb1-4456-81a6-68ba898840d9 tempest-TaggedAttachmentsTest-1829613531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:08:39 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-bcea9e04-c16d-4cee-a2a4-fc7126185733 req-759e9bef-0bb1-4456-81a6-68ba898840d9 tempest-TaggedAttachmentsTest-1829613531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:08:39 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac14e28-2f1e-4af9-95a4-1adfc645156f]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:08:39 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-bcea9e04-c16d-4cee-a2a4-fc7126185733 req-759e9bef-0bb1-4456-81a6-68ba898840d9 tempest-TaggedAttachmentsTest-1829613531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-385526ea-b39f-4919-b353-56e7f269b8e2 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:08:40 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-bcea9e04-c16d-4cee-a2a4-fc7126185733 req-759e9bef-0bb1-4456-81a6-68ba898840d9 tempest-TaggedAttachmentsTest-1829613531 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-385526ea-b39f-4919-b353-56e7f269b8e2" returned: 0 in 0.549s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:08:40 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-bcea9e04-c16d-4cee-a2a4-fc7126185733 req-759e9bef-0bb1-4456-81a6-68ba898840d9 tempest-TaggedAttachmentsTest-1829613531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.634s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:08:40 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-bcea9e04-c16d-4cee-a2a4-fc7126185733 req-759e9bef-0bb1-4456-81a6-68ba898840d9 tempest-TaggedAttachmentsTest-1829613531 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b', 'name': 'volume-385526ea-b39f-4919-b353-56e7f269b8e2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4d95da15-30f7-4f86-82c7-c17e021875a7', 'enforce_multipath': True} {{(pid=82780) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 21:08:40 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-bcea9e04-c16d-4cee-a2a4-fc7126185733 req-759e9bef-0bb1-4456-81a6-68ba898840d9 tempest-TaggedAttachmentsTest-1829613531 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:08:40 devstack cinder-volume[82780]: INFO cinder.volume.manager [req-bcea9e04-c16d-4cee-a2a4-fc7126185733 req-759e9bef-0bb1-4456-81a6-68ba898840d9 tempest-TaggedAttachmentsTest-1829613531 None] attachment_update completed successfully. Sep 10 21:08:46 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-fc1d2f3b-c7e6-4eed-a4f3-0db550b98bd0 tempest-VolumeTypesAccessTest-2000117538 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:08:46 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc1d2f3b-c7e6-4eed-a4f3-0db550b98bd0 tempest-VolumeTypesAccessTest-2000117538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:08:46 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fc1d2f3b-c7e6-4eed-a4f3-0db550b98bd0 tempest-VolumeTypesAccessTest-2000117538 None] Flow 'volume_create_manager' (562a4bb7-dfb2-48a0-9f1c-ce292838f082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:08:46 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fc1d2f3b-c7e6-4eed-a4f3-0db550b98bd0 tempest-VolumeTypesAccessTest-2000117538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fcea93c-c0a2-4f8f-8415-17e08af2e6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:08:46 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fc1d2f3b-c7e6-4eed-a4f3-0db550b98bd0 tempest-VolumeTypesAccessTest-2000117538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fcea93c-c0a2-4f8f-8415-17e08af2e6df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:08:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1281583557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fec144ad-6b40-4f2d-b8e4-9669df3d5e22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9850aba73c2946789968dbbda9ac7ff5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:08:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:08:46Z,use_quota=True,user_id='141eca7143184549a08ab2b409e870aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(128ed6c9-905a-4903-b10f-106c731c948e),volume_type_id=128ed6c9-905a-4903-b10f-106c731c948e)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:08:46 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fc1d2f3b-c7e6-4eed-a4f3-0db550b98bd0 tempest-VolumeTypesAccessTest-2000117538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (759614e6-9724-4164-af94-410fa413dac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:08:46 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fc1d2f3b-c7e6-4eed-a4f3-0db550b98bd0 tempest-VolumeTypesAccessTest-2000117538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (759614e6-9724-4164-af94-410fa413dac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:08:46 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fc1d2f3b-c7e6-4eed-a4f3-0db550b98bd0 tempest-VolumeTypesAccessTest-2000117538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1567c1ca-bc57-46c0-b81a-9983ebbd1eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:08:46 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fc1d2f3b-c7e6-4eed-a4f3-0db550b98bd0 tempest-VolumeTypesAccessTest-2000117538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1567c1ca-bc57-46c0-b81a-9983ebbd1eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fec144ad-6b40-4f2d-b8e4-9669df3d5e22', 'volume_name': 'volume-fec144ad-6b40-4f2d-b8e4-9669df3d5e22', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:08:46 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fc1d2f3b-c7e6-4eed-a4f3-0db550b98bd0 tempest-VolumeTypesAccessTest-2000117538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (257ea5ad-8e63-483a-8989-72e513979a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:08:46 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fc1d2f3b-c7e6-4eed-a4f3-0db550b98bd0 tempest-VolumeTypesAccessTest-2000117538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (257ea5ad-8e63-483a-8989-72e513979a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:08:46 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fc1d2f3b-c7e6-4eed-a4f3-0db550b98bd0 tempest-VolumeTypesAccessTest-2000117538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01faf9e9-4d64-42b7-a833-8a9f8b5ebf1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:08:46 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-fc1d2f3b-c7e6-4eed-a4f3-0db550b98bd0 tempest-VolumeTypesAccessTest-2000117538 None] Volume fec144ad-6b40-4f2d-b8e4-9669df3d5e22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fec144ad-6b40-4f2d-b8e4-9669df3d5e22', 'volume_size': 1} Sep 10 21:08:46 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-fc1d2f3b-c7e6-4eed-a4f3-0db550b98bd0 tempest-VolumeTypesAccessTest-2000117538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:08:46 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-fc1d2f3b-c7e6-4eed-a4f3-0db550b98bd0 tempest-VolumeTypesAccessTest-2000117538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:08:46 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-fc1d2f3b-c7e6-4eed-a4f3-0db550b98bd0 tempest-VolumeTypesAccessTest-2000117538 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:08:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1281583557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fec144ad-6b40-4f2d-b8e4-9669df3d5e22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9850aba73c2946789968dbbda9ac7ff5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:08:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:08:46Z,use_quota=True,user_id='141eca7143184549a08ab2b409e870aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(128ed6c9-905a-4903-b10f-106c731c948e),volume_type_id=128ed6c9-905a-4903-b10f-106c731c948e)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:08:46 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-fc1d2f3b-c7e6-4eed-a4f3-0db550b98bd0 tempest-VolumeTypesAccessTest-2000117538 None] Creating volume fec144ad-6b40-4f2d-b8e4-9669df3d5e22 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:08:46 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-fc1d2f3b-c7e6-4eed-a4f3-0db550b98bd0 tempest-VolumeTypesAccessTest-2000117538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:08:46 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-fc1d2f3b-c7e6-4eed-a4f3-0db550b98bd0 tempest-VolumeTypesAccessTest-2000117538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:08:46 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-fc1d2f3b-c7e6-4eed-a4f3-0db550b98bd0 tempest-VolumeTypesAccessTest-2000117538 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:08:46 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-fc1d2f3b-c7e6-4eed-a4f3-0db550b98bd0 tempest-VolumeTypesAccessTest-2000117538 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:08:46 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-fc1d2f3b-c7e6-4eed-a4f3-0db550b98bd0 tempest-VolumeTypesAccessTest-2000117538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:08:46 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-fc1d2f3b-c7e6-4eed-a4f3-0db550b98bd0 tempest-VolumeTypesAccessTest-2000117538 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:08:46 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-fc1d2f3b-c7e6-4eed-a4f3-0db550b98bd0 tempest-VolumeTypesAccessTest-2000117538 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:08:46 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-fc1d2f3b-c7e6-4eed-a4f3-0db550b98bd0 tempest-VolumeTypesAccessTest-2000117538 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-fec144ad-6b40-4f2d-b8e4-9669df3d5e22 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:08:46 devstack quobyte-client[82807]: System call of process 87125 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:08:46 devstack quobyte-client[82807]: System call of process 87125 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:08:46 devstack quobyte-client[82807]: System call of process 87125 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:08:46 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=15, name=volume-fec144ad-6b40-4f2d-b8e4-9669df3d5e22, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:08:47 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-fc1d2f3b-c7e6-4eed-a4f3-0db550b98bd0 tempest-VolumeTypesAccessTest-2000117538 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-fec144ad-6b40-4f2d-b8e4-9669df3d5e22 1073741824" returned: 0 in 0.407s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:08:47 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-fc1d2f3b-c7e6-4eed-a4f3-0db550b98bd0 tempest-VolumeTypesAccessTest-2000117538 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-fec144ad-6b40-4f2d-b8e4-9669df3d5e22 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:08:47 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-fc1d2f3b-c7e6-4eed-a4f3-0db550b98bd0 tempest-VolumeTypesAccessTest-2000117538 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-fec144ad-6b40-4f2d-b8e4-9669df3d5e22" returned: 0 in 0.085s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:08:47 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-fc1d2f3b-c7e6-4eed-a4f3-0db550b98bd0 tempest-VolumeTypesAccessTest-2000117538 None] <== create_volume: return (608ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:08:47 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-fc1d2f3b-c7e6-4eed-a4f3-0db550b98bd0 tempest-VolumeTypesAccessTest-2000117538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.622s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:08:47 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fc1d2f3b-c7e6-4eed-a4f3-0db550b98bd0 tempest-VolumeTypesAccessTest-2000117538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01faf9e9-4d64-42b7-a833-8a9f8b5ebf1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fec144ad-6b40-4f2d-b8e4-9669df3d5e22', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:08:47 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fc1d2f3b-c7e6-4eed-a4f3-0db550b98bd0 tempest-VolumeTypesAccessTest-2000117538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16a616aa-a26d-4f61-8c53-b5b43dec2add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:08:47 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-fc1d2f3b-c7e6-4eed-a4f3-0db550b98bd0 tempest-VolumeTypesAccessTest-2000117538 None] Volume volume-fec144ad-6b40-4f2d-b8e4-9669df3d5e22 (fec144ad-6b40-4f2d-b8e4-9669df3d5e22): created successfully Sep 10 21:08:47 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fc1d2f3b-c7e6-4eed-a4f3-0db550b98bd0 tempest-VolumeTypesAccessTest-2000117538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16a616aa-a26d-4f61-8c53-b5b43dec2add) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:08:47 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fc1d2f3b-c7e6-4eed-a4f3-0db550b98bd0 tempest-VolumeTypesAccessTest-2000117538 None] Flow 'volume_create_manager' (562a4bb7-dfb2-48a0-9f1c-ce292838f082) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:08:47 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-fc1d2f3b-c7e6-4eed-a4f3-0db550b98bd0 tempest-VolumeTypesAccessTest-2000117538 None] Created volume successfully. Sep 10 21:08:49 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-7f3ef5f2-81bb-43ef-9836-5224885cd74b tempest-VolumeTypesAccessTest-2000117538 None] Acquiring lock "cinder-fec144ad-6b40-4f2d-b8e4-9669df3d5e22-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:08:49 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-7f3ef5f2-81bb-43ef-9836-5224885cd74b tempest-VolumeTypesAccessTest-2000117538 None] Lock "cinder-fec144ad-6b40-4f2d-b8e4-9669df3d5e22-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:08:49 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-7f3ef5f2-81bb-43ef-9836-5224885cd74b tempest-VolumeTypesAccessTest-2000117538 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:08:49 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-7f3ef5f2-81bb-43ef-9836-5224885cd74b tempest-VolumeTypesAccessTest-2000117538 None] Acquiring lock "cinder-quobyte-fec144ad-6b40-4f2d-b8e4-9669df3d5e22" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:08:49 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-7f3ef5f2-81bb-43ef-9836-5224885cd74b tempest-VolumeTypesAccessTest-2000117538 None] Lock "cinder-quobyte-fec144ad-6b40-4f2d-b8e4-9669df3d5e22" acquired by "delete_volume" :: waited 0.013s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:08:49 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6fb5848-4ffd-4036-a6d3-23afb77f5f27]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:08:49 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-7f3ef5f2-81bb-43ef-9836-5224885cd74b tempest-VolumeTypesAccessTest-2000117538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-fec144ad-6b40-4f2d-b8e4-9669df3d5e22 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:08:49 devstack quobyte-client[82807]: System call of process 87139 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:08:50 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-7f3ef5f2-81bb-43ef-9836-5224885cd74b tempest-VolumeTypesAccessTest-2000117538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-fec144ad-6b40-4f2d-b8e4-9669df3d5e22" returned: 0 in 0.770s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:08:50 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-7f3ef5f2-81bb-43ef-9836-5224885cd74b tempest-VolumeTypesAccessTest-2000117538 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-fec144ad-6b40-4f2d-b8e4-9669df3d5e22 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:08:50 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-7f3ef5f2-81bb-43ef-9836-5224885cd74b tempest-VolumeTypesAccessTest-2000117538 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-fec144ad-6b40-4f2d-b8e4-9669df3d5e22" returned: 0 in 0.156s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:08:50 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-7f3ef5f2-81bb-43ef-9836-5224885cd74b tempest-VolumeTypesAccessTest-2000117538 None] Lock "cinder-quobyte-fec144ad-6b40-4f2d-b8e4-9669df3d5e22" released by "delete_volume" :: held 1.239s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:08:50 devstack cinder-volume[82780]: WARNING cinder.quota [None req-7f3ef5f2-81bb-43ef-9836-5224885cd74b tempest-VolumeTypesAccessTest-2000117538 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-172703846 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-172703846, it is now deprecated. Please use the default quota class for default quota. Sep 10 21:08:50 devstack cinder-volume[82780]: WARNING cinder.quota [None req-7f3ef5f2-81bb-43ef-9836-5224885cd74b tempest-VolumeTypesAccessTest-2000117538 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-172703846 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-172703846, it is now deprecated. Please use the default quota class for default quota. Sep 10 21:08:51 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-7f3ef5f2-81bb-43ef-9836-5224885cd74b tempest-VolumeTypesAccessTest-2000117538 None] Created reservations ['6ae496dc-301c-4bfb-af2b-141a71213c71', 'e4d14adc-00a9-4094-a531-01e368022edb', '4a74df64-b2bc-4a74-909f-7a05b3edacb5', '399ce615-15ed-416d-9437-463a1ca5cd3f'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:08:51 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-7f3ef5f2-81bb-43ef-9836-5224885cd74b tempest-VolumeTypesAccessTest-2000117538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:08:51 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-7f3ef5f2-81bb-43ef-9836-5224885cd74b tempest-VolumeTypesAccessTest-2000117538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:08:51 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-7f3ef5f2-81bb-43ef-9836-5224885cd74b tempest-VolumeTypesAccessTest-2000117538 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:08:51 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-7f3ef5f2-81bb-43ef-9836-5224885cd74b tempest-VolumeTypesAccessTest-2000117538 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:08:51 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-7f3ef5f2-81bb-43ef-9836-5224885cd74b tempest-VolumeTypesAccessTest-2000117538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:08:51 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-7f3ef5f2-81bb-43ef-9836-5224885cd74b tempest-VolumeTypesAccessTest-2000117538 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:08:51 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-7f3ef5f2-81bb-43ef-9836-5224885cd74b tempest-VolumeTypesAccessTest-2000117538 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.169s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:08:51 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-7f3ef5f2-81bb-43ef-9836-5224885cd74b tempest-VolumeTypesAccessTest-2000117538 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:08:51 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-7f3ef5f2-81bb-43ef-9836-5224885cd74b tempest-VolumeTypesAccessTest-2000117538 None] Deleted volume successfully. Sep 10 21:08:51 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-7f3ef5f2-81bb-43ef-9836-5224885cd74b tempest-VolumeTypesAccessTest-2000117538 None] Lock "cinder-fec144ad-6b40-4f2d-b8e4-9669df3d5e22-delete_volume" released by "delete_volume" :: held 2.801s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:08:56 devstack cinder-volume[82780]: DEBUG oslo_service.periodic_task [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82780) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 21:08:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:08:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:08:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:08:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:08:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:08:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:08:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.112s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:08:56 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:09:01 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=30,cinder:UPDATE=32,cinder:INSERT=5 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:09:01 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:UPDATE=20,cinder:DELETE=4,cinder:SELECT=19,cinder:INSERT=3 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:09:03 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-0df1b841-1f9e-4967-9970-74aad53d73cb tempest-VolumesListAdminTestJSON-402587183 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:09:03 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-0df1b841-1f9e-4967-9970-74aad53d73cb tempest-VolumesListAdminTestJSON-402587183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:09:03 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0df1b841-1f9e-4967-9970-74aad53d73cb tempest-VolumesListAdminTestJSON-402587183 None] Flow 'volume_create_manager' (d500fa87-2774-459b-ad1a-e9c5c5b64a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:09:03 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0df1b841-1f9e-4967-9970-74aad53d73cb tempest-VolumesListAdminTestJSON-402587183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9061d5bb-c96f-485b-94c3-360edcdab80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:09:03 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0df1b841-1f9e-4967-9970-74aad53d73cb tempest-VolumesListAdminTestJSON-402587183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9061d5bb-c96f-485b-94c3-360edcdab80e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:09:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-888003789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=323fbd06-a222-4825-9d81-7e5e55116c09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1642a6e7af4846b187017302d3e671df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:09:03Z,use_quota=True,user_id='886bbf59356e46d295bf7570c387a008',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:09:03 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0df1b841-1f9e-4967-9970-74aad53d73cb tempest-VolumesListAdminTestJSON-402587183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f90326f1-c5ef-4e1b-8989-a8fb669e8860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:09:03 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0df1b841-1f9e-4967-9970-74aad53d73cb tempest-VolumesListAdminTestJSON-402587183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f90326f1-c5ef-4e1b-8989-a8fb669e8860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:09:03 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0df1b841-1f9e-4967-9970-74aad53d73cb tempest-VolumesListAdminTestJSON-402587183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0130cc72-a5ed-47da-b1b6-ebcee1d46f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:09:03 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0df1b841-1f9e-4967-9970-74aad53d73cb tempest-VolumesListAdminTestJSON-402587183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0130cc72-a5ed-47da-b1b6-ebcee1d46f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '323fbd06-a222-4825-9d81-7e5e55116c09', 'volume_name': 'volume-323fbd06-a222-4825-9d81-7e5e55116c09', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:09:03 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0df1b841-1f9e-4967-9970-74aad53d73cb tempest-VolumesListAdminTestJSON-402587183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae7003d9-6d6e-4520-aa73-e7c644a1a601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:09:03 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0df1b841-1f9e-4967-9970-74aad53d73cb tempest-VolumesListAdminTestJSON-402587183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae7003d9-6d6e-4520-aa73-e7c644a1a601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:09:03 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0df1b841-1f9e-4967-9970-74aad53d73cb tempest-VolumesListAdminTestJSON-402587183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9626b41-99bb-474e-b23c-b81121c3001a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:09:03 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-0df1b841-1f9e-4967-9970-74aad53d73cb tempest-VolumesListAdminTestJSON-402587183 None] Volume 323fbd06-a222-4825-9d81-7e5e55116c09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-323fbd06-a222-4825-9d81-7e5e55116c09', 'volume_size': 1} Sep 10 21:09:03 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-0df1b841-1f9e-4967-9970-74aad53d73cb tempest-VolumesListAdminTestJSON-402587183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:09:03 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-0df1b841-1f9e-4967-9970-74aad53d73cb tempest-VolumesListAdminTestJSON-402587183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:09:03 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-0df1b841-1f9e-4967-9970-74aad53d73cb tempest-VolumesListAdminTestJSON-402587183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:09:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-888003789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=323fbd06-a222-4825-9d81-7e5e55116c09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1642a6e7af4846b187017302d3e671df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:09:03Z,use_quota=True,user_id='886bbf59356e46d295bf7570c387a008',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:09:03 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-0df1b841-1f9e-4967-9970-74aad53d73cb tempest-VolumesListAdminTestJSON-402587183 None] Creating volume 323fbd06-a222-4825-9d81-7e5e55116c09 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:09:03 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-0df1b841-1f9e-4967-9970-74aad53d73cb tempest-VolumesListAdminTestJSON-402587183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:09:03 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-0df1b841-1f9e-4967-9970-74aad53d73cb tempest-VolumesListAdminTestJSON-402587183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:09:03 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-0df1b841-1f9e-4967-9970-74aad53d73cb tempest-VolumesListAdminTestJSON-402587183 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:09:03 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-0df1b841-1f9e-4967-9970-74aad53d73cb tempest-VolumesListAdminTestJSON-402587183 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:09:03 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-0df1b841-1f9e-4967-9970-74aad53d73cb tempest-VolumesListAdminTestJSON-402587183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:09:03 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-0df1b841-1f9e-4967-9970-74aad53d73cb tempest-VolumesListAdminTestJSON-402587183 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:09:03 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-0df1b841-1f9e-4967-9970-74aad53d73cb tempest-VolumesListAdminTestJSON-402587183 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:09:03 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0df1b841-1f9e-4967-9970-74aad53d73cb tempest-VolumesListAdminTestJSON-402587183 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-323fbd06-a222-4825-9d81-7e5e55116c09 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:09:03 devstack quobyte-client[82807]: System call of process 87271 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:09:03 devstack quobyte-client[82807]: System call of process 87271 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:09:03 devstack quobyte-client[82807]: System call of process 87271 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:09:03 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=16, name=volume-323fbd06-a222-4825-9d81-7e5e55116c09, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:09:03 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0df1b841-1f9e-4967-9970-74aad53d73cb tempest-VolumesListAdminTestJSON-402587183 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-323fbd06-a222-4825-9d81-7e5e55116c09 1073741824" returned: 0 in 0.338s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:09:03 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0df1b841-1f9e-4967-9970-74aad53d73cb tempest-VolumesListAdminTestJSON-402587183 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-323fbd06-a222-4825-9d81-7e5e55116c09 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:09:04 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0df1b841-1f9e-4967-9970-74aad53d73cb tempest-VolumesListAdminTestJSON-402587183 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-323fbd06-a222-4825-9d81-7e5e55116c09" returned: 0 in 0.116s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:09:04 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-0df1b841-1f9e-4967-9970-74aad53d73cb tempest-VolumesListAdminTestJSON-402587183 None] <== create_volume: return (536ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:09:04 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-0df1b841-1f9e-4967-9970-74aad53d73cb tempest-VolumesListAdminTestJSON-402587183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.556s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:09:04 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0df1b841-1f9e-4967-9970-74aad53d73cb tempest-VolumesListAdminTestJSON-402587183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9626b41-99bb-474e-b23c-b81121c3001a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-323fbd06-a222-4825-9d81-7e5e55116c09', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:09:04 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0df1b841-1f9e-4967-9970-74aad53d73cb tempest-VolumesListAdminTestJSON-402587183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65646a5e-2366-479c-8d83-b1678b206290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:09:04 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-0df1b841-1f9e-4967-9970-74aad53d73cb tempest-VolumesListAdminTestJSON-402587183 None] Volume volume-323fbd06-a222-4825-9d81-7e5e55116c09 (323fbd06-a222-4825-9d81-7e5e55116c09): created successfully Sep 10 21:09:04 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0df1b841-1f9e-4967-9970-74aad53d73cb tempest-VolumesListAdminTestJSON-402587183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65646a5e-2366-479c-8d83-b1678b206290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:09:04 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0df1b841-1f9e-4967-9970-74aad53d73cb tempest-VolumesListAdminTestJSON-402587183 None] Flow 'volume_create_manager' (d500fa87-2774-459b-ad1a-e9c5c5b64a1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:09:04 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-0df1b841-1f9e-4967-9970-74aad53d73cb tempest-VolumesListAdminTestJSON-402587183 None] Created volume successfully. Sep 10 21:09:06 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-f727a8e2-c343-40b0-bcb8-1a941cbd49ff tempest-VolumesListAdminTestJSON-402587183 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:09:06 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-f727a8e2-c343-40b0-bcb8-1a941cbd49ff tempest-VolumesListAdminTestJSON-402587183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:09:06 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-f727a8e2-c343-40b0-bcb8-1a941cbd49ff tempest-VolumesListAdminTestJSON-402587183 None] Flow 'volume_create_manager' (5b9e6488-cd5d-4e59-8c80-c74ef01918c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:09:06 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-f727a8e2-c343-40b0-bcb8-1a941cbd49ff tempest-VolumesListAdminTestJSON-402587183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12f77219-7b52-4086-870f-982314f586ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:09:06 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-f727a8e2-c343-40b0-bcb8-1a941cbd49ff tempest-VolumesListAdminTestJSON-402587183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12f77219-7b52-4086-870f-982314f586ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-794101119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=551baceb-2a97-42cd-bf37-87f6c204f100,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1642a6e7af4846b187017302d3e671df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:09:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:09:06Z,use_quota=True,user_id='886bbf59356e46d295bf7570c387a008',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:09:06 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-f727a8e2-c343-40b0-bcb8-1a941cbd49ff tempest-VolumesListAdminTestJSON-402587183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ec08494-56bb-410d-b89a-4463a423c70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:09:06 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-f727a8e2-c343-40b0-bcb8-1a941cbd49ff tempest-VolumesListAdminTestJSON-402587183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ec08494-56bb-410d-b89a-4463a423c70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:09:06 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-f727a8e2-c343-40b0-bcb8-1a941cbd49ff tempest-VolumesListAdminTestJSON-402587183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (382a54e2-78ac-49b5-8de6-a817d96057be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:09:06 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-f727a8e2-c343-40b0-bcb8-1a941cbd49ff tempest-VolumesListAdminTestJSON-402587183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (382a54e2-78ac-49b5-8de6-a817d96057be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '551baceb-2a97-42cd-bf37-87f6c204f100', 'volume_name': 'volume-551baceb-2a97-42cd-bf37-87f6c204f100', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:09:06 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-f727a8e2-c343-40b0-bcb8-1a941cbd49ff tempest-VolumesListAdminTestJSON-402587183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de5a59dc-9506-4a60-9ca7-7c64b334bf9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:09:06 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-f727a8e2-c343-40b0-bcb8-1a941cbd49ff tempest-VolumesListAdminTestJSON-402587183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de5a59dc-9506-4a60-9ca7-7c64b334bf9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:09:06 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-f727a8e2-c343-40b0-bcb8-1a941cbd49ff tempest-VolumesListAdminTestJSON-402587183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (752214d6-e190-4f7b-bd4e-1ee063aeaa30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:09:06 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-f727a8e2-c343-40b0-bcb8-1a941cbd49ff tempest-VolumesListAdminTestJSON-402587183 None] Volume 551baceb-2a97-42cd-bf37-87f6c204f100: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-551baceb-2a97-42cd-bf37-87f6c204f100', 'volume_size': 1} Sep 10 21:09:06 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-f727a8e2-c343-40b0-bcb8-1a941cbd49ff tempest-VolumesListAdminTestJSON-402587183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:09:06 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-f727a8e2-c343-40b0-bcb8-1a941cbd49ff tempest-VolumesListAdminTestJSON-402587183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:09:06 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-f727a8e2-c343-40b0-bcb8-1a941cbd49ff tempest-VolumesListAdminTestJSON-402587183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-794101119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=551baceb-2a97-42cd-bf37-87f6c204f100,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1642a6e7af4846b187017302d3e671df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:09:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:09:06Z,use_quota=True,user_id='886bbf59356e46d295bf7570c387a008',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:09:06 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-f727a8e2-c343-40b0-bcb8-1a941cbd49ff tempest-VolumesListAdminTestJSON-402587183 None] Creating volume 551baceb-2a97-42cd-bf37-87f6c204f100 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:09:06 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-f727a8e2-c343-40b0-bcb8-1a941cbd49ff tempest-VolumesListAdminTestJSON-402587183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:09:06 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-f727a8e2-c343-40b0-bcb8-1a941cbd49ff tempest-VolumesListAdminTestJSON-402587183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:09:06 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-f727a8e2-c343-40b0-bcb8-1a941cbd49ff tempest-VolumesListAdminTestJSON-402587183 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:09:06 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-f727a8e2-c343-40b0-bcb8-1a941cbd49ff tempest-VolumesListAdminTestJSON-402587183 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:09:06 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-f727a8e2-c343-40b0-bcb8-1a941cbd49ff tempest-VolumesListAdminTestJSON-402587183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:09:06 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-f727a8e2-c343-40b0-bcb8-1a941cbd49ff tempest-VolumesListAdminTestJSON-402587183 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:09:06 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-f727a8e2-c343-40b0-bcb8-1a941cbd49ff tempest-VolumesListAdminTestJSON-402587183 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:09:06 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f727a8e2-c343-40b0-bcb8-1a941cbd49ff tempest-VolumesListAdminTestJSON-402587183 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-551baceb-2a97-42cd-bf37-87f6c204f100 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:09:06 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=17, name=volume-551baceb-2a97-42cd-bf37-87f6c204f100, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:09:06 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f727a8e2-c343-40b0-bcb8-1a941cbd49ff tempest-VolumesListAdminTestJSON-402587183 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-551baceb-2a97-42cd-bf37-87f6c204f100 1073741824" returned: 0 in 0.378s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:09:06 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f727a8e2-c343-40b0-bcb8-1a941cbd49ff tempest-VolumesListAdminTestJSON-402587183 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-551baceb-2a97-42cd-bf37-87f6c204f100 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:09:06 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f727a8e2-c343-40b0-bcb8-1a941cbd49ff tempest-VolumesListAdminTestJSON-402587183 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-551baceb-2a97-42cd-bf37-87f6c204f100" returned: 0 in 0.085s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:09:06 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-f727a8e2-c343-40b0-bcb8-1a941cbd49ff tempest-VolumesListAdminTestJSON-402587183 None] <== create_volume: return (527ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:09:06 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-f727a8e2-c343-40b0-bcb8-1a941cbd49ff tempest-VolumesListAdminTestJSON-402587183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.546s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:09:07 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-f727a8e2-c343-40b0-bcb8-1a941cbd49ff tempest-VolumesListAdminTestJSON-402587183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (752214d6-e190-4f7b-bd4e-1ee063aeaa30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-551baceb-2a97-42cd-bf37-87f6c204f100', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:09:07 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-f727a8e2-c343-40b0-bcb8-1a941cbd49ff tempest-VolumesListAdminTestJSON-402587183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a04b7ea9-9d4b-474f-96bb-e00e194af2e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:09:07 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-f727a8e2-c343-40b0-bcb8-1a941cbd49ff tempest-VolumesListAdminTestJSON-402587183 None] Volume volume-551baceb-2a97-42cd-bf37-87f6c204f100 (551baceb-2a97-42cd-bf37-87f6c204f100): created successfully Sep 10 21:09:07 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-f727a8e2-c343-40b0-bcb8-1a941cbd49ff tempest-VolumesListAdminTestJSON-402587183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a04b7ea9-9d4b-474f-96bb-e00e194af2e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:09:07 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-f727a8e2-c343-40b0-bcb8-1a941cbd49ff tempest-VolumesListAdminTestJSON-402587183 None] Flow 'volume_create_manager' (5b9e6488-cd5d-4e59-8c80-c74ef01918c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:09:07 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-f727a8e2-c343-40b0-bcb8-1a941cbd49ff tempest-VolumesListAdminTestJSON-402587183 None] Created volume successfully. Sep 10 21:09:09 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-1622a3e5-b3fd-4cb4-abb1-d8e425745b42 tempest-VolumesListAdminTestJSON-402587183 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:09:09 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-1622a3e5-b3fd-4cb4-abb1-d8e425745b42 tempest-VolumesListAdminTestJSON-402587183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:09:09 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1622a3e5-b3fd-4cb4-abb1-d8e425745b42 tempest-VolumesListAdminTestJSON-402587183 None] Flow 'volume_create_manager' (ac6c1af7-be88-439d-b564-06441c6e8010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:09:09 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1622a3e5-b3fd-4cb4-abb1-d8e425745b42 tempest-VolumesListAdminTestJSON-402587183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (023501f0-b2cb-4078-ac16-baf00e656067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:09:09 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1622a3e5-b3fd-4cb4-abb1-d8e425745b42 tempest-VolumesListAdminTestJSON-402587183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (023501f0-b2cb-4078-ac16-baf00e656067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:09:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-865892228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ee44f95-2dd2-4bf3-9e00-730d540421a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1642a6e7af4846b187017302d3e671df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:09:09Z,use_quota=True,user_id='886bbf59356e46d295bf7570c387a008',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:09:09 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1622a3e5-b3fd-4cb4-abb1-d8e425745b42 tempest-VolumesListAdminTestJSON-402587183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d530a62-476b-4403-b4d1-d5405e4aaa32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:09:09 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1622a3e5-b3fd-4cb4-abb1-d8e425745b42 tempest-VolumesListAdminTestJSON-402587183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d530a62-476b-4403-b4d1-d5405e4aaa32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:09:09 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1622a3e5-b3fd-4cb4-abb1-d8e425745b42 tempest-VolumesListAdminTestJSON-402587183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd11d08b-47c9-4b83-a026-ecf44aa5e9c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:09:09 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1622a3e5-b3fd-4cb4-abb1-d8e425745b42 tempest-VolumesListAdminTestJSON-402587183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd11d08b-47c9-4b83-a026-ecf44aa5e9c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ee44f95-2dd2-4bf3-9e00-730d540421a0', 'volume_name': 'volume-7ee44f95-2dd2-4bf3-9e00-730d540421a0', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:09:09 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1622a3e5-b3fd-4cb4-abb1-d8e425745b42 tempest-VolumesListAdminTestJSON-402587183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae1e9031-39a7-4c87-ac5c-67f4a3d9a965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:09:09 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1622a3e5-b3fd-4cb4-abb1-d8e425745b42 tempest-VolumesListAdminTestJSON-402587183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae1e9031-39a7-4c87-ac5c-67f4a3d9a965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:09:09 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1622a3e5-b3fd-4cb4-abb1-d8e425745b42 tempest-VolumesListAdminTestJSON-402587183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76733b88-9e60-45a3-a798-9b0ac0984c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:09:09 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-1622a3e5-b3fd-4cb4-abb1-d8e425745b42 tempest-VolumesListAdminTestJSON-402587183 None] Volume 7ee44f95-2dd2-4bf3-9e00-730d540421a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ee44f95-2dd2-4bf3-9e00-730d540421a0', 'volume_size': 1} Sep 10 21:09:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-1622a3e5-b3fd-4cb4-abb1-d8e425745b42 tempest-VolumesListAdminTestJSON-402587183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:09:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-1622a3e5-b3fd-4cb4-abb1-d8e425745b42 tempest-VolumesListAdminTestJSON-402587183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:09:09 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-1622a3e5-b3fd-4cb4-abb1-d8e425745b42 tempest-VolumesListAdminTestJSON-402587183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:09:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-865892228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ee44f95-2dd2-4bf3-9e00-730d540421a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1642a6e7af4846b187017302d3e671df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:09:09Z,use_quota=True,user_id='886bbf59356e46d295bf7570c387a008',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:09:09 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-1622a3e5-b3fd-4cb4-abb1-d8e425745b42 tempest-VolumesListAdminTestJSON-402587183 None] Creating volume 7ee44f95-2dd2-4bf3-9e00-730d540421a0 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:09:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-1622a3e5-b3fd-4cb4-abb1-d8e425745b42 tempest-VolumesListAdminTestJSON-402587183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:09:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-1622a3e5-b3fd-4cb4-abb1-d8e425745b42 tempest-VolumesListAdminTestJSON-402587183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:09:09 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-1622a3e5-b3fd-4cb4-abb1-d8e425745b42 tempest-VolumesListAdminTestJSON-402587183 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:09:09 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-1622a3e5-b3fd-4cb4-abb1-d8e425745b42 tempest-VolumesListAdminTestJSON-402587183 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:09:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-1622a3e5-b3fd-4cb4-abb1-d8e425745b42 tempest-VolumesListAdminTestJSON-402587183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:09:09 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-1622a3e5-b3fd-4cb4-abb1-d8e425745b42 tempest-VolumesListAdminTestJSON-402587183 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:09:09 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-1622a3e5-b3fd-4cb4-abb1-d8e425745b42 tempest-VolumesListAdminTestJSON-402587183 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:09:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1622a3e5-b3fd-4cb4-abb1-d8e425745b42 tempest-VolumesListAdminTestJSON-402587183 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-7ee44f95-2dd2-4bf3-9e00-730d540421a0 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:09:09 devstack quobyte-client[82807]: System call of process 87313 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:09:09 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=18, name=volume-7ee44f95-2dd2-4bf3-9e00-730d540421a0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:09:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1622a3e5-b3fd-4cb4-abb1-d8e425745b42 tempest-VolumesListAdminTestJSON-402587183 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-7ee44f95-2dd2-4bf3-9e00-730d540421a0 1073741824" returned: 0 in 0.427s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:09:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1622a3e5-b3fd-4cb4-abb1-d8e425745b42 tempest-VolumesListAdminTestJSON-402587183 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-7ee44f95-2dd2-4bf3-9e00-730d540421a0 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:09:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1622a3e5-b3fd-4cb4-abb1-d8e425745b42 tempest-VolumesListAdminTestJSON-402587183 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-7ee44f95-2dd2-4bf3-9e00-730d540421a0" returned: 0 in 0.124s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:09:10 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-1622a3e5-b3fd-4cb4-abb1-d8e425745b42 tempest-VolumesListAdminTestJSON-402587183 None] <== create_volume: return (659ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:09:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-1622a3e5-b3fd-4cb4-abb1-d8e425745b42 tempest-VolumesListAdminTestJSON-402587183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.677s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:09:10 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1622a3e5-b3fd-4cb4-abb1-d8e425745b42 tempest-VolumesListAdminTestJSON-402587183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76733b88-9e60-45a3-a798-9b0ac0984c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ee44f95-2dd2-4bf3-9e00-730d540421a0', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:09:10 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1622a3e5-b3fd-4cb4-abb1-d8e425745b42 tempest-VolumesListAdminTestJSON-402587183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37bd35a7-3ede-42ae-84de-b487a7f861d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:09:10 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-1622a3e5-b3fd-4cb4-abb1-d8e425745b42 tempest-VolumesListAdminTestJSON-402587183 None] Volume volume-7ee44f95-2dd2-4bf3-9e00-730d540421a0 (7ee44f95-2dd2-4bf3-9e00-730d540421a0): created successfully Sep 10 21:09:10 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1622a3e5-b3fd-4cb4-abb1-d8e425745b42 tempest-VolumesListAdminTestJSON-402587183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37bd35a7-3ede-42ae-84de-b487a7f861d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:09:10 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1622a3e5-b3fd-4cb4-abb1-d8e425745b42 tempest-VolumesListAdminTestJSON-402587183 None] Flow 'volume_create_manager' (ac6c1af7-be88-439d-b564-06441c6e8010) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:09:10 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-1622a3e5-b3fd-4cb4-abb1-d8e425745b42 tempest-VolumesListAdminTestJSON-402587183 None] Created volume successfully. Sep 10 21:09:12 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-6367fb7c-0d84-4c84-9fe2-01cc81ae506c tempest-VolumesListAdminTestJSON-319402301 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:09:12 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-6367fb7c-0d84-4c84-9fe2-01cc81ae506c tempest-VolumesListAdminTestJSON-319402301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:09:12 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-6367fb7c-0d84-4c84-9fe2-01cc81ae506c tempest-VolumesListAdminTestJSON-319402301 None] Flow 'volume_create_manager' (39e42b65-1459-4ac0-8725-37f184e97d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:09:12 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-6367fb7c-0d84-4c84-9fe2-01cc81ae506c tempest-VolumesListAdminTestJSON-319402301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef3a3f33-74e4-4bb7-80c3-bb16c9821fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:09:12 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-6367fb7c-0d84-4c84-9fe2-01cc81ae506c tempest-VolumesListAdminTestJSON-319402301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef3a3f33-74e4-4bb7-80c3-bb16c9821fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5800ae4-81d8-4052-a369-8fa959c2aa1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d0b2339f41b4c93b1a29d68b8e2cc16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:09:12Z,use_quota=True,user_id='67ccc8c466a34d9897db8b4f68df8b90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:09:12 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-6367fb7c-0d84-4c84-9fe2-01cc81ae506c tempest-VolumesListAdminTestJSON-319402301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dc5b49f-148e-4c13-b8a7-0d449884e0d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:09:12 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-6367fb7c-0d84-4c84-9fe2-01cc81ae506c tempest-VolumesListAdminTestJSON-319402301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dc5b49f-148e-4c13-b8a7-0d449884e0d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:09:12 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-6367fb7c-0d84-4c84-9fe2-01cc81ae506c tempest-VolumesListAdminTestJSON-319402301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcec4e96-bea3-4788-98ce-98ebf68e2b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:09:12 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-6367fb7c-0d84-4c84-9fe2-01cc81ae506c tempest-VolumesListAdminTestJSON-319402301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcec4e96-bea3-4788-98ce-98ebf68e2b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5800ae4-81d8-4052-a369-8fa959c2aa1f', 'volume_name': 'volume-b5800ae4-81d8-4052-a369-8fa959c2aa1f', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:09:12 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-6367fb7c-0d84-4c84-9fe2-01cc81ae506c tempest-VolumesListAdminTestJSON-319402301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85daa01b-cadb-45af-a90f-ce279763fe92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:09:12 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-6367fb7c-0d84-4c84-9fe2-01cc81ae506c tempest-VolumesListAdminTestJSON-319402301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85daa01b-cadb-45af-a90f-ce279763fe92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:09:12 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-6367fb7c-0d84-4c84-9fe2-01cc81ae506c tempest-VolumesListAdminTestJSON-319402301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (178ddb69-d74f-4b15-8273-b8f87b54e36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:09:12 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-6367fb7c-0d84-4c84-9fe2-01cc81ae506c tempest-VolumesListAdminTestJSON-319402301 None] Volume b5800ae4-81d8-4052-a369-8fa959c2aa1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5800ae4-81d8-4052-a369-8fa959c2aa1f', 'volume_size': 1} Sep 10 21:09:12 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-6367fb7c-0d84-4c84-9fe2-01cc81ae506c tempest-VolumesListAdminTestJSON-319402301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:09:12 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-6367fb7c-0d84-4c84-9fe2-01cc81ae506c tempest-VolumesListAdminTestJSON-319402301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:09:12 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-6367fb7c-0d84-4c84-9fe2-01cc81ae506c tempest-VolumesListAdminTestJSON-319402301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5800ae4-81d8-4052-a369-8fa959c2aa1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d0b2339f41b4c93b1a29d68b8e2cc16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:09:12Z,use_quota=True,user_id='67ccc8c466a34d9897db8b4f68df8b90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:09:12 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-6367fb7c-0d84-4c84-9fe2-01cc81ae506c tempest-VolumesListAdminTestJSON-319402301 None] Creating volume b5800ae4-81d8-4052-a369-8fa959c2aa1f {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:09:12 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-6367fb7c-0d84-4c84-9fe2-01cc81ae506c tempest-VolumesListAdminTestJSON-319402301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:09:12 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-6367fb7c-0d84-4c84-9fe2-01cc81ae506c tempest-VolumesListAdminTestJSON-319402301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:09:12 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-6367fb7c-0d84-4c84-9fe2-01cc81ae506c tempest-VolumesListAdminTestJSON-319402301 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:09:12 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-6367fb7c-0d84-4c84-9fe2-01cc81ae506c tempest-VolumesListAdminTestJSON-319402301 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:09:12 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-6367fb7c-0d84-4c84-9fe2-01cc81ae506c tempest-VolumesListAdminTestJSON-319402301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:09:12 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-6367fb7c-0d84-4c84-9fe2-01cc81ae506c tempest-VolumesListAdminTestJSON-319402301 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:09:12 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-6367fb7c-0d84-4c84-9fe2-01cc81ae506c tempest-VolumesListAdminTestJSON-319402301 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:09:12 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-6367fb7c-0d84-4c84-9fe2-01cc81ae506c tempest-VolumesListAdminTestJSON-319402301 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b5800ae4-81d8-4052-a369-8fa959c2aa1f 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:09:12 devstack quobyte-client[82807]: System call of process 87317 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:09:12 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=19, name=volume-b5800ae4-81d8-4052-a369-8fa959c2aa1f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:09:12 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-6367fb7c-0d84-4c84-9fe2-01cc81ae506c tempest-VolumesListAdminTestJSON-319402301 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b5800ae4-81d8-4052-a369-8fa959c2aa1f 1073741824" returned: 0 in 0.338s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:09:12 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-6367fb7c-0d84-4c84-9fe2-01cc81ae506c tempest-VolumesListAdminTestJSON-319402301 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b5800ae4-81d8-4052-a369-8fa959c2aa1f {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:09:12 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-6367fb7c-0d84-4c84-9fe2-01cc81ae506c tempest-VolumesListAdminTestJSON-319402301 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b5800ae4-81d8-4052-a369-8fa959c2aa1f" returned: 0 in 0.068s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:09:12 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-6367fb7c-0d84-4c84-9fe2-01cc81ae506c tempest-VolumesListAdminTestJSON-319402301 None] <== create_volume: return (466ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:09:12 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-6367fb7c-0d84-4c84-9fe2-01cc81ae506c tempest-VolumesListAdminTestJSON-319402301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.479s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:09:12 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-6367fb7c-0d84-4c84-9fe2-01cc81ae506c tempest-VolumesListAdminTestJSON-319402301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (178ddb69-d74f-4b15-8273-b8f87b54e36b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5800ae4-81d8-4052-a369-8fa959c2aa1f', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:09:12 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-6367fb7c-0d84-4c84-9fe2-01cc81ae506c tempest-VolumesListAdminTestJSON-319402301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eda17de7-b2b9-4c31-be56-f8060e2408b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:09:12 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-6367fb7c-0d84-4c84-9fe2-01cc81ae506c tempest-VolumesListAdminTestJSON-319402301 None] Volume volume-b5800ae4-81d8-4052-a369-8fa959c2aa1f (b5800ae4-81d8-4052-a369-8fa959c2aa1f): created successfully Sep 10 21:09:12 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-6367fb7c-0d84-4c84-9fe2-01cc81ae506c tempest-VolumesListAdminTestJSON-319402301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eda17de7-b2b9-4c31-be56-f8060e2408b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:09:12 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-6367fb7c-0d84-4c84-9fe2-01cc81ae506c tempest-VolumesListAdminTestJSON-319402301 None] Flow 'volume_create_manager' (39e42b65-1459-4ac0-8725-37f184e97d0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:09:13 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-6367fb7c-0d84-4c84-9fe2-01cc81ae506c tempest-VolumesListAdminTestJSON-319402301 None] Created volume successfully. Sep 10 21:09:13 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-5032185f-2343-4193-b54f-4957fbb323e1 req-c5819c29-2bfa-469e-b7d1-5438b632363c tempest-TaggedAttachmentsTest-1829613531 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:09:13 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-5032185f-2343-4193-b54f-4957fbb323e1 req-c5819c29-2bfa-469e-b7d1-5438b632363c tempest-TaggedAttachmentsTest-1829613531 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:09:13 devstack cinder-volume[82780]: INFO cinder.volume.manager [req-5032185f-2343-4193-b54f-4957fbb323e1 req-c5819c29-2bfa-469e-b7d1-5438b632363c tempest-TaggedAttachmentsTest-1829613531 None] Terminate volume connection completed successfully. Sep 10 21:09:13 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-5032185f-2343-4193-b54f-4957fbb323e1 req-c5819c29-2bfa-469e-b7d1-5438b632363c tempest-TaggedAttachmentsTest-1829613531 None] Deleting attachment 4d95da15-30f7-4f86-82c7-c17e021875a7. {{(pid=82780) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 21:09:14 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-186a0dcf-aec6-4616-8f71-ca6c6d76ef1e tempest-VolumesListAdminTestJSON-319402301 None] Acquiring lock "cinder-b5800ae4-81d8-4052-a369-8fa959c2aa1f-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:09:14 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-186a0dcf-aec6-4616-8f71-ca6c6d76ef1e tempest-VolumesListAdminTestJSON-319402301 None] Lock "cinder-b5800ae4-81d8-4052-a369-8fa959c2aa1f-delete_volume" acquired by "delete_volume" :: waited 0.094s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:09:14 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-186a0dcf-aec6-4616-8f71-ca6c6d76ef1e tempest-VolumesListAdminTestJSON-319402301 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:09:14 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-186a0dcf-aec6-4616-8f71-ca6c6d76ef1e tempest-VolumesListAdminTestJSON-319402301 None] Acquiring lock "cinder-quobyte-b5800ae4-81d8-4052-a369-8fa959c2aa1f" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:09:14 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-186a0dcf-aec6-4616-8f71-ca6c6d76ef1e tempest-VolumesListAdminTestJSON-319402301 None] Lock "cinder-quobyte-b5800ae4-81d8-4052-a369-8fa959c2aa1f" acquired by "delete_volume" :: waited 0.018s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:09:14 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb89c8d2-a33c-46c5-a7da-e066f0d7d468]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:09:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-186a0dcf-aec6-4616-8f71-ca6c6d76ef1e tempest-VolumesListAdminTestJSON-319402301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b5800ae4-81d8-4052-a369-8fa959c2aa1f {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:09:14 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-1347072c-3d9c-4c53-b33a-99775e7ce5ab tempest-VolumesListAdminTestJSON-402587183 None] Acquiring lock "cinder-7ee44f95-2dd2-4bf3-9e00-730d540421a0-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:09:14 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-1347072c-3d9c-4c53-b33a-99775e7ce5ab tempest-VolumesListAdminTestJSON-402587183 None] Lock "cinder-7ee44f95-2dd2-4bf3-9e00-730d540421a0-delete_volume" acquired by "delete_volume" :: waited 0.207s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:09:15 devstack quobyte-client[82807]: System call of process 87324 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:09:15 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-1347072c-3d9c-4c53-b33a-99775e7ce5ab tempest-VolumesListAdminTestJSON-402587183 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:09:15 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-1347072c-3d9c-4c53-b33a-99775e7ce5ab tempest-VolumesListAdminTestJSON-402587183 None] Acquiring lock "cinder-quobyte-7ee44f95-2dd2-4bf3-9e00-730d540421a0" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:09:15 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-186a0dcf-aec6-4616-8f71-ca6c6d76ef1e tempest-VolumesListAdminTestJSON-319402301 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b5800ae4-81d8-4052-a369-8fa959c2aa1f" returned: 0 in 0.825s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:09:15 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-186a0dcf-aec6-4616-8f71-ca6c6d76ef1e tempest-VolumesListAdminTestJSON-319402301 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b5800ae4-81d8-4052-a369-8fa959c2aa1f {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:09:15 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-1347072c-3d9c-4c53-b33a-99775e7ce5ab tempest-VolumesListAdminTestJSON-402587183 None] Lock "cinder-quobyte-7ee44f95-2dd2-4bf3-9e00-730d540421a0" acquired by "delete_volume" :: waited 0.186s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:09:15 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d14a5f-56b0-4509-9e1f-3d7a94858bed]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:09:15 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1347072c-3d9c-4c53-b33a-99775e7ce5ab tempest-VolumesListAdminTestJSON-402587183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-7ee44f95-2dd2-4bf3-9e00-730d540421a0 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:09:15 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-186a0dcf-aec6-4616-8f71-ca6c6d76ef1e tempest-VolumesListAdminTestJSON-319402301 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b5800ae4-81d8-4052-a369-8fa959c2aa1f" returned: 0 in 0.391s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:09:15 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-186a0dcf-aec6-4616-8f71-ca6c6d76ef1e tempest-VolumesListAdminTestJSON-319402301 None] Lock "cinder-quobyte-b5800ae4-81d8-4052-a369-8fa959c2aa1f" released by "delete_volume" :: held 1.486s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:09:16 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-186a0dcf-aec6-4616-8f71-ca6c6d76ef1e tempest-VolumesListAdminTestJSON-319402301 None] Created reservations ['fe08c41a-292c-4186-90f3-06e57c695d38', '807c8702-c78b-4c23-918e-85b3679f6619', 'ce78a6e6-4d6e-49e8-b090-3b12ad738225', '97fff0b1-e26e-4493-af3d-14195ba3f0c5'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:09:16 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1347072c-3d9c-4c53-b33a-99775e7ce5ab tempest-VolumesListAdminTestJSON-402587183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-7ee44f95-2dd2-4bf3-9e00-730d540421a0" returned: 0 in 0.694s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:09:16 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1347072c-3d9c-4c53-b33a-99775e7ce5ab tempest-VolumesListAdminTestJSON-402587183 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-7ee44f95-2dd2-4bf3-9e00-730d540421a0 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:09:16 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1347072c-3d9c-4c53-b33a-99775e7ce5ab tempest-VolumesListAdminTestJSON-402587183 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-7ee44f95-2dd2-4bf3-9e00-730d540421a0" returned: 0 in 0.267s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:09:16 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-186a0dcf-aec6-4616-8f71-ca6c6d76ef1e tempest-VolumesListAdminTestJSON-319402301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:09:16 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-186a0dcf-aec6-4616-8f71-ca6c6d76ef1e tempest-VolumesListAdminTestJSON-319402301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:09:16 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-186a0dcf-aec6-4616-8f71-ca6c6d76ef1e tempest-VolumesListAdminTestJSON-319402301 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:09:16 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-186a0dcf-aec6-4616-8f71-ca6c6d76ef1e tempest-VolumesListAdminTestJSON-319402301 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:09:16 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-186a0dcf-aec6-4616-8f71-ca6c6d76ef1e tempest-VolumesListAdminTestJSON-319402301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:09:16 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-186a0dcf-aec6-4616-8f71-ca6c6d76ef1e tempest-VolumesListAdminTestJSON-319402301 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:09:17 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-1347072c-3d9c-4c53-b33a-99775e7ce5ab tempest-VolumesListAdminTestJSON-402587183 None] Lock "cinder-quobyte-7ee44f95-2dd2-4bf3-9e00-730d540421a0" released by "delete_volume" :: held 2.274s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:09:19 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-186a0dcf-aec6-4616-8f71-ca6c6d76ef1e tempest-VolumesListAdminTestJSON-319402301 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 2.317s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:09:19 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-186a0dcf-aec6-4616-8f71-ca6c6d76ef1e tempest-VolumesListAdminTestJSON-319402301 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:09:19 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-1347072c-3d9c-4c53-b33a-99775e7ce5ab tempest-VolumesListAdminTestJSON-402587183 None] Created reservations ['4ed51e9c-f542-4cb3-93ad-3da883ddd31d', 'bf7486aa-a173-498f-a22a-78ab0321bc62', 'ed1a1ffb-ba53-4ba7-9523-21ba9ae55600', '266f4f7c-d24f-445e-a7e4-09ed02dc3b20'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:09:19 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-186a0dcf-aec6-4616-8f71-ca6c6d76ef1e tempest-VolumesListAdminTestJSON-319402301 None] Deleted volume successfully. Sep 10 21:09:19 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-1347072c-3d9c-4c53-b33a-99775e7ce5ab tempest-VolumesListAdminTestJSON-402587183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:09:19 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-1347072c-3d9c-4c53-b33a-99775e7ce5ab tempest-VolumesListAdminTestJSON-402587183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:09:19 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-1347072c-3d9c-4c53-b33a-99775e7ce5ab tempest-VolumesListAdminTestJSON-402587183 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:09:19 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-1347072c-3d9c-4c53-b33a-99775e7ce5ab tempest-VolumesListAdminTestJSON-402587183 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:09:19 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-1347072c-3d9c-4c53-b33a-99775e7ce5ab tempest-VolumesListAdminTestJSON-402587183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:09:19 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1347072c-3d9c-4c53-b33a-99775e7ce5ab tempest-VolumesListAdminTestJSON-402587183 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:09:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1347072c-3d9c-4c53-b33a-99775e7ce5ab tempest-VolumesListAdminTestJSON-402587183 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.584s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:09:20 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-1347072c-3d9c-4c53-b33a-99775e7ce5ab tempest-VolumesListAdminTestJSON-402587183 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:09:20 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-1347072c-3d9c-4c53-b33a-99775e7ce5ab tempest-VolumesListAdminTestJSON-402587183 None] Deleted volume successfully. Sep 10 21:09:20 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-186a0dcf-aec6-4616-8f71-ca6c6d76ef1e tempest-VolumesListAdminTestJSON-319402301 None] Lock "cinder-b5800ae4-81d8-4052-a369-8fa959c2aa1f-delete_volume" released by "delete_volume" :: held 5.965s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:09:20 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-3266dc63-0327-4335-a9ff-6ad7c51370be tempest-VolumesListAdminTestJSON-402587183 None] Acquiring lock "cinder-551baceb-2a97-42cd-bf37-87f6c204f100-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:09:20 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-3266dc63-0327-4335-a9ff-6ad7c51370be tempest-VolumesListAdminTestJSON-402587183 None] Lock "cinder-551baceb-2a97-42cd-bf37-87f6c204f100-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:09:20 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-1347072c-3d9c-4c53-b33a-99775e7ce5ab tempest-VolumesListAdminTestJSON-402587183 None] Lock "cinder-7ee44f95-2dd2-4bf3-9e00-730d540421a0-delete_volume" released by "delete_volume" :: held 5.475s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:09:20 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-3266dc63-0327-4335-a9ff-6ad7c51370be tempest-VolumesListAdminTestJSON-402587183 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:09:20 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-3266dc63-0327-4335-a9ff-6ad7c51370be tempest-VolumesListAdminTestJSON-402587183 None] Acquiring lock "cinder-quobyte-551baceb-2a97-42cd-bf37-87f6c204f100" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:09:20 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-3266dc63-0327-4335-a9ff-6ad7c51370be tempest-VolumesListAdminTestJSON-402587183 None] Lock "cinder-quobyte-551baceb-2a97-42cd-bf37-87f6c204f100" acquired by "delete_volume" :: waited 0.030s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:09:20 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[1724d657-75eb-4a20-aada-d7f6372ee6e8]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:09:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-3266dc63-0327-4335-a9ff-6ad7c51370be tempest-VolumesListAdminTestJSON-402587183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-551baceb-2a97-42cd-bf37-87f6c204f100 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:09:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-3266dc63-0327-4335-a9ff-6ad7c51370be tempest-VolumesListAdminTestJSON-402587183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-551baceb-2a97-42cd-bf37-87f6c204f100" returned: 0 in 0.510s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:09:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-3266dc63-0327-4335-a9ff-6ad7c51370be tempest-VolumesListAdminTestJSON-402587183 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-551baceb-2a97-42cd-bf37-87f6c204f100 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:09:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-3266dc63-0327-4335-a9ff-6ad7c51370be tempest-VolumesListAdminTestJSON-402587183 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-551baceb-2a97-42cd-bf37-87f6c204f100" returned: 0 in 0.081s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:09:21 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-3266dc63-0327-4335-a9ff-6ad7c51370be tempest-VolumesListAdminTestJSON-402587183 None] Lock "cinder-quobyte-551baceb-2a97-42cd-bf37-87f6c204f100" released by "delete_volume" :: held 0.744s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:09:21 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-3266dc63-0327-4335-a9ff-6ad7c51370be tempest-VolumesListAdminTestJSON-402587183 None] Created reservations ['4bb7c709-4db4-43e0-98ea-c69e3a20cf0c', '746eed01-e1d1-440c-8e52-0ad5b05fe863', '899d1459-9166-4ee7-a42f-09dd083589a2', '396f1345-eca1-4f3e-a428-64b50d74ba4d'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:09:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-3266dc63-0327-4335-a9ff-6ad7c51370be tempest-VolumesListAdminTestJSON-402587183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:09:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-3266dc63-0327-4335-a9ff-6ad7c51370be tempest-VolumesListAdminTestJSON-402587183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:09:21 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-3266dc63-0327-4335-a9ff-6ad7c51370be tempest-VolumesListAdminTestJSON-402587183 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:09:21 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-3266dc63-0327-4335-a9ff-6ad7c51370be tempest-VolumesListAdminTestJSON-402587183 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:09:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-3266dc63-0327-4335-a9ff-6ad7c51370be tempest-VolumesListAdminTestJSON-402587183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:09:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-3266dc63-0327-4335-a9ff-6ad7c51370be tempest-VolumesListAdminTestJSON-402587183 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:09:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-3266dc63-0327-4335-a9ff-6ad7c51370be tempest-VolumesListAdminTestJSON-402587183 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.101s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:09:21 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-3266dc63-0327-4335-a9ff-6ad7c51370be tempest-VolumesListAdminTestJSON-402587183 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:09:21 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-3266dc63-0327-4335-a9ff-6ad7c51370be tempest-VolumesListAdminTestJSON-402587183 None] Deleted volume successfully. Sep 10 21:09:22 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-3266dc63-0327-4335-a9ff-6ad7c51370be tempest-VolumesListAdminTestJSON-402587183 None] Lock "cinder-551baceb-2a97-42cd-bf37-87f6c204f100-delete_volume" released by "delete_volume" :: held 1.746s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:09:22 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-344905db-16c3-471c-a371-8275ba07a5c2 tempest-VolumesListAdminTestJSON-402587183 None] Acquiring lock "cinder-323fbd06-a222-4825-9d81-7e5e55116c09-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:09:22 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-344905db-16c3-471c-a371-8275ba07a5c2 tempest-VolumesListAdminTestJSON-402587183 None] Lock "cinder-323fbd06-a222-4825-9d81-7e5e55116c09-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:09:22 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-344905db-16c3-471c-a371-8275ba07a5c2 tempest-VolumesListAdminTestJSON-402587183 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:09:22 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-344905db-16c3-471c-a371-8275ba07a5c2 tempest-VolumesListAdminTestJSON-402587183 None] Acquiring lock "cinder-quobyte-323fbd06-a222-4825-9d81-7e5e55116c09" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:09:22 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-344905db-16c3-471c-a371-8275ba07a5c2 tempest-VolumesListAdminTestJSON-402587183 None] Lock "cinder-quobyte-323fbd06-a222-4825-9d81-7e5e55116c09" acquired by "delete_volume" :: waited 0.014s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:09:22 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44643ac-f95a-4801-92e6-7ffab04ce32b]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:09:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-344905db-16c3-471c-a371-8275ba07a5c2 tempest-VolumesListAdminTestJSON-402587183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-323fbd06-a222-4825-9d81-7e5e55116c09 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:09:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-344905db-16c3-471c-a371-8275ba07a5c2 tempest-VolumesListAdminTestJSON-402587183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-323fbd06-a222-4825-9d81-7e5e55116c09" returned: 0 in 0.449s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:09:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-344905db-16c3-471c-a371-8275ba07a5c2 tempest-VolumesListAdminTestJSON-402587183 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-323fbd06-a222-4825-9d81-7e5e55116c09 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:09:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-344905db-16c3-471c-a371-8275ba07a5c2 tempest-VolumesListAdminTestJSON-402587183 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-323fbd06-a222-4825-9d81-7e5e55116c09" returned: 0 in 0.106s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:09:23 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-344905db-16c3-471c-a371-8275ba07a5c2 tempest-VolumesListAdminTestJSON-402587183 None] Lock "cinder-quobyte-323fbd06-a222-4825-9d81-7e5e55116c09" released by "delete_volume" :: held 0.699s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:09:23 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-344905db-16c3-471c-a371-8275ba07a5c2 tempest-VolumesListAdminTestJSON-402587183 None] Created reservations ['8e091fe0-5faf-450b-8363-2524dc1fc8b1', '1835eb91-008f-4b1e-8bcb-4af570dc0bfe', 'd96e07ec-0853-4d35-b045-f481c072c7b4', '359f0bd1-ec37-4bfe-b826-edec2351f7ec'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:09:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-344905db-16c3-471c-a371-8275ba07a5c2 tempest-VolumesListAdminTestJSON-402587183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:09:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-344905db-16c3-471c-a371-8275ba07a5c2 tempest-VolumesListAdminTestJSON-402587183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:09:24 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-344905db-16c3-471c-a371-8275ba07a5c2 tempest-VolumesListAdminTestJSON-402587183 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:09:24 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-344905db-16c3-471c-a371-8275ba07a5c2 tempest-VolumesListAdminTestJSON-402587183 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:09:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-344905db-16c3-471c-a371-8275ba07a5c2 tempest-VolumesListAdminTestJSON-402587183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:09:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-344905db-16c3-471c-a371-8275ba07a5c2 tempest-VolumesListAdminTestJSON-402587183 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:09:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-344905db-16c3-471c-a371-8275ba07a5c2 tempest-VolumesListAdminTestJSON-402587183 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.121s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:09:24 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-344905db-16c3-471c-a371-8275ba07a5c2 tempest-VolumesListAdminTestJSON-402587183 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:09:24 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-344905db-16c3-471c-a371-8275ba07a5c2 tempest-VolumesListAdminTestJSON-402587183 None] Deleted volume successfully. Sep 10 21:09:24 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-344905db-16c3-471c-a371-8275ba07a5c2 tempest-VolumesListAdminTestJSON-402587183 None] Lock "cinder-323fbd06-a222-4825-9d81-7e5e55116c09-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:09:34 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=26,cinder:UPDATE=41,cinder:DELETE=2,cinder:INSERT=5 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:09:34 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:UPDATE=39,cinder:SELECT=24,cinder:DELETE=6,cinder:INSERT=11 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:09:37 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-20c5798d-6d14-4395-ab08-916cae4f01c1 tempest-VolumesImageMetadata-1503177403 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:09:37 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-20c5798d-6d14-4395-ab08-916cae4f01c1 tempest-VolumesImageMetadata-1503177403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:09:37 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-20c5798d-6d14-4395-ab08-916cae4f01c1 tempest-VolumesImageMetadata-1503177403 None] Flow 'volume_create_manager' (6b34fc70-be51-4d20-a660-88852be86161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:09:37 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-20c5798d-6d14-4395-ab08-916cae4f01c1 tempest-VolumesImageMetadata-1503177403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50497df5-62ff-4a27-a015-88ff98816fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:09:37 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-20c5798d-6d14-4395-ab08-916cae4f01c1 tempest-VolumesImageMetadata-1503177403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50497df5-62ff-4a27-a015-88ff98816fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1596545366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d897a5b5-3a8c-47bc-ad00-87b7f681ae6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45483d11492e4e998086b1120b95a5a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:09:37Z,use_quota=True,user_id='5a478df82b7e41babdd594552d7d0322',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:09:37 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-20c5798d-6d14-4395-ab08-916cae4f01c1 tempest-VolumesImageMetadata-1503177403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54c8e563-fb7d-4128-8bc0-7333466a3ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:09:37 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-20c5798d-6d14-4395-ab08-916cae4f01c1 tempest-VolumesImageMetadata-1503177403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54c8e563-fb7d-4128-8bc0-7333466a3ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:09:37 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-20c5798d-6d14-4395-ab08-916cae4f01c1 tempest-VolumesImageMetadata-1503177403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (537705aa-710b-4010-80ef-c38b1bcefba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:09:38 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-20c5798d-6d14-4395-ab08-916cae4f01c1 tempest-VolumesImageMetadata-1503177403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (537705aa-710b-4010-80ef-c38b1bcefba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd897a5b5-3a8c-47bc-ad00-87b7f681ae6e', 'volume_name': 'volume-d897a5b5-3a8c-47bc-ad00-87b7f681ae6e', 'volume_size': 1, 'image_id': '844acb65-e174-4c79-a335-b56b5bb82298', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2bf6d32ea4d94e048fb27411155cf2e9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '844acb65-e174-4c79-a335-b56b5bb82298', 'created_at': datetime.datetime(2025, 9, 10, 18, 53, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 18, 53, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/844acb65-e174-4c79-a335-b56b5bb82298/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:09:38 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-20c5798d-6d14-4395-ab08-916cae4f01c1 tempest-VolumesImageMetadata-1503177403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6f968b2-96ba-412b-94f6-3aec9e44f477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:09:38 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-20c5798d-6d14-4395-ab08-916cae4f01c1 tempest-VolumesImageMetadata-1503177403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6f968b2-96ba-412b-94f6-3aec9e44f477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:09:38 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-20c5798d-6d14-4395-ab08-916cae4f01c1 tempest-VolumesImageMetadata-1503177403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43daf523-758b-4126-9726-d9e628e1a047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:09:38 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-20c5798d-6d14-4395-ab08-916cae4f01c1 tempest-VolumesImageMetadata-1503177403 None] Volume d897a5b5-3a8c-47bc-ad00-87b7f681ae6e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d897a5b5-3a8c-47bc-ad00-87b7f681ae6e', 'volume_size': 1, 'image_id': '844acb65-e174-4c79-a335-b56b5bb82298', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2bf6d32ea4d94e048fb27411155cf2e9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '844acb65-e174-4c79-a335-b56b5bb82298', 'created_at': datetime.datetime(2025, 9, 10, 18, 53, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 18, 53, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/844acb65-e174-4c79-a335-b56b5bb82298/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 10 21:09:38 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-20c5798d-6d14-4395-ab08-916cae4f01c1 tempest-VolumesImageMetadata-1503177403 None] Cloning d897a5b5-3a8c-47bc-ad00-87b7f681ae6e from image 844acb65-e174-4c79-a335-b56b5bb82298 at location (None, None). {{(pid=82780) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1083}} Sep 10 21:09:39 devstack cinder-volume[82780]: DEBUG cinder.image.image_utils [None req-20c5798d-6d14-4395-ab08-916cae4f01c1 tempest-VolumesImageMetadata-1503177403 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_844acb65-e174-4c79-a335-b56b5bb82298_l8ehbjmadevstack@QuobyteHD, size 20.69 MB, duration 1.03 sec {{(pid=82780) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 10 21:09:39 devstack cinder-volume[82780]: INFO cinder.image.image_utils [None req-20c5798d-6d14-4395-ab08-916cae4f01c1 tempest-VolumesImageMetadata-1503177403 None] Image download 20.69 MB at 20.11 MB/s Sep 10 21:09:39 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[6819667a-dcda-4482-ac1e-450f6fb57ad5]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:09:39 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-20c5798d-6d14-4395-ab08-916cae4f01c1 tempest-VolumesImageMetadata-1503177403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_844acb65-e174-4c79-a335-b56b5bb82298_l8ehbjmadevstack@QuobyteHD {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:09:40 devstack sudo[87458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_844acb65-e174-4c79-a335-b56b5bb82298_l8ehbjmadevstack@QuobyteHD Sep 10 21:09:40 devstack sudo[87458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 21:09:42 devstack sudo[87458]: pam_unix(sudo:session): session closed for user root Sep 10 21:09:42 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-20c5798d-6d14-4395-ab08-916cae4f01c1 tempest-VolumesImageMetadata-1503177403 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_844acb65-e174-4c79-a335-b56b5bb82298_l8ehbjmadevstack@QuobyteHD" returned: 0 in 2.832s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:09:42 devstack cinder-volume[82780]: DEBUG cinder.image.image_utils [None req-20c5798d-6d14-4395-ab08-916cae4f01c1 tempest-VolumesImageMetadata-1503177403 None] Temporary image 844acb65-e174-4c79-a335-b56b5bb82298 is fetched for user 5a478df82b7e41babdd594552d7d0322. {{(pid=82780) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 10 21:09:43 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[098816fb-7f40-4ea4-8838-c75d01e96d43]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:09:43 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-20c5798d-6d14-4395-ab08-916cae4f01c1 tempest-VolumesImageMetadata-1503177403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_844acb65-e174-4c79-a335-b56b5bb82298_l8ehbjmadevstack@QuobyteHD {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:09:43 devstack sudo[87466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_844acb65-e174-4c79-a335-b56b5bb82298_l8ehbjmadevstack@QuobyteHD Sep 10 21:09:43 devstack sudo[87466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 21:09:45 devstack sudo[87466]: pam_unix(sudo:session): session closed for user root Sep 10 21:09:45 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-20c5798d-6d14-4395-ab08-916cae4f01c1 tempest-VolumesImageMetadata-1503177403 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_844acb65-e174-4c79-a335-b56b5bb82298_l8ehbjmadevstack@QuobyteHD" returned: 0 in 2.435s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:09:45 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-20c5798d-6d14-4395-ab08-916cae4f01c1 tempest-VolumesImageMetadata-1503177403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:09:45 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-20c5798d-6d14-4395-ab08-916cae4f01c1 tempest-VolumesImageMetadata-1503177403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:09:45 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-20c5798d-6d14-4395-ab08-916cae4f01c1 tempest-VolumesImageMetadata-1503177403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1596545366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d897a5b5-3a8c-47bc-ad00-87b7f681ae6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45483d11492e4e998086b1120b95a5a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:09:37Z,use_quota=True,user_id='5a478df82b7e41babdd594552d7d0322',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:09:45 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-20c5798d-6d14-4395-ab08-916cae4f01c1 tempest-VolumesImageMetadata-1503177403 None] Creating volume d897a5b5-3a8c-47bc-ad00-87b7f681ae6e {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:09:45 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-20c5798d-6d14-4395-ab08-916cae4f01c1 tempest-VolumesImageMetadata-1503177403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:09:45 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-20c5798d-6d14-4395-ab08-916cae4f01c1 tempest-VolumesImageMetadata-1503177403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:09:45 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-20c5798d-6d14-4395-ab08-916cae4f01c1 tempest-VolumesImageMetadata-1503177403 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:09:45 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-20c5798d-6d14-4395-ab08-916cae4f01c1 tempest-VolumesImageMetadata-1503177403 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:09:45 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-20c5798d-6d14-4395-ab08-916cae4f01c1 tempest-VolumesImageMetadata-1503177403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:09:45 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-20c5798d-6d14-4395-ab08-916cae4f01c1 tempest-VolumesImageMetadata-1503177403 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:09:45 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-20c5798d-6d14-4395-ab08-916cae4f01c1 tempest-VolumesImageMetadata-1503177403 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:09:45 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-20c5798d-6d14-4395-ab08-916cae4f01c1 tempest-VolumesImageMetadata-1503177403 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d897a5b5-3a8c-47bc-ad00-87b7f681ae6e 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:09:45 devstack quobyte-client[82807]: System call of process 87472 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:09:45 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=20, name=volume-d897a5b5-3a8c-47bc-ad00-87b7f681ae6e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:09:46 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-20c5798d-6d14-4395-ab08-916cae4f01c1 tempest-VolumesImageMetadata-1503177403 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d897a5b5-3a8c-47bc-ad00-87b7f681ae6e 1073741824" returned: 0 in 0.562s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:09:46 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-20c5798d-6d14-4395-ab08-916cae4f01c1 tempest-VolumesImageMetadata-1503177403 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d897a5b5-3a8c-47bc-ad00-87b7f681ae6e {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:09:46 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-20c5798d-6d14-4395-ab08-916cae4f01c1 tempest-VolumesImageMetadata-1503177403 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d897a5b5-3a8c-47bc-ad00-87b7f681ae6e" returned: 0 in 0.563s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:09:46 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-20c5798d-6d14-4395-ab08-916cae4f01c1 tempest-VolumesImageMetadata-1503177403 None] <== create_volume: return (1239ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:09:46 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-20c5798d-6d14-4395-ab08-916cae4f01c1 tempest-VolumesImageMetadata-1503177403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.292s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:09:47 devstack quobyte-client[82807]: Failed to parse file /sys/class/net/tap6def983f-a7/statistics/collisions: Failed to read/parse sysfs file /sys/class/net/tap6def983f-a7/statistics/collisions: stoll Sep 10 21:09:47 devstack quobyte-client[82807]: Failed to parse file /sys/class/net/tap6def983f-a7/statistics/multicast: Failed to read/parse sysfs file /sys/class/net/tap6def983f-a7/statistics/multicast: stoll Sep 10 21:09:47 devstack quobyte-client[82807]: Failed to parse file /sys/class/net/tap6def983f-a7/statistics/rx_bytes: Failed to read/parse sysfs file /sys/class/net/tap6def983f-a7/statistics/rx_bytes: stoll Sep 10 21:09:47 devstack quobyte-client[82807]: Failed to parse file /sys/class/net/tap6def983f-a7/statistics/rx_compressed: Failed to read/parse sysfs file /sys/class/net/tap6def983f-a7/statistics/rx_compressed: stoll Sep 10 21:09:47 devstack quobyte-client[82807]: Failed to parse file /sys/class/net/tap6def983f-a7/statistics/rx_crc_errors: Failed to read/parse sysfs file /sys/class/net/tap6def983f-a7/statistics/rx_crc_errors: stoll Sep 10 21:09:47 devstack quobyte-client[82807]: Failed to parse file /sys/class/net/tap6def983f-a7/statistics/rx_dropped: Failed to read/parse sysfs file /sys/class/net/tap6def983f-a7/statistics/rx_dropped: stoll Sep 10 21:09:47 devstack quobyte-client[82807]: Failed to parse file /sys/class/net/tap6def983f-a7/statistics/rx_errors: Failed to read/parse sysfs file /sys/class/net/tap6def983f-a7/statistics/rx_errors: stoll Sep 10 21:09:47 devstack quobyte-client[82807]: Failed to parse file /sys/class/net/tap6def983f-a7/statistics/rx_fifo_errors: Failed to read/parse sysfs file /sys/class/net/tap6def983f-a7/statistics/rx_fifo_errors: stoll Sep 10 21:09:47 devstack quobyte-client[82807]: Failed to parse file /sys/class/net/tap6def983f-a7/statistics/rx_frame_errors: Failed to read/parse sysfs file /sys/class/net/tap6def983f-a7/statistics/rx_frame_errors: stoll Sep 10 21:09:47 devstack quobyte-client[82807]: Failed to parse file /sys/class/net/tap6def983f-a7/statistics/rx_length_errors: Failed to read/parse sysfs file /sys/class/net/tap6def983f-a7/statistics/rx_length_errors: stoll Sep 10 21:09:47 devstack quobyte-client[82807]: Failed to parse file /sys/class/net/tap6def983f-a7/statistics/rx_missed_errors: Failed to read/parse sysfs file /sys/class/net/tap6def983f-a7/statistics/rx_missed_errors: stoll Sep 10 21:09:47 devstack quobyte-client[82807]: Failed to parse file /sys/class/net/tap6def983f-a7/statistics/rx_nohandler: Failed to read/parse sysfs file /sys/class/net/tap6def983f-a7/statistics/rx_nohandler: stoll Sep 10 21:09:47 devstack quobyte-client[82807]: Failed to parse file /sys/class/net/tap6def983f-a7/statistics/rx_over_errors: Failed to read/parse sysfs file /sys/class/net/tap6def983f-a7/statistics/rx_over_errors: stoll Sep 10 21:09:47 devstack quobyte-client[82807]: Failed to parse file /sys/class/net/tap6def983f-a7/statistics/rx_packets: Failed to read/parse sysfs file /sys/class/net/tap6def983f-a7/statistics/rx_packets: stoll Sep 10 21:09:47 devstack quobyte-client[82807]: Failed to parse file /sys/class/net/tap6def983f-a7/statistics/tx_aborted_errors: Failed to read/parse sysfs file /sys/class/net/tap6def983f-a7/statistics/tx_aborted_errors: stoll Sep 10 21:09:47 devstack quobyte-client[82807]: Failed to parse file /sys/class/net/tap6def983f-a7/statistics/tx_bytes: Failed to read/parse sysfs file /sys/class/net/tap6def983f-a7/statistics/tx_bytes: stoll Sep 10 21:09:47 devstack quobyte-client[82807]: Failed to parse file /sys/class/net/tap6def983f-a7/statistics/tx_carrier_errors: Failed to read/parse sysfs file /sys/class/net/tap6def983f-a7/statistics/tx_carrier_errors: stoll Sep 10 21:09:47 devstack quobyte-client[82807]: Failed to parse file /sys/class/net/tap6def983f-a7/statistics/tx_compressed: Failed to read/parse sysfs file /sys/class/net/tap6def983f-a7/statistics/tx_compressed: stoll Sep 10 21:09:47 devstack quobyte-client[82807]: Failed to parse file /sys/class/net/tap6def983f-a7/statistics/tx_dropped: Failed to read/parse sysfs file /sys/class/net/tap6def983f-a7/statistics/tx_dropped: stoll Sep 10 21:09:47 devstack quobyte-client[82807]: Failed to parse file /sys/class/net/tap6def983f-a7/statistics/tx_errors: Failed to read/parse sysfs file /sys/class/net/tap6def983f-a7/statistics/tx_errors: stoll Sep 10 21:09:47 devstack quobyte-client[82807]: Failed to parse file /sys/class/net/tap6def983f-a7/statistics/tx_fifo_errors: Failed to read/parse sysfs file /sys/class/net/tap6def983f-a7/statistics/tx_fifo_errors: stoll Sep 10 21:09:47 devstack quobyte-client[82807]: Failed to parse file /sys/class/net/tap6def983f-a7/statistics/tx_heartbeat_errors: Failed to read/parse sysfs file /sys/class/net/tap6def983f-a7/statistics/tx_heartbeat_errors: stoll Sep 10 21:09:47 devstack quobyte-client[82807]: Failed to parse file /sys/class/net/tap6def983f-a7/statistics/tx_packets: Failed to read/parse sysfs file /sys/class/net/tap6def983f-a7/statistics/tx_packets: stoll Sep 10 21:09:47 devstack quobyte-client[82807]: Failed to parse file /sys/class/net/tap6def983f-a7/statistics/tx_window_errors: Failed to read/parse sysfs file /sys/class/net/tap6def983f-a7/statistics/tx_window_errors: stoll Sep 10 21:09:47 devstack cinder-volume[82780]: DEBUG cinder.volume.volume_utils [None req-20c5798d-6d14-4395-ab08-916cae4f01c1 tempest-VolumesImageMetadata-1503177403 None] Attempting download of 844acb65-e174-4c79-a335-b56b5bb82298 ((None, None)) to volume d897a5b5-3a8c-47bc-ad00-87b7f681ae6e. {{(pid=82780) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 10 21:09:48 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[99db79bf-d532-4c4c-a789-0826fe63f5a0]: (4, 'raw') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:09:48 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-20c5798d-6d14-4395-ab08-916cae4f01c1 tempest-VolumesImageMetadata-1503177403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_844acb65-e174-4c79-a335-b56b5bb82298_0qh9kf3i {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:09:48 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-20c5798d-6d14-4395-ab08-916cae4f01c1 tempest-VolumesImageMetadata-1503177403 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_844acb65-e174-4c79-a335-b56b5bb82298_0qh9kf3i" returned: 0 in 0.771s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:09:48 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-20c5798d-6d14-4395-ab08-916cae4f01c1 tempest-VolumesImageMetadata-1503177403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_844acb65-e174-4c79-a335-b56b5bb82298_0qh9kf3i {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:09:49 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-20c5798d-6d14-4395-ab08-916cae4f01c1 tempest-VolumesImageMetadata-1503177403 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_844acb65-e174-4c79-a335-b56b5bb82298_0qh9kf3i" returned: 1 in 0.881s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:09:49 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-20c5798d-6d14-4395-ab08-916cae4f01c1 tempest-VolumesImageMetadata-1503177403 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_844acb65-e174-4c79-a335-b56b5bb82298_0qh9kf3i' failed. Not Retrying. {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 21:09:49 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[793cd3d4-a414-4928-836e-3584033d9755]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:09:49 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-20c5798d-6d14-4395-ab08-916cae4f01c1 tempest-VolumesImageMetadata-1503177403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_844acb65-e174-4c79-a335-b56b5bb82298_l8ehbjmadevstack@QuobyteHD {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:09:50 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-20c5798d-6d14-4395-ab08-916cae4f01c1 tempest-VolumesImageMetadata-1503177403 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_844acb65-e174-4c79-a335-b56b5bb82298_l8ehbjmadevstack@QuobyteHD" returned: 0 in 0.764s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:09:50 devstack cinder-volume[82780]: DEBUG cinder.image.image_utils [None req-20c5798d-6d14-4395-ab08-916cae4f01c1 tempest-VolumesImageMetadata-1503177403 None] 844acb65-e174-4c79-a335-b56b5bb82298 was qcow2, converting to raw {{(pid=82780) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 10 21:09:50 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-20c5798d-6d14-4395-ab08-916cae4f01c1 tempest-VolumesImageMetadata-1503177403 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_844acb65-e174-4c79-a335-b56b5bb82298_l8ehbjmadevstack@QuobyteHD /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d897a5b5-3a8c-47bc-ad00-87b7f681ae6e {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:09:51 devstack quobyte-client[82807]: System call of process 87544 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:09:51 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=20, name=volume-d897a5b5-3a8c-47bc-ad00-87b7f681ae6e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:09:52 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-20c5798d-6d14-4395-ab08-916cae4f01c1 tempest-VolumesImageMetadata-1503177403 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_844acb65-e174-4c79-a335-b56b5bb82298_l8ehbjmadevstack@QuobyteHD /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d897a5b5-3a8c-47bc-ad00-87b7f681ae6e" returned: 0 in 1.742s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:09:52 devstack cinder-volume[82780]: DEBUG cinder.image.image_utils [None req-20c5798d-6d14-4395-ab08-916cae4f01c1 tempest-VolumesImageMetadata-1503177403 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_844acb65-e174-4c79-a335-b56b5bb82298_l8ehbjmadevstack@QuobyteHD, size 112.00 MB, duration 1.78 sec, destination /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d897a5b5-3a8c-47bc-ad00-87b7f681ae6e {{(pid=82780) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 10 21:09:52 devstack cinder-volume[82780]: INFO cinder.image.image_utils [None req-20c5798d-6d14-4395-ab08-916cae4f01c1 tempest-VolumesImageMetadata-1503177403 None] Converted 112.00 MB image at 63.00 MB/s Sep 10 21:09:52 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-20c5798d-6d14-4395-ab08-916cae4f01c1 tempest-VolumesImageMetadata-1503177403 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d897a5b5-3a8c-47bc-ad00-87b7f681ae6e 1G {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:09:52 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-20c5798d-6d14-4395-ab08-916cae4f01c1 tempest-VolumesImageMetadata-1503177403 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d897a5b5-3a8c-47bc-ad00-87b7f681ae6e 1G" returned: 0 in 0.185s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:09:52 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[51767db3-85bf-4874-968e-cb95210c88c2]: (4, 'raw') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:09:52 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-20c5798d-6d14-4395-ab08-916cae4f01c1 tempest-VolumesImageMetadata-1503177403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d897a5b5-3a8c-47bc-ad00-87b7f681ae6e {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:09:53 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-20c5798d-6d14-4395-ab08-916cae4f01c1 tempest-VolumesImageMetadata-1503177403 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d897a5b5-3a8c-47bc-ad00-87b7f681ae6e" returned: 0 in 0.374s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:09:53 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-20c5798d-6d14-4395-ab08-916cae4f01c1 tempest-VolumesImageMetadata-1503177403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d897a5b5-3a8c-47bc-ad00-87b7f681ae6e {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:09:53 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-20c5798d-6d14-4395-ab08-916cae4f01c1 tempest-VolumesImageMetadata-1503177403 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d897a5b5-3a8c-47bc-ad00-87b7f681ae6e" returned: 1 in 0.377s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:09:53 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-20c5798d-6d14-4395-ab08-916cae4f01c1 tempest-VolumesImageMetadata-1503177403 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d897a5b5-3a8c-47bc-ad00-87b7f681ae6e' failed. Not Retrying. {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 21:09:53 devstack cinder-volume[82780]: DEBUG cinder.volume.volume_utils [None req-20c5798d-6d14-4395-ab08-916cae4f01c1 tempest-VolumesImageMetadata-1503177403 None] Downloaded image 844acb65-e174-4c79-a335-b56b5bb82298 ((None, None)) to volume d897a5b5-3a8c-47bc-ad00-87b7f681ae6e successfully. {{(pid=82780) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 10 21:09:53 devstack cinder-volume[82780]: DEBUG cinder.image.image_utils [None req-20c5798d-6d14-4395-ab08-916cae4f01c1 tempest-VolumesImageMetadata-1503177403 None] Temporary image 844acb65-e174-4c79-a335-b56b5bb82298 for user 5a478df82b7e41babdd594552d7d0322 is deleted. {{(pid=82780) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 10 21:09:53 devstack cinder-volume[82780]: DEBUG cinder.volume.volume_utils [None req-20c5798d-6d14-4395-ab08-916cae4f01c1 tempest-VolumesImageMetadata-1503177403 None] Marking volume d897a5b5-3a8c-47bc-ad00-87b7f681ae6e as bootable. {{(pid=82780) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 10 21:09:53 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-20c5798d-6d14-4395-ab08-916cae4f01c1 tempest-VolumesImageMetadata-1503177403 None] Copying metadata from image 844acb65-e174-4c79-a335-b56b5bb82298 to d897a5b5-3a8c-47bc-ad00-87b7f681ae6e. {{(pid=82780) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 10 21:09:53 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-20c5798d-6d14-4395-ab08-916cae4f01c1 tempest-VolumesImageMetadata-1503177403 None] Creating volume glance metadata for volume d897a5b5-3a8c-47bc-ad00-87b7f681ae6e backed by image 844acb65-e174-4c79-a335-b56b5bb82298 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '844acb65-e174-4c79-a335-b56b5bb82298', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82780) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 10 21:09:54 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-20c5798d-6d14-4395-ab08-916cae4f01c1 tempest-VolumesImageMetadata-1503177403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43daf523-758b-4126-9726-d9e628e1a047) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d897a5b5-3a8c-47bc-ad00-87b7f681ae6e', 'volume_size': 1, 'image_id': '844acb65-e174-4c79-a335-b56b5bb82298', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2bf6d32ea4d94e048fb27411155cf2e9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '844acb65-e174-4c79-a335-b56b5bb82298', 'created_at': datetime.datetime(2025, 9, 10, 18, 53, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 18, 53, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/844acb65-e174-4c79-a335-b56b5bb82298/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:09:54 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-20c5798d-6d14-4395-ab08-916cae4f01c1 tempest-VolumesImageMetadata-1503177403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74c44058-fcd5-4c0c-a7bd-ba3ca3c3edb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:09:54 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-20c5798d-6d14-4395-ab08-916cae4f01c1 tempest-VolumesImageMetadata-1503177403 None] Volume volume-d897a5b5-3a8c-47bc-ad00-87b7f681ae6e (d897a5b5-3a8c-47bc-ad00-87b7f681ae6e): created successfully Sep 10 21:09:54 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-20c5798d-6d14-4395-ab08-916cae4f01c1 tempest-VolumesImageMetadata-1503177403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74c44058-fcd5-4c0c-a7bd-ba3ca3c3edb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:09:54 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-20c5798d-6d14-4395-ab08-916cae4f01c1 tempest-VolumesImageMetadata-1503177403 None] Flow 'volume_create_manager' (6b34fc70-be51-4d20-a660-88852be86161) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:09:54 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-20c5798d-6d14-4395-ab08-916cae4f01c1 tempest-VolumesImageMetadata-1503177403 None] Created volume successfully. Sep 10 21:09:55 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-b0652366-db47-441a-bd06-1aba0ef54ba2 tempest-VolumesImageMetadata-1503177403 None] Acquiring lock "cinder-d897a5b5-3a8c-47bc-ad00-87b7f681ae6e-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:09:55 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-b0652366-db47-441a-bd06-1aba0ef54ba2 tempest-VolumesImageMetadata-1503177403 None] Lock "cinder-d897a5b5-3a8c-47bc-ad00-87b7f681ae6e-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:09:55 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-b0652366-db47-441a-bd06-1aba0ef54ba2 tempest-VolumesImageMetadata-1503177403 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:09:55 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-b0652366-db47-441a-bd06-1aba0ef54ba2 tempest-VolumesImageMetadata-1503177403 None] Acquiring lock "cinder-quobyte-d897a5b5-3a8c-47bc-ad00-87b7f681ae6e" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:09:55 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-b0652366-db47-441a-bd06-1aba0ef54ba2 tempest-VolumesImageMetadata-1503177403 None] Lock "cinder-quobyte-d897a5b5-3a8c-47bc-ad00-87b7f681ae6e" acquired by "delete_volume" :: waited 0.018s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:09:55 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab17565-1d85-4aed-8d93-466008980dfd]: (4, 'raw') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:09:55 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b0652366-db47-441a-bd06-1aba0ef54ba2 tempest-VolumesImageMetadata-1503177403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d897a5b5-3a8c-47bc-ad00-87b7f681ae6e {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:09:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b0652366-db47-441a-bd06-1aba0ef54ba2 tempest-VolumesImageMetadata-1503177403 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d897a5b5-3a8c-47bc-ad00-87b7f681ae6e" returned: 0 in 0.491s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:09:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b0652366-db47-441a-bd06-1aba0ef54ba2 tempest-VolumesImageMetadata-1503177403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d897a5b5-3a8c-47bc-ad00-87b7f681ae6e {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:09:56 devstack cinder-volume[82780]: DEBUG oslo_service.periodic_task [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82780) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 21:09:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:09:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:09:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:09:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:09:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:09:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:09:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.155s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:09:56 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:09:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b0652366-db47-441a-bd06-1aba0ef54ba2 tempest-VolumesImageMetadata-1503177403 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d897a5b5-3a8c-47bc-ad00-87b7f681ae6e" returned: 1 in 0.731s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:09:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b0652366-db47-441a-bd06-1aba0ef54ba2 tempest-VolumesImageMetadata-1503177403 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d897a5b5-3a8c-47bc-ad00-87b7f681ae6e' failed. Not Retrying. {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 21:09:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b0652366-db47-441a-bd06-1aba0ef54ba2 tempest-VolumesImageMetadata-1503177403 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d897a5b5-3a8c-47bc-ad00-87b7f681ae6e {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:09:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b0652366-db47-441a-bd06-1aba0ef54ba2 tempest-VolumesImageMetadata-1503177403 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d897a5b5-3a8c-47bc-ad00-87b7f681ae6e" returned: 0 in 0.152s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:09:57 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-b0652366-db47-441a-bd06-1aba0ef54ba2 tempest-VolumesImageMetadata-1503177403 None] Lock "cinder-quobyte-d897a5b5-3a8c-47bc-ad00-87b7f681ae6e" released by "delete_volume" :: held 1.704s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:09:57 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-b0652366-db47-441a-bd06-1aba0ef54ba2 tempest-VolumesImageMetadata-1503177403 None] Created reservations ['60ef200d-50cc-4e52-8fc8-9a6f4cadd3d9', '49cf56e7-e10e-447c-92ed-8d8c64b98cce', '5110bf1f-9dd3-4836-8253-9b8355f5c155', 'cc1a97dc-a9d7-4ad4-93f5-5cb178b1e8df'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:09:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-b0652366-db47-441a-bd06-1aba0ef54ba2 tempest-VolumesImageMetadata-1503177403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:09:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-b0652366-db47-441a-bd06-1aba0ef54ba2 tempest-VolumesImageMetadata-1503177403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:09:57 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-b0652366-db47-441a-bd06-1aba0ef54ba2 tempest-VolumesImageMetadata-1503177403 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:09:57 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-b0652366-db47-441a-bd06-1aba0ef54ba2 tempest-VolumesImageMetadata-1503177403 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:09:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-b0652366-db47-441a-bd06-1aba0ef54ba2 tempest-VolumesImageMetadata-1503177403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:09:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b0652366-db47-441a-bd06-1aba0ef54ba2 tempest-VolumesImageMetadata-1503177403 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:09:58 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b0652366-db47-441a-bd06-1aba0ef54ba2 tempest-VolumesImageMetadata-1503177403 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.133s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:09:58 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-b0652366-db47-441a-bd06-1aba0ef54ba2 tempest-VolumesImageMetadata-1503177403 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:09:58 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-b0652366-db47-441a-bd06-1aba0ef54ba2 tempest-VolumesImageMetadata-1503177403 None] Deleted volume successfully. Sep 10 21:09:58 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-b0652366-db47-441a-bd06-1aba0ef54ba2 tempest-VolumesImageMetadata-1503177403 None] Lock "cinder-d897a5b5-3a8c-47bc-ad00-87b7f681ae6e-delete_volume" released by "delete_volume" :: held 2.815s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:09:59 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-e1512bbf-f3e1-4ad2-aff1-b069ffe0e2b5 tempest-TaggedAttachmentsTest-1829613531 None] Acquiring lock "cinder-385526ea-b39f-4919-b353-56e7f269b8e2-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:09:59 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-e1512bbf-f3e1-4ad2-aff1-b069ffe0e2b5 tempest-TaggedAttachmentsTest-1829613531 None] Lock "cinder-385526ea-b39f-4919-b353-56e7f269b8e2-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:09:59 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-e1512bbf-f3e1-4ad2-aff1-b069ffe0e2b5 tempest-TaggedAttachmentsTest-1829613531 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:09:59 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-e1512bbf-f3e1-4ad2-aff1-b069ffe0e2b5 tempest-TaggedAttachmentsTest-1829613531 None] Acquiring lock "cinder-quobyte-385526ea-b39f-4919-b353-56e7f269b8e2" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:09:59 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-e1512bbf-f3e1-4ad2-aff1-b069ffe0e2b5 tempest-TaggedAttachmentsTest-1829613531 None] Lock "cinder-quobyte-385526ea-b39f-4919-b353-56e7f269b8e2" acquired by "delete_volume" :: waited 0.017s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:09:59 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[594e9144-dc72-41fd-9618-a63ff685a3af]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:09:59 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e1512bbf-f3e1-4ad2-aff1-b069ffe0e2b5 tempest-TaggedAttachmentsTest-1829613531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-385526ea-b39f-4919-b353-56e7f269b8e2 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:10:00 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e1512bbf-f3e1-4ad2-aff1-b069ffe0e2b5 tempest-TaggedAttachmentsTest-1829613531 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-385526ea-b39f-4919-b353-56e7f269b8e2" returned: 0 in 0.520s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:10:00 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e1512bbf-f3e1-4ad2-aff1-b069ffe0e2b5 tempest-TaggedAttachmentsTest-1829613531 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-385526ea-b39f-4919-b353-56e7f269b8e2 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:10:00 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e1512bbf-f3e1-4ad2-aff1-b069ffe0e2b5 tempest-TaggedAttachmentsTest-1829613531 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-385526ea-b39f-4919-b353-56e7f269b8e2" returned: 0 in 0.151s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:10:00 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-e1512bbf-f3e1-4ad2-aff1-b069ffe0e2b5 tempest-TaggedAttachmentsTest-1829613531 None] Lock "cinder-quobyte-385526ea-b39f-4919-b353-56e7f269b8e2" released by "delete_volume" :: held 0.904s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:10:00 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-e1512bbf-f3e1-4ad2-aff1-b069ffe0e2b5 tempest-TaggedAttachmentsTest-1829613531 None] Created reservations ['270c2a80-abad-4938-9194-f373af248131', 'e500e34e-25f1-4e97-825b-ceef252f6944', 'a46735be-47d0-42d4-bbfd-1eb993ff9c6f', 'c383b457-a6e2-4789-8d6f-9ed5ec166c37'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:10:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-e1512bbf-f3e1-4ad2-aff1-b069ffe0e2b5 tempest-TaggedAttachmentsTest-1829613531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:10:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-e1512bbf-f3e1-4ad2-aff1-b069ffe0e2b5 tempest-TaggedAttachmentsTest-1829613531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:10:01 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-e1512bbf-f3e1-4ad2-aff1-b069ffe0e2b5 tempest-TaggedAttachmentsTest-1829613531 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:10:01 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-e1512bbf-f3e1-4ad2-aff1-b069ffe0e2b5 tempest-TaggedAttachmentsTest-1829613531 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:10:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-e1512bbf-f3e1-4ad2-aff1-b069ffe0e2b5 tempest-TaggedAttachmentsTest-1829613531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:10:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e1512bbf-f3e1-4ad2-aff1-b069ffe0e2b5 tempest-TaggedAttachmentsTest-1829613531 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:10:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e1512bbf-f3e1-4ad2-aff1-b069ffe0e2b5 tempest-TaggedAttachmentsTest-1829613531 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.131s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:10:01 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-e1512bbf-f3e1-4ad2-aff1-b069ffe0e2b5 tempest-TaggedAttachmentsTest-1829613531 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:10:01 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-e1512bbf-f3e1-4ad2-aff1-b069ffe0e2b5 tempest-TaggedAttachmentsTest-1829613531 None] Deleted volume successfully. Sep 10 21:10:01 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-e1512bbf-f3e1-4ad2-aff1-b069ffe0e2b5 tempest-TaggedAttachmentsTest-1829613531 None] Lock "cinder-385526ea-b39f-4919-b353-56e7f269b8e2-delete_volume" released by "delete_volume" :: held 2.254s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:10:05 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-bc8650eb-5c8a-4801-9541-18efd802a4c8 tempest-AbsoluteLimitsTests-1040832799 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:10:05 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc8650eb-5c8a-4801-9541-18efd802a4c8 tempest-AbsoluteLimitsTests-1040832799 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:10:05 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-bc8650eb-5c8a-4801-9541-18efd802a4c8 tempest-AbsoluteLimitsTests-1040832799 None] Flow 'volume_create_manager' (a1dfbdf5-9b4e-46d5-964a-30fc22130c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:10:05 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-bc8650eb-5c8a-4801-9541-18efd802a4c8 tempest-AbsoluteLimitsTests-1040832799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (562120d2-f5b7-437a-b820-721ce4159979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:10:05 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-bc8650eb-5c8a-4801-9541-18efd802a4c8 tempest-AbsoluteLimitsTests-1040832799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (562120d2-f5b7-437a-b820-721ce4159979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:10:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-328189366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65964e41-13bf-4ae9-9d52-70885d25c535,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c409180ef6d640e9a49bff5863a5c469',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:10:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:10:05Z,use_quota=True,user_id='8dfcc13f984f4a3e96571921a56d7b80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:10:05 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-bc8650eb-5c8a-4801-9541-18efd802a4c8 tempest-AbsoluteLimitsTests-1040832799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b114297f-76ce-4d92-a3d8-5bb7b97cb027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:10:05 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-bc8650eb-5c8a-4801-9541-18efd802a4c8 tempest-AbsoluteLimitsTests-1040832799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b114297f-76ce-4d92-a3d8-5bb7b97cb027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:10:05 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-bc8650eb-5c8a-4801-9541-18efd802a4c8 tempest-AbsoluteLimitsTests-1040832799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cce3dc8-aad3-46da-b283-8fc8122e5ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:10:05 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-bc8650eb-5c8a-4801-9541-18efd802a4c8 tempest-AbsoluteLimitsTests-1040832799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cce3dc8-aad3-46da-b283-8fc8122e5ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65964e41-13bf-4ae9-9d52-70885d25c535', 'volume_name': 'volume-65964e41-13bf-4ae9-9d52-70885d25c535', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:10:05 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-bc8650eb-5c8a-4801-9541-18efd802a4c8 tempest-AbsoluteLimitsTests-1040832799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (197b5f62-9372-46ec-85b9-1fb26dc0c86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:10:05 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-bc8650eb-5c8a-4801-9541-18efd802a4c8 tempest-AbsoluteLimitsTests-1040832799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (197b5f62-9372-46ec-85b9-1fb26dc0c86f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:10:05 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-bc8650eb-5c8a-4801-9541-18efd802a4c8 tempest-AbsoluteLimitsTests-1040832799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (045fca0d-5820-4711-9917-7405f9fa54b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:10:05 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-bc8650eb-5c8a-4801-9541-18efd802a4c8 tempest-AbsoluteLimitsTests-1040832799 None] Volume 65964e41-13bf-4ae9-9d52-70885d25c535: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65964e41-13bf-4ae9-9d52-70885d25c535', 'volume_size': 1} Sep 10 21:10:05 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-bc8650eb-5c8a-4801-9541-18efd802a4c8 tempest-AbsoluteLimitsTests-1040832799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:10:05 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-bc8650eb-5c8a-4801-9541-18efd802a4c8 tempest-AbsoluteLimitsTests-1040832799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:10:05 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-bc8650eb-5c8a-4801-9541-18efd802a4c8 tempest-AbsoluteLimitsTests-1040832799 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:10:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-328189366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65964e41-13bf-4ae9-9d52-70885d25c535,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c409180ef6d640e9a49bff5863a5c469',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:10:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:10:05Z,use_quota=True,user_id='8dfcc13f984f4a3e96571921a56d7b80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:10:05 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-bc8650eb-5c8a-4801-9541-18efd802a4c8 tempest-AbsoluteLimitsTests-1040832799 None] Creating volume 65964e41-13bf-4ae9-9d52-70885d25c535 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:10:05 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-bc8650eb-5c8a-4801-9541-18efd802a4c8 tempest-AbsoluteLimitsTests-1040832799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:10:05 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-bc8650eb-5c8a-4801-9541-18efd802a4c8 tempest-AbsoluteLimitsTests-1040832799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:10:05 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-bc8650eb-5c8a-4801-9541-18efd802a4c8 tempest-AbsoluteLimitsTests-1040832799 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:10:05 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-bc8650eb-5c8a-4801-9541-18efd802a4c8 tempest-AbsoluteLimitsTests-1040832799 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:10:05 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-bc8650eb-5c8a-4801-9541-18efd802a4c8 tempest-AbsoluteLimitsTests-1040832799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:10:05 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-bc8650eb-5c8a-4801-9541-18efd802a4c8 tempest-AbsoluteLimitsTests-1040832799 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:10:05 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-bc8650eb-5c8a-4801-9541-18efd802a4c8 tempest-AbsoluteLimitsTests-1040832799 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:10:05 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-bc8650eb-5c8a-4801-9541-18efd802a4c8 tempest-AbsoluteLimitsTests-1040832799 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-65964e41-13bf-4ae9-9d52-70885d25c535 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:10:05 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=21, name=volume-65964e41-13bf-4ae9-9d52-70885d25c535, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:10:06 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-bc8650eb-5c8a-4801-9541-18efd802a4c8 tempest-AbsoluteLimitsTests-1040832799 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-65964e41-13bf-4ae9-9d52-70885d25c535 1073741824" returned: 0 in 0.506s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:10:06 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-bc8650eb-5c8a-4801-9541-18efd802a4c8 tempest-AbsoluteLimitsTests-1040832799 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-65964e41-13bf-4ae9-9d52-70885d25c535 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:10:06 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-bc8650eb-5c8a-4801-9541-18efd802a4c8 tempest-AbsoluteLimitsTests-1040832799 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-65964e41-13bf-4ae9-9d52-70885d25c535" returned: 0 in 0.247s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:10:06 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-bc8650eb-5c8a-4801-9541-18efd802a4c8 tempest-AbsoluteLimitsTests-1040832799 None] <== create_volume: return (988ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:10:06 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-bc8650eb-5c8a-4801-9541-18efd802a4c8 tempest-AbsoluteLimitsTests-1040832799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:10:06 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-bc8650eb-5c8a-4801-9541-18efd802a4c8 tempest-AbsoluteLimitsTests-1040832799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (045fca0d-5820-4711-9917-7405f9fa54b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65964e41-13bf-4ae9-9d52-70885d25c535', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:10:06 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-bc8650eb-5c8a-4801-9541-18efd802a4c8 tempest-AbsoluteLimitsTests-1040832799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04cae124-46cf-4986-854c-51048900facb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:10:06 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-bc8650eb-5c8a-4801-9541-18efd802a4c8 tempest-AbsoluteLimitsTests-1040832799 None] Volume volume-65964e41-13bf-4ae9-9d52-70885d25c535 (65964e41-13bf-4ae9-9d52-70885d25c535): created successfully Sep 10 21:10:06 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-bc8650eb-5c8a-4801-9541-18efd802a4c8 tempest-AbsoluteLimitsTests-1040832799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04cae124-46cf-4986-854c-51048900facb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:10:06 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-bc8650eb-5c8a-4801-9541-18efd802a4c8 tempest-AbsoluteLimitsTests-1040832799 None] Flow 'volume_create_manager' (a1dfbdf5-9b4e-46d5-964a-30fc22130c69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:10:06 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-bc8650eb-5c8a-4801-9541-18efd802a4c8 tempest-AbsoluteLimitsTests-1040832799 None] Created volume successfully. Sep 10 21:10:07 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-f3e3f456-c35b-4aa6-881a-bf4135e2cc0d tempest-AbsoluteLimitsTests-1040832799 None] Acquiring lock "cinder-65964e41-13bf-4ae9-9d52-70885d25c535-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:10:07 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-f3e3f456-c35b-4aa6-881a-bf4135e2cc0d tempest-AbsoluteLimitsTests-1040832799 None] Lock "cinder-65964e41-13bf-4ae9-9d52-70885d25c535-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:10:08 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-f3e3f456-c35b-4aa6-881a-bf4135e2cc0d tempest-AbsoluteLimitsTests-1040832799 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:10:08 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-f3e3f456-c35b-4aa6-881a-bf4135e2cc0d tempest-AbsoluteLimitsTests-1040832799 None] Acquiring lock "cinder-quobyte-65964e41-13bf-4ae9-9d52-70885d25c535" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:10:08 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-f3e3f456-c35b-4aa6-881a-bf4135e2cc0d tempest-AbsoluteLimitsTests-1040832799 None] Lock "cinder-quobyte-65964e41-13bf-4ae9-9d52-70885d25c535" acquired by "delete_volume" :: waited 0.016s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:10:08 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d2a6b0-6d6c-43ab-a2c7-f1a049a6ad35]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:10:08 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f3e3f456-c35b-4aa6-881a-bf4135e2cc0d tempest-AbsoluteLimitsTests-1040832799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-65964e41-13bf-4ae9-9d52-70885d25c535 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:10:08 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f3e3f456-c35b-4aa6-881a-bf4135e2cc0d tempest-AbsoluteLimitsTests-1040832799 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-65964e41-13bf-4ae9-9d52-70885d25c535" returned: 0 in 0.803s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:10:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f3e3f456-c35b-4aa6-881a-bf4135e2cc0d tempest-AbsoluteLimitsTests-1040832799 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-65964e41-13bf-4ae9-9d52-70885d25c535 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:10:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f3e3f456-c35b-4aa6-881a-bf4135e2cc0d tempest-AbsoluteLimitsTests-1040832799 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-65964e41-13bf-4ae9-9d52-70885d25c535" returned: 0 in 0.258s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:10:09 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-f3e3f456-c35b-4aa6-881a-bf4135e2cc0d tempest-AbsoluteLimitsTests-1040832799 None] Lock "cinder-quobyte-65964e41-13bf-4ae9-9d52-70885d25c535" released by "delete_volume" :: held 1.374s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:10:09 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-f3e3f456-c35b-4aa6-881a-bf4135e2cc0d tempest-AbsoluteLimitsTests-1040832799 None] Created reservations ['524d9f87-32b3-4535-8848-7c0ecc530c1d', 'fc3cfe77-2608-41fe-91d1-bb9f3ab46b3c', 'b6e3f215-0246-43be-9410-2896369f6f79', '22593818-4189-4a9f-8d0d-9ebe6cc46e72'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:10:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-f3e3f456-c35b-4aa6-881a-bf4135e2cc0d tempest-AbsoluteLimitsTests-1040832799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:10:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-f3e3f456-c35b-4aa6-881a-bf4135e2cc0d tempest-AbsoluteLimitsTests-1040832799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:10:09 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-f3e3f456-c35b-4aa6-881a-bf4135e2cc0d tempest-AbsoluteLimitsTests-1040832799 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:10:09 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-f3e3f456-c35b-4aa6-881a-bf4135e2cc0d tempest-AbsoluteLimitsTests-1040832799 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:10:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-f3e3f456-c35b-4aa6-881a-bf4135e2cc0d tempest-AbsoluteLimitsTests-1040832799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:10:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f3e3f456-c35b-4aa6-881a-bf4135e2cc0d tempest-AbsoluteLimitsTests-1040832799 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:10:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f3e3f456-c35b-4aa6-881a-bf4135e2cc0d tempest-AbsoluteLimitsTests-1040832799 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.218s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:10:10 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-f3e3f456-c35b-4aa6-881a-bf4135e2cc0d tempest-AbsoluteLimitsTests-1040832799 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:10:10 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-f3e3f456-c35b-4aa6-881a-bf4135e2cc0d tempest-AbsoluteLimitsTests-1040832799 None] Deleted volume successfully. Sep 10 21:10:10 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-f3e3f456-c35b-4aa6-881a-bf4135e2cc0d tempest-AbsoluteLimitsTests-1040832799 None] Lock "cinder-65964e41-13bf-4ae9-9d52-70885d25c535-delete_volume" released by "delete_volume" :: held 2.755s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:10:13 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-a9139c91-1f03-494d-a00b-e0b2916a7b13 tempest-AttachVolumeShelveTestJSON-724512628 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:10:13 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9139c91-1f03-494d-a00b-e0b2916a7b13 tempest-AttachVolumeShelveTestJSON-724512628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:10:14 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-a9139c91-1f03-494d-a00b-e0b2916a7b13 tempest-AttachVolumeShelveTestJSON-724512628 None] Flow 'volume_create_manager' (e310aaa5-3c7d-4fb3-9f27-b7de5ab76c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:10:14 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-a9139c91-1f03-494d-a00b-e0b2916a7b13 tempest-AttachVolumeShelveTestJSON-724512628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9bbd186-a374-43d5-bd53-a021f775b843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:10:14 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-a9139c91-1f03-494d-a00b-e0b2916a7b13 tempest-AttachVolumeShelveTestJSON-724512628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9bbd186-a374-43d5-bd53-a021f775b843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:10:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-312636925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dcc93b5-fc71-40f0-bdb1-84076e8851c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06ae1def70ed442192bcf8ca613309fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:10:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:10:13Z,use_quota=True,user_id='1462b8525363425e8a3614d59533c5a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:10:14 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-a9139c91-1f03-494d-a00b-e0b2916a7b13 tempest-AttachVolumeShelveTestJSON-724512628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45e698ea-3321-4098-a244-f3f4968e9340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:10:14 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-a9139c91-1f03-494d-a00b-e0b2916a7b13 tempest-AttachVolumeShelveTestJSON-724512628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45e698ea-3321-4098-a244-f3f4968e9340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:10:14 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-a9139c91-1f03-494d-a00b-e0b2916a7b13 tempest-AttachVolumeShelveTestJSON-724512628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8049e118-acfd-4be3-b850-595964a3c4ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:10:14 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-a9139c91-1f03-494d-a00b-e0b2916a7b13 tempest-AttachVolumeShelveTestJSON-724512628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8049e118-acfd-4be3-b850-595964a3c4ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2dcc93b5-fc71-40f0-bdb1-84076e8851c5', 'volume_name': 'volume-2dcc93b5-fc71-40f0-bdb1-84076e8851c5', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:10:14 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-a9139c91-1f03-494d-a00b-e0b2916a7b13 tempest-AttachVolumeShelveTestJSON-724512628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d22aaf56-55f8-4671-b4e6-9037fd4e9e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:10:14 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-a9139c91-1f03-494d-a00b-e0b2916a7b13 tempest-AttachVolumeShelveTestJSON-724512628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d22aaf56-55f8-4671-b4e6-9037fd4e9e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:10:14 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-a9139c91-1f03-494d-a00b-e0b2916a7b13 tempest-AttachVolumeShelveTestJSON-724512628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (689ae27d-c7a6-42ae-886b-2dc0866cc1de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:10:14 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-a9139c91-1f03-494d-a00b-e0b2916a7b13 tempest-AttachVolumeShelveTestJSON-724512628 None] Volume 2dcc93b5-fc71-40f0-bdb1-84076e8851c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2dcc93b5-fc71-40f0-bdb1-84076e8851c5', 'volume_size': 1} Sep 10 21:10:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a9139c91-1f03-494d-a00b-e0b2916a7b13 tempest-AttachVolumeShelveTestJSON-724512628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:10:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a9139c91-1f03-494d-a00b-e0b2916a7b13 tempest-AttachVolumeShelveTestJSON-724512628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:10:14 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a9139c91-1f03-494d-a00b-e0b2916a7b13 tempest-AttachVolumeShelveTestJSON-724512628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:10:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-312636925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dcc93b5-fc71-40f0-bdb1-84076e8851c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06ae1def70ed442192bcf8ca613309fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:10:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:10:13Z,use_quota=True,user_id='1462b8525363425e8a3614d59533c5a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:10:14 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-a9139c91-1f03-494d-a00b-e0b2916a7b13 tempest-AttachVolumeShelveTestJSON-724512628 None] Creating volume 2dcc93b5-fc71-40f0-bdb1-84076e8851c5 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:10:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a9139c91-1f03-494d-a00b-e0b2916a7b13 tempest-AttachVolumeShelveTestJSON-724512628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:10:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a9139c91-1f03-494d-a00b-e0b2916a7b13 tempest-AttachVolumeShelveTestJSON-724512628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:10:14 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a9139c91-1f03-494d-a00b-e0b2916a7b13 tempest-AttachVolumeShelveTestJSON-724512628 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:10:14 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a9139c91-1f03-494d-a00b-e0b2916a7b13 tempest-AttachVolumeShelveTestJSON-724512628 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:10:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a9139c91-1f03-494d-a00b-e0b2916a7b13 tempest-AttachVolumeShelveTestJSON-724512628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:10:14 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a9139c91-1f03-494d-a00b-e0b2916a7b13 tempest-AttachVolumeShelveTestJSON-724512628 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:10:14 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-a9139c91-1f03-494d-a00b-e0b2916a7b13 tempest-AttachVolumeShelveTestJSON-724512628 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:10:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a9139c91-1f03-494d-a00b-e0b2916a7b13 tempest-AttachVolumeShelveTestJSON-724512628 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-2dcc93b5-fc71-40f0-bdb1-84076e8851c5 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:10:14 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=22, name=volume-2dcc93b5-fc71-40f0-bdb1-84076e8851c5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:10:15 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a9139c91-1f03-494d-a00b-e0b2916a7b13 tempest-AttachVolumeShelveTestJSON-724512628 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-2dcc93b5-fc71-40f0-bdb1-84076e8851c5 1073741824" returned: 0 in 0.724s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:10:15 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a9139c91-1f03-494d-a00b-e0b2916a7b13 tempest-AttachVolumeShelveTestJSON-724512628 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-2dcc93b5-fc71-40f0-bdb1-84076e8851c5 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:10:15 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a9139c91-1f03-494d-a00b-e0b2916a7b13 tempest-AttachVolumeShelveTestJSON-724512628 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-2dcc93b5-fc71-40f0-bdb1-84076e8851c5" returned: 0 in 0.222s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:10:15 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a9139c91-1f03-494d-a00b-e0b2916a7b13 tempest-AttachVolumeShelveTestJSON-724512628 None] <== create_volume: return (1102ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:10:15 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a9139c91-1f03-494d-a00b-e0b2916a7b13 tempest-AttachVolumeShelveTestJSON-724512628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:10:15 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-a9139c91-1f03-494d-a00b-e0b2916a7b13 tempest-AttachVolumeShelveTestJSON-724512628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (689ae27d-c7a6-42ae-886b-2dc0866cc1de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dcc93b5-fc71-40f0-bdb1-84076e8851c5', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:10:15 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-a9139c91-1f03-494d-a00b-e0b2916a7b13 tempest-AttachVolumeShelveTestJSON-724512628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6119b64b-93a3-4fa5-80b1-b7a7af689e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:10:15 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-a9139c91-1f03-494d-a00b-e0b2916a7b13 tempest-AttachVolumeShelveTestJSON-724512628 None] Volume volume-2dcc93b5-fc71-40f0-bdb1-84076e8851c5 (2dcc93b5-fc71-40f0-bdb1-84076e8851c5): created successfully Sep 10 21:10:15 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-a9139c91-1f03-494d-a00b-e0b2916a7b13 tempest-AttachVolumeShelveTestJSON-724512628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6119b64b-93a3-4fa5-80b1-b7a7af689e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:10:16 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-a9139c91-1f03-494d-a00b-e0b2916a7b13 tempest-AttachVolumeShelveTestJSON-724512628 None] Flow 'volume_create_manager' (e310aaa5-3c7d-4fb3-9f27-b7de5ab76c05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:10:16 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-a9139c91-1f03-494d-a00b-e0b2916a7b13 tempest-AttachVolumeShelveTestJSON-724512628 None] Created volume successfully. Sep 10 21:10:21 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-a087e8b0-59be-4a0a-bc08-e16166ae2a87 tempest-VolumesTransfersV357Test-2098359214 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:10:21 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-a087e8b0-59be-4a0a-bc08-e16166ae2a87 tempest-VolumesTransfersV357Test-2098359214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:10:22 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-a087e8b0-59be-4a0a-bc08-e16166ae2a87 tempest-VolumesTransfersV357Test-2098359214 None] Flow 'volume_create_manager' (5b8aac44-0299-40a8-865c-e2434c832786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:10:22 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-a087e8b0-59be-4a0a-bc08-e16166ae2a87 tempest-VolumesTransfersV357Test-2098359214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b82a542-e0f1-4fe6-a7d6-9c60f27ee33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:10:22 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-a087e8b0-59be-4a0a-bc08-e16166ae2a87 tempest-VolumesTransfersV357Test-2098359214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b82a542-e0f1-4fe6-a7d6-9c60f27ee33a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:10:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1554155282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eb24ee9-0e62-479d-ad53-e14ca7f9022f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a010cf317200495c815cf0fd99166c0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:10:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:10:22Z,use_quota=True,user_id='c47a1af617a54462a74fb9c647a27698',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:10:22 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-a087e8b0-59be-4a0a-bc08-e16166ae2a87 tempest-VolumesTransfersV357Test-2098359214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8b0e08a-b0fa-4a50-8ac0-184c0ba0bc38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:10:22 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-a087e8b0-59be-4a0a-bc08-e16166ae2a87 tempest-VolumesTransfersV357Test-2098359214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8b0e08a-b0fa-4a50-8ac0-184c0ba0bc38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:10:22 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-a087e8b0-59be-4a0a-bc08-e16166ae2a87 tempest-VolumesTransfersV357Test-2098359214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ced0752e-11dc-4d20-b2d2-a5c0b67784d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:10:22 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-a087e8b0-59be-4a0a-bc08-e16166ae2a87 tempest-VolumesTransfersV357Test-2098359214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ced0752e-11dc-4d20-b2d2-a5c0b67784d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5eb24ee9-0e62-479d-ad53-e14ca7f9022f', 'volume_name': 'volume-5eb24ee9-0e62-479d-ad53-e14ca7f9022f', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:10:22 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-a087e8b0-59be-4a0a-bc08-e16166ae2a87 tempest-VolumesTransfersV357Test-2098359214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9967dd8-adcd-44c3-8ab4-c621f0f93873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:10:22 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-a087e8b0-59be-4a0a-bc08-e16166ae2a87 tempest-VolumesTransfersV357Test-2098359214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9967dd8-adcd-44c3-8ab4-c621f0f93873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:10:22 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-a087e8b0-59be-4a0a-bc08-e16166ae2a87 tempest-VolumesTransfersV357Test-2098359214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da12c064-1cf0-404f-bbbd-037a7460876a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:10:22 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-a087e8b0-59be-4a0a-bc08-e16166ae2a87 tempest-VolumesTransfersV357Test-2098359214 None] Volume 5eb24ee9-0e62-479d-ad53-e14ca7f9022f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5eb24ee9-0e62-479d-ad53-e14ca7f9022f', 'volume_size': 1} Sep 10 21:10:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a087e8b0-59be-4a0a-bc08-e16166ae2a87 tempest-VolumesTransfersV357Test-2098359214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:10:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a087e8b0-59be-4a0a-bc08-e16166ae2a87 tempest-VolumesTransfersV357Test-2098359214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.052s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:10:22 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a087e8b0-59be-4a0a-bc08-e16166ae2a87 tempest-VolumesTransfersV357Test-2098359214 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:10:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1554155282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eb24ee9-0e62-479d-ad53-e14ca7f9022f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a010cf317200495c815cf0fd99166c0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:10:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:10:22Z,use_quota=True,user_id='c47a1af617a54462a74fb9c647a27698',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:10:22 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-a087e8b0-59be-4a0a-bc08-e16166ae2a87 tempest-VolumesTransfersV357Test-2098359214 None] Creating volume 5eb24ee9-0e62-479d-ad53-e14ca7f9022f {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:10:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a087e8b0-59be-4a0a-bc08-e16166ae2a87 tempest-VolumesTransfersV357Test-2098359214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:10:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a087e8b0-59be-4a0a-bc08-e16166ae2a87 tempest-VolumesTransfersV357Test-2098359214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.037s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:10:22 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a087e8b0-59be-4a0a-bc08-e16166ae2a87 tempest-VolumesTransfersV357Test-2098359214 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:10:22 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a087e8b0-59be-4a0a-bc08-e16166ae2a87 tempest-VolumesTransfersV357Test-2098359214 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:10:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a087e8b0-59be-4a0a-bc08-e16166ae2a87 tempest-VolumesTransfersV357Test-2098359214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.110s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:10:22 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a087e8b0-59be-4a0a-bc08-e16166ae2a87 tempest-VolumesTransfersV357Test-2098359214 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:10:22 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-a087e8b0-59be-4a0a-bc08-e16166ae2a87 tempest-VolumesTransfersV357Test-2098359214 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:10:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a087e8b0-59be-4a0a-bc08-e16166ae2a87 tempest-VolumesTransfersV357Test-2098359214 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5eb24ee9-0e62-479d-ad53-e14ca7f9022f 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:10:22 devstack quobyte-client[82807]: System call of process 87711 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:10:22 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=23, name=volume-5eb24ee9-0e62-479d-ad53-e14ca7f9022f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:10:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a087e8b0-59be-4a0a-bc08-e16166ae2a87 tempest-VolumesTransfersV357Test-2098359214 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5eb24ee9-0e62-479d-ad53-e14ca7f9022f 1073741824" returned: 0 in 0.579s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:10:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a087e8b0-59be-4a0a-bc08-e16166ae2a87 tempest-VolumesTransfersV357Test-2098359214 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5eb24ee9-0e62-479d-ad53-e14ca7f9022f {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:10:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a087e8b0-59be-4a0a-bc08-e16166ae2a87 tempest-VolumesTransfersV357Test-2098359214 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5eb24ee9-0e62-479d-ad53-e14ca7f9022f" returned: 0 in 0.187s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:10:23 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a087e8b0-59be-4a0a-bc08-e16166ae2a87 tempest-VolumesTransfersV357Test-2098359214 None] <== create_volume: return (1074ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:10:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a087e8b0-59be-4a0a-bc08-e16166ae2a87 tempest-VolumesTransfersV357Test-2098359214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:10:23 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-a087e8b0-59be-4a0a-bc08-e16166ae2a87 tempest-VolumesTransfersV357Test-2098359214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da12c064-1cf0-404f-bbbd-037a7460876a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5eb24ee9-0e62-479d-ad53-e14ca7f9022f', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:10:23 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-a087e8b0-59be-4a0a-bc08-e16166ae2a87 tempest-VolumesTransfersV357Test-2098359214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3c107c2-e405-4360-925b-f7c783d9ad60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:10:23 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-a087e8b0-59be-4a0a-bc08-e16166ae2a87 tempest-VolumesTransfersV357Test-2098359214 None] Volume volume-5eb24ee9-0e62-479d-ad53-e14ca7f9022f (5eb24ee9-0e62-479d-ad53-e14ca7f9022f): created successfully Sep 10 21:10:23 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-a087e8b0-59be-4a0a-bc08-e16166ae2a87 tempest-VolumesTransfersV357Test-2098359214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3c107c2-e405-4360-925b-f7c783d9ad60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:10:23 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-a087e8b0-59be-4a0a-bc08-e16166ae2a87 tempest-VolumesTransfersV357Test-2098359214 None] Flow 'volume_create_manager' (5b8aac44-0299-40a8-865c-e2434c832786) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:10:24 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-a087e8b0-59be-4a0a-bc08-e16166ae2a87 tempest-VolumesTransfersV357Test-2098359214 None] Created volume successfully. Sep 10 21:10:26 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-95819c70-62ac-4e4b-8fca-9c1287f95f78 tempest-VolumesTransfersV357Test-1553948817 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:10:26 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-95819c70-62ac-4e4b-8fca-9c1287f95f78 tempest-VolumesTransfersV357Test-1553948817 None] Transfer volume completed successfully. Sep 10 21:10:28 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-d409795d-4980-42f1-9879-46f9d56c0995 tempest-VolumesTransfersV357Test-1482116352 None] Acquiring lock "cinder-5eb24ee9-0e62-479d-ad53-e14ca7f9022f-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:10:28 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-d409795d-4980-42f1-9879-46f9d56c0995 tempest-VolumesTransfersV357Test-1482116352 None] Lock "cinder-5eb24ee9-0e62-479d-ad53-e14ca7f9022f-delete_volume" acquired by "delete_volume" :: waited 0.131s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:10:28 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-d409795d-4980-42f1-9879-46f9d56c0995 tempest-VolumesTransfersV357Test-1482116352 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:10:28 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-d409795d-4980-42f1-9879-46f9d56c0995 tempest-VolumesTransfersV357Test-1482116352 None] Acquiring lock "cinder-quobyte-5eb24ee9-0e62-479d-ad53-e14ca7f9022f" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:10:28 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-d409795d-4980-42f1-9879-46f9d56c0995 tempest-VolumesTransfersV357Test-1482116352 None] Lock "cinder-quobyte-5eb24ee9-0e62-479d-ad53-e14ca7f9022f" acquired by "delete_volume" :: waited 0.018s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:10:28 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[874673c1-7ca4-481a-ad8f-09ae1ee74c6d]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:10:28 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-d409795d-4980-42f1-9879-46f9d56c0995 tempest-VolumesTransfersV357Test-1482116352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5eb24ee9-0e62-479d-ad53-e14ca7f9022f {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:10:29 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-d409795d-4980-42f1-9879-46f9d56c0995 tempest-VolumesTransfersV357Test-1482116352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5eb24ee9-0e62-479d-ad53-e14ca7f9022f" returned: 0 in 0.552s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:10:29 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-d409795d-4980-42f1-9879-46f9d56c0995 tempest-VolumesTransfersV357Test-1482116352 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5eb24ee9-0e62-479d-ad53-e14ca7f9022f {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:10:29 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-d409795d-4980-42f1-9879-46f9d56c0995 tempest-VolumesTransfersV357Test-1482116352 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5eb24ee9-0e62-479d-ad53-e14ca7f9022f" returned: 0 in 0.194s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:10:29 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-d409795d-4980-42f1-9879-46f9d56c0995 tempest-VolumesTransfersV357Test-1482116352 None] Lock "cinder-quobyte-5eb24ee9-0e62-479d-ad53-e14ca7f9022f" released by "delete_volume" :: held 0.941s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:10:30 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-d409795d-4980-42f1-9879-46f9d56c0995 tempest-VolumesTransfersV357Test-1482116352 None] Created reservations ['7b2ed498-fb1c-46ba-a86b-3e5799c5367d', '6788632f-bf97-4160-a4f7-c94b4bbfb97e', 'ddce7b8a-1168-4b77-8f76-e1e26e892b44', '07b9f57d-131a-4db4-a4cd-dce12807f6b4'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:10:30 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-d409795d-4980-42f1-9879-46f9d56c0995 tempest-VolumesTransfersV357Test-1482116352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:10:30 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-d409795d-4980-42f1-9879-46f9d56c0995 tempest-VolumesTransfersV357Test-1482116352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:10:30 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-d409795d-4980-42f1-9879-46f9d56c0995 tempest-VolumesTransfersV357Test-1482116352 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:10:30 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-d409795d-4980-42f1-9879-46f9d56c0995 tempest-VolumesTransfersV357Test-1482116352 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:10:30 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-d409795d-4980-42f1-9879-46f9d56c0995 tempest-VolumesTransfersV357Test-1482116352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:10:30 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-d409795d-4980-42f1-9879-46f9d56c0995 tempest-VolumesTransfersV357Test-1482116352 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:10:30 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-d409795d-4980-42f1-9879-46f9d56c0995 tempest-VolumesTransfersV357Test-1482116352 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.185s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:10:30 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-d409795d-4980-42f1-9879-46f9d56c0995 tempest-VolumesTransfersV357Test-1482116352 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:10:30 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-d409795d-4980-42f1-9879-46f9d56c0995 tempest-VolumesTransfersV357Test-1482116352 None] Deleted volume successfully. Sep 10 21:10:30 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-d409795d-4980-42f1-9879-46f9d56c0995 tempest-VolumesTransfersV357Test-1482116352 None] Lock "cinder-5eb24ee9-0e62-479d-ad53-e14ca7f9022f-delete_volume" released by "delete_volume" :: held 2.303s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:10:31 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-fb85253a-fcbf-4ae8-82ba-9f362b96b6d4 tempest-VolumesTransfersV357Test-2098359214 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:10:31 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb85253a-fcbf-4ae8-82ba-9f362b96b6d4 tempest-VolumesTransfersV357Test-2098359214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:10:31 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fb85253a-fcbf-4ae8-82ba-9f362b96b6d4 tempest-VolumesTransfersV357Test-2098359214 None] Flow 'volume_create_manager' (7906bd46-7469-4dd8-89da-15a8b2e55bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:10:31 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fb85253a-fcbf-4ae8-82ba-9f362b96b6d4 tempest-VolumesTransfersV357Test-2098359214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8175f91-a990-463f-9983-1ccf09d69ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:10:31 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fb85253a-fcbf-4ae8-82ba-9f362b96b6d4 tempest-VolumesTransfersV357Test-2098359214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8175f91-a990-463f-9983-1ccf09d69ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:10:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-56938406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3499021b-05a9-41f5-afd9-1488868e985e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a010cf317200495c815cf0fd99166c0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:10:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:10:31Z,use_quota=True,user_id='c47a1af617a54462a74fb9c647a27698',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:10:31 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fb85253a-fcbf-4ae8-82ba-9f362b96b6d4 tempest-VolumesTransfersV357Test-2098359214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93b5217d-fe66-464f-9767-70e7287af41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:10:31 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fb85253a-fcbf-4ae8-82ba-9f362b96b6d4 tempest-VolumesTransfersV357Test-2098359214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93b5217d-fe66-464f-9767-70e7287af41c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:10:31 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fb85253a-fcbf-4ae8-82ba-9f362b96b6d4 tempest-VolumesTransfersV357Test-2098359214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e91a3b35-6ad1-48be-98f2-91c92faa2f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:10:31 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fb85253a-fcbf-4ae8-82ba-9f362b96b6d4 tempest-VolumesTransfersV357Test-2098359214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e91a3b35-6ad1-48be-98f2-91c92faa2f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3499021b-05a9-41f5-afd9-1488868e985e', 'volume_name': 'volume-3499021b-05a9-41f5-afd9-1488868e985e', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:10:31 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fb85253a-fcbf-4ae8-82ba-9f362b96b6d4 tempest-VolumesTransfersV357Test-2098359214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22e1bb6d-b348-40f7-8f69-8b1b2f47cb95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:10:31 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fb85253a-fcbf-4ae8-82ba-9f362b96b6d4 tempest-VolumesTransfersV357Test-2098359214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22e1bb6d-b348-40f7-8f69-8b1b2f47cb95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:10:31 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fb85253a-fcbf-4ae8-82ba-9f362b96b6d4 tempest-VolumesTransfersV357Test-2098359214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1659123e-8e89-49cc-932b-0c0e58a1d6f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:10:31 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-fb85253a-fcbf-4ae8-82ba-9f362b96b6d4 tempest-VolumesTransfersV357Test-2098359214 None] Volume 3499021b-05a9-41f5-afd9-1488868e985e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3499021b-05a9-41f5-afd9-1488868e985e', 'volume_size': 1} Sep 10 21:10:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-fb85253a-fcbf-4ae8-82ba-9f362b96b6d4 tempest-VolumesTransfersV357Test-2098359214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:10:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-fb85253a-fcbf-4ae8-82ba-9f362b96b6d4 tempest-VolumesTransfersV357Test-2098359214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:10:31 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-fb85253a-fcbf-4ae8-82ba-9f362b96b6d4 tempest-VolumesTransfersV357Test-2098359214 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:10:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-56938406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3499021b-05a9-41f5-afd9-1488868e985e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a010cf317200495c815cf0fd99166c0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:10:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:10:31Z,use_quota=True,user_id='c47a1af617a54462a74fb9c647a27698',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:10:31 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-fb85253a-fcbf-4ae8-82ba-9f362b96b6d4 tempest-VolumesTransfersV357Test-2098359214 None] Creating volume 3499021b-05a9-41f5-afd9-1488868e985e {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:10:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-fb85253a-fcbf-4ae8-82ba-9f362b96b6d4 tempest-VolumesTransfersV357Test-2098359214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:10:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-fb85253a-fcbf-4ae8-82ba-9f362b96b6d4 tempest-VolumesTransfersV357Test-2098359214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:10:31 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-fb85253a-fcbf-4ae8-82ba-9f362b96b6d4 tempest-VolumesTransfersV357Test-2098359214 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:10:31 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-fb85253a-fcbf-4ae8-82ba-9f362b96b6d4 tempest-VolumesTransfersV357Test-2098359214 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:10:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-fb85253a-fcbf-4ae8-82ba-9f362b96b6d4 tempest-VolumesTransfersV357Test-2098359214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:10:31 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-fb85253a-fcbf-4ae8-82ba-9f362b96b6d4 tempest-VolumesTransfersV357Test-2098359214 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:10:31 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-fb85253a-fcbf-4ae8-82ba-9f362b96b6d4 tempest-VolumesTransfersV357Test-2098359214 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:10:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-fb85253a-fcbf-4ae8-82ba-9f362b96b6d4 tempest-VolumesTransfersV357Test-2098359214 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3499021b-05a9-41f5-afd9-1488868e985e 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:10:31 devstack quobyte-client[82807]: System call of process 87735 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:10:31 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=24, name=volume-3499021b-05a9-41f5-afd9-1488868e985e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:10:32 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-fb85253a-fcbf-4ae8-82ba-9f362b96b6d4 tempest-VolumesTransfersV357Test-2098359214 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3499021b-05a9-41f5-afd9-1488868e985e 1073741824" returned: 0 in 0.451s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:10:32 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-fb85253a-fcbf-4ae8-82ba-9f362b96b6d4 tempest-VolumesTransfersV357Test-2098359214 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3499021b-05a9-41f5-afd9-1488868e985e {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:10:32 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-fb85253a-fcbf-4ae8-82ba-9f362b96b6d4 tempest-VolumesTransfersV357Test-2098359214 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3499021b-05a9-41f5-afd9-1488868e985e" returned: 0 in 0.124s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:10:32 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-fb85253a-fcbf-4ae8-82ba-9f362b96b6d4 tempest-VolumesTransfersV357Test-2098359214 None] <== create_volume: return (646ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:10:32 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-fb85253a-fcbf-4ae8-82ba-9f362b96b6d4 tempest-VolumesTransfersV357Test-2098359214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.658s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:10:32 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fb85253a-fcbf-4ae8-82ba-9f362b96b6d4 tempest-VolumesTransfersV357Test-2098359214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1659123e-8e89-49cc-932b-0c0e58a1d6f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3499021b-05a9-41f5-afd9-1488868e985e', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:10:32 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fb85253a-fcbf-4ae8-82ba-9f362b96b6d4 tempest-VolumesTransfersV357Test-2098359214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aadaafd7-3ef3-43e2-ad10-889c0cca1a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:10:32 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-fb85253a-fcbf-4ae8-82ba-9f362b96b6d4 tempest-VolumesTransfersV357Test-2098359214 None] Volume volume-3499021b-05a9-41f5-afd9-1488868e985e (3499021b-05a9-41f5-afd9-1488868e985e): created successfully Sep 10 21:10:32 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fb85253a-fcbf-4ae8-82ba-9f362b96b6d4 tempest-VolumesTransfersV357Test-2098359214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aadaafd7-3ef3-43e2-ad10-889c0cca1a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:10:32 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fb85253a-fcbf-4ae8-82ba-9f362b96b6d4 tempest-VolumesTransfersV357Test-2098359214 None] Flow 'volume_create_manager' (7906bd46-7469-4dd8-89da-15a8b2e55bc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:10:32 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-fb85253a-fcbf-4ae8-82ba-9f362b96b6d4 tempest-VolumesTransfersV357Test-2098359214 None] Created volume successfully. Sep 10 21:10:34 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-532c53df-0bcd-434c-b4a1-6340ffc8cbf5 tempest-VolumesTransfersV357Test-1482116352 None] Acquiring lock "cinder-3499021b-05a9-41f5-afd9-1488868e985e-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:10:34 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-532c53df-0bcd-434c-b4a1-6340ffc8cbf5 tempest-VolumesTransfersV357Test-1482116352 None] Lock "cinder-3499021b-05a9-41f5-afd9-1488868e985e-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:10:34 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=37,cinder:UPDATE=56,cinder:INSERT=20,cinder:DELETE=4 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:10:34 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=32,cinder:INSERT=9,cinder:UPDATE=33,cinder:DELETE=5 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:10:34 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-532c53df-0bcd-434c-b4a1-6340ffc8cbf5 tempest-VolumesTransfersV357Test-1482116352 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:10:34 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-532c53df-0bcd-434c-b4a1-6340ffc8cbf5 tempest-VolumesTransfersV357Test-1482116352 None] Acquiring lock "cinder-quobyte-3499021b-05a9-41f5-afd9-1488868e985e" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:10:34 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-532c53df-0bcd-434c-b4a1-6340ffc8cbf5 tempest-VolumesTransfersV357Test-1482116352 None] Lock "cinder-quobyte-3499021b-05a9-41f5-afd9-1488868e985e" acquired by "delete_volume" :: waited 0.021s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:10:34 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[920dfb49-18da-483d-b055-80ea86a274a8]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:10:34 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-532c53df-0bcd-434c-b4a1-6340ffc8cbf5 tempest-VolumesTransfersV357Test-1482116352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3499021b-05a9-41f5-afd9-1488868e985e {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:10:35 devstack quobyte-client[82807]: System call of process 87741 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:10:35 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-532c53df-0bcd-434c-b4a1-6340ffc8cbf5 tempest-VolumesTransfersV357Test-1482116352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3499021b-05a9-41f5-afd9-1488868e985e" returned: 0 in 0.910s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:10:35 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-532c53df-0bcd-434c-b4a1-6340ffc8cbf5 tempest-VolumesTransfersV357Test-1482116352 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3499021b-05a9-41f5-afd9-1488868e985e {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:10:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-532c53df-0bcd-434c-b4a1-6340ffc8cbf5 tempest-VolumesTransfersV357Test-1482116352 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3499021b-05a9-41f5-afd9-1488868e985e" returned: 0 in 0.151s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:10:36 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-532c53df-0bcd-434c-b4a1-6340ffc8cbf5 tempest-VolumesTransfersV357Test-1482116352 None] Lock "cinder-quobyte-3499021b-05a9-41f5-afd9-1488868e985e" released by "delete_volume" :: held 1.443s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:10:36 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-532c53df-0bcd-434c-b4a1-6340ffc8cbf5 tempest-VolumesTransfersV357Test-1482116352 None] Created reservations ['5b13c2da-bc95-4779-a659-e8f382a0bf79', '08b44ecc-86bc-4c4e-bcd5-61db17d0253d', '8e1c05a3-d6db-4ee2-8197-47d1943e7881', 'b18ba7c9-de98-4ba4-b309-31586c5a7a25'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:10:37 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-532c53df-0bcd-434c-b4a1-6340ffc8cbf5 tempest-VolumesTransfersV357Test-1482116352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:10:37 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-532c53df-0bcd-434c-b4a1-6340ffc8cbf5 tempest-VolumesTransfersV357Test-1482116352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:10:37 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-532c53df-0bcd-434c-b4a1-6340ffc8cbf5 tempest-VolumesTransfersV357Test-1482116352 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:10:37 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-532c53df-0bcd-434c-b4a1-6340ffc8cbf5 tempest-VolumesTransfersV357Test-1482116352 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:10:37 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-532c53df-0bcd-434c-b4a1-6340ffc8cbf5 tempest-VolumesTransfersV357Test-1482116352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:10:37 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-532c53df-0bcd-434c-b4a1-6340ffc8cbf5 tempest-VolumesTransfersV357Test-1482116352 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:10:37 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-532c53df-0bcd-434c-b4a1-6340ffc8cbf5 tempest-VolumesTransfersV357Test-1482116352 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.269s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:10:37 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-532c53df-0bcd-434c-b4a1-6340ffc8cbf5 tempest-VolumesTransfersV357Test-1482116352 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:10:37 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-532c53df-0bcd-434c-b4a1-6340ffc8cbf5 tempest-VolumesTransfersV357Test-1482116352 None] Deleted volume successfully. Sep 10 21:10:38 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-532c53df-0bcd-434c-b4a1-6340ffc8cbf5 tempest-VolumesTransfersV357Test-1482116352 None] Lock "cinder-3499021b-05a9-41f5-afd9-1488868e985e-delete_volume" released by "delete_volume" :: held 3.907s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:10:41 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-c14175a7-234b-4d7a-be43-b385789877e5 req-3c6c4141-59a9-4659-a198-947652f42a75 tempest-AttachVolumeShelveTestJSON-724512628 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:10:41 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-c14175a7-234b-4d7a-be43-b385789877e5 req-3c6c4141-59a9-4659-a198-947652f42a75 tempest-AttachVolumeShelveTestJSON-724512628 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:10:41 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-c14175a7-234b-4d7a-be43-b385789877e5 req-3c6c4141-59a9-4659-a198-947652f42a75 tempest-AttachVolumeShelveTestJSON-724512628 None] No connector for attachment 982a10a0-c63d-4384-b015-496635b6d6f0; skipping storage backend terminate_connection call. {{(pid=82780) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4977}} Sep 10 21:10:41 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-c14175a7-234b-4d7a-be43-b385789877e5 req-3c6c4141-59a9-4659-a198-947652f42a75 tempest-AttachVolumeShelveTestJSON-724512628 None] Deleting attachment 982a10a0-c63d-4384-b015-496635b6d6f0. {{(pid=82780) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 21:10:51 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=7,cinder:INSERT=4,cinder:UPDATE=11 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:10:51 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=3,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:10:56 devstack cinder-volume[82780]: DEBUG oslo_service.periodic_task [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82780) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 21:10:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:10:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:10:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:10:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:10:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:10:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:10:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.199s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:10:56 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:10:58 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-d7ade9eb-3d5a-4233-bb61-e6f65683e5d3 tempest-VolumesActionsTest-1621937453 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:10:58 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7ade9eb-3d5a-4233-bb61-e6f65683e5d3 tempest-VolumesActionsTest-1621937453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:10:58 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-d7ade9eb-3d5a-4233-bb61-e6f65683e5d3 tempest-VolumesActionsTest-1621937453 None] Flow 'volume_create_manager' (c8752df4-8abe-4f0c-803a-e306ae370017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:10:58 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-d7ade9eb-3d5a-4233-bb61-e6f65683e5d3 tempest-VolumesActionsTest-1621937453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce440ced-e0c1-41d2-ac01-377e8fde0786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:10:58 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-d7ade9eb-3d5a-4233-bb61-e6f65683e5d3 tempest-VolumesActionsTest-1621937453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce440ced-e0c1-41d2-ac01-377e8fde0786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:10:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1054605805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ba4dc01-f436-4319-9ebc-16c2724bdfde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee125d5de0924249a253a1eece05efa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:10:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:10:58Z,use_quota=True,user_id='613bf3891c614ebc8cd52f4cecc2a2fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:10:58 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-d7ade9eb-3d5a-4233-bb61-e6f65683e5d3 tempest-VolumesActionsTest-1621937453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37bfd56e-14bb-4eaf-b0bf-b11cb08485ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:10:58 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-d7ade9eb-3d5a-4233-bb61-e6f65683e5d3 tempest-VolumesActionsTest-1621937453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37bfd56e-14bb-4eaf-b0bf-b11cb08485ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:10:58 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-d7ade9eb-3d5a-4233-bb61-e6f65683e5d3 tempest-VolumesActionsTest-1621937453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98700d5e-0687-4705-9f23-ab51b532f4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:10:58 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-d7ade9eb-3d5a-4233-bb61-e6f65683e5d3 tempest-VolumesActionsTest-1621937453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98700d5e-0687-4705-9f23-ab51b532f4b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ba4dc01-f436-4319-9ebc-16c2724bdfde', 'volume_name': 'volume-5ba4dc01-f436-4319-9ebc-16c2724bdfde', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:10:58 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-d7ade9eb-3d5a-4233-bb61-e6f65683e5d3 tempest-VolumesActionsTest-1621937453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33e5322b-145b-4c96-8096-91c22a1e3347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:10:58 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-d7ade9eb-3d5a-4233-bb61-e6f65683e5d3 tempest-VolumesActionsTest-1621937453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33e5322b-145b-4c96-8096-91c22a1e3347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:10:58 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-d7ade9eb-3d5a-4233-bb61-e6f65683e5d3 tempest-VolumesActionsTest-1621937453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1493f43-afde-4367-ac88-6f203366537d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:10:58 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-d7ade9eb-3d5a-4233-bb61-e6f65683e5d3 tempest-VolumesActionsTest-1621937453 None] Volume 5ba4dc01-f436-4319-9ebc-16c2724bdfde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ba4dc01-f436-4319-9ebc-16c2724bdfde', 'volume_size': 1} Sep 10 21:10:58 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-d7ade9eb-3d5a-4233-bb61-e6f65683e5d3 tempest-VolumesActionsTest-1621937453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:10:58 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-d7ade9eb-3d5a-4233-bb61-e6f65683e5d3 tempest-VolumesActionsTest-1621937453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:10:58 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-d7ade9eb-3d5a-4233-bb61-e6f65683e5d3 tempest-VolumesActionsTest-1621937453 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:10:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1054605805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ba4dc01-f436-4319-9ebc-16c2724bdfde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee125d5de0924249a253a1eece05efa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:10:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:10:58Z,use_quota=True,user_id='613bf3891c614ebc8cd52f4cecc2a2fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:10:58 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-d7ade9eb-3d5a-4233-bb61-e6f65683e5d3 tempest-VolumesActionsTest-1621937453 None] Creating volume 5ba4dc01-f436-4319-9ebc-16c2724bdfde {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:10:58 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-d7ade9eb-3d5a-4233-bb61-e6f65683e5d3 tempest-VolumesActionsTest-1621937453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:10:58 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-d7ade9eb-3d5a-4233-bb61-e6f65683e5d3 tempest-VolumesActionsTest-1621937453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:10:58 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-d7ade9eb-3d5a-4233-bb61-e6f65683e5d3 tempest-VolumesActionsTest-1621937453 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:10:58 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-d7ade9eb-3d5a-4233-bb61-e6f65683e5d3 tempest-VolumesActionsTest-1621937453 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:10:58 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-d7ade9eb-3d5a-4233-bb61-e6f65683e5d3 tempest-VolumesActionsTest-1621937453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:10:58 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-d7ade9eb-3d5a-4233-bb61-e6f65683e5d3 tempest-VolumesActionsTest-1621937453 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:10:58 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-d7ade9eb-3d5a-4233-bb61-e6f65683e5d3 tempest-VolumesActionsTest-1621937453 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:10:58 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-d7ade9eb-3d5a-4233-bb61-e6f65683e5d3 tempest-VolumesActionsTest-1621937453 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5ba4dc01-f436-4319-9ebc-16c2724bdfde 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:10:58 devstack quobyte-client[82807]: System call of process 87766 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:10:58 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=25, name=volume-5ba4dc01-f436-4319-9ebc-16c2724bdfde, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:10:59 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-d7ade9eb-3d5a-4233-bb61-e6f65683e5d3 tempest-VolumesActionsTest-1621937453 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5ba4dc01-f436-4319-9ebc-16c2724bdfde 1073741824" returned: 0 in 0.460s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:10:59 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-d7ade9eb-3d5a-4233-bb61-e6f65683e5d3 tempest-VolumesActionsTest-1621937453 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5ba4dc01-f436-4319-9ebc-16c2724bdfde {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:10:59 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-d7ade9eb-3d5a-4233-bb61-e6f65683e5d3 tempest-VolumesActionsTest-1621937453 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5ba4dc01-f436-4319-9ebc-16c2724bdfde" returned: 0 in 0.169s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:10:59 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-d7ade9eb-3d5a-4233-bb61-e6f65683e5d3 tempest-VolumesActionsTest-1621937453 None] <== create_volume: return (732ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:10:59 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-d7ade9eb-3d5a-4233-bb61-e6f65683e5d3 tempest-VolumesActionsTest-1621937453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:10:59 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-d7ade9eb-3d5a-4233-bb61-e6f65683e5d3 tempest-VolumesActionsTest-1621937453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1493f43-afde-4367-ac88-6f203366537d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ba4dc01-f436-4319-9ebc-16c2724bdfde', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:10:59 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-d7ade9eb-3d5a-4233-bb61-e6f65683e5d3 tempest-VolumesActionsTest-1621937453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54238ffb-ec5c-4cba-8e7b-fd7bc197f2b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:10:59 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-d7ade9eb-3d5a-4233-bb61-e6f65683e5d3 tempest-VolumesActionsTest-1621937453 None] Volume volume-5ba4dc01-f436-4319-9ebc-16c2724bdfde (5ba4dc01-f436-4319-9ebc-16c2724bdfde): created successfully Sep 10 21:10:59 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-d7ade9eb-3d5a-4233-bb61-e6f65683e5d3 tempest-VolumesActionsTest-1621937453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54238ffb-ec5c-4cba-8e7b-fd7bc197f2b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:10:59 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-d7ade9eb-3d5a-4233-bb61-e6f65683e5d3 tempest-VolumesActionsTest-1621937453 None] Flow 'volume_create_manager' (c8752df4-8abe-4f0c-803a-e306ae370017) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:10:59 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-d7ade9eb-3d5a-4233-bb61-e6f65683e5d3 tempest-VolumesActionsTest-1621937453 None] Created volume successfully. Sep 10 21:11:04 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-8e5a37cf-a88a-4e0c-97e5-a488e1efb4b9 tempest-TaggedBootDevicesTest-1369002241 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:11:04 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e5a37cf-a88a-4e0c-97e5-a488e1efb4b9 tempest-TaggedBootDevicesTest-1369002241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:11:05 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-8e5a37cf-a88a-4e0c-97e5-a488e1efb4b9 tempest-TaggedBootDevicesTest-1369002241 None] Flow 'volume_create_manager' (9ccbe459-5179-407f-b179-24a16b4cfce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:11:05 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-8e5a37cf-a88a-4e0c-97e5-a488e1efb4b9 tempest-TaggedBootDevicesTest-1369002241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (865db35e-7749-46ef-a967-418519e41df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:11:05 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-8e5a37cf-a88a-4e0c-97e5-a488e1efb4b9 tempest-TaggedBootDevicesTest-1369002241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (865db35e-7749-46ef-a967-418519e41df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-956401863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c2f424f-6634-4eab-a7d4-8673a507b137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e51c150950964e27ab3a56a42d0fa9fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:11:05Z,use_quota=True,user_id='b5d2b44d076e4a99826fd312b6614b5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:11:05 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-8e5a37cf-a88a-4e0c-97e5-a488e1efb4b9 tempest-TaggedBootDevicesTest-1369002241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e211864-c8ae-4dfc-ac95-b82b873f6a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:11:05 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-8e5a37cf-a88a-4e0c-97e5-a488e1efb4b9 tempest-TaggedBootDevicesTest-1369002241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e211864-c8ae-4dfc-ac95-b82b873f6a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:11:05 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-8e5a37cf-a88a-4e0c-97e5-a488e1efb4b9 tempest-TaggedBootDevicesTest-1369002241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4461147d-583b-43fc-97bf-e18b198a7ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:11:05 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-8e5a37cf-a88a-4e0c-97e5-a488e1efb4b9 tempest-TaggedBootDevicesTest-1369002241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4461147d-583b-43fc-97bf-e18b198a7ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8c2f424f-6634-4eab-a7d4-8673a507b137', 'volume_name': 'volume-8c2f424f-6634-4eab-a7d4-8673a507b137', 'volume_size': 1, 'image_id': '844acb65-e174-4c79-a335-b56b5bb82298', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2bf6d32ea4d94e048fb27411155cf2e9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '844acb65-e174-4c79-a335-b56b5bb82298', 'created_at': datetime.datetime(2025, 9, 10, 18, 53, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 18, 53, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/844acb65-e174-4c79-a335-b56b5bb82298/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:11:05 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-8e5a37cf-a88a-4e0c-97e5-a488e1efb4b9 tempest-TaggedBootDevicesTest-1369002241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96cdff03-029b-4646-8009-daef2a8c5408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:11:05 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-8e5a37cf-a88a-4e0c-97e5-a488e1efb4b9 tempest-TaggedBootDevicesTest-1369002241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96cdff03-029b-4646-8009-daef2a8c5408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:11:05 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-8e5a37cf-a88a-4e0c-97e5-a488e1efb4b9 tempest-TaggedBootDevicesTest-1369002241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49b9eaaa-314f-463a-852a-d10e029ca1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:11:05 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-8e5a37cf-a88a-4e0c-97e5-a488e1efb4b9 tempest-TaggedBootDevicesTest-1369002241 None] Volume 8c2f424f-6634-4eab-a7d4-8673a507b137: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8c2f424f-6634-4eab-a7d4-8673a507b137', 'volume_size': 1, 'image_id': '844acb65-e174-4c79-a335-b56b5bb82298', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2bf6d32ea4d94e048fb27411155cf2e9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '844acb65-e174-4c79-a335-b56b5bb82298', 'created_at': datetime.datetime(2025, 9, 10, 18, 53, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 18, 53, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/844acb65-e174-4c79-a335-b56b5bb82298/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 10 21:11:05 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e5a37cf-a88a-4e0c-97e5-a488e1efb4b9 tempest-TaggedBootDevicesTest-1369002241 None] Cloning 8c2f424f-6634-4eab-a7d4-8673a507b137 from image 844acb65-e174-4c79-a335-b56b5bb82298 at location (None, None). {{(pid=82780) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1083}} Sep 10 21:11:06 devstack cinder-volume[82780]: DEBUG cinder.image.image_utils [None req-8e5a37cf-a88a-4e0c-97e5-a488e1efb4b9 tempest-TaggedBootDevicesTest-1369002241 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_844acb65-e174-4c79-a335-b56b5bb82298_q5d_0yq9devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82780) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 10 21:11:06 devstack cinder-volume[82780]: INFO cinder.image.image_utils [None req-8e5a37cf-a88a-4e0c-97e5-a488e1efb4b9 tempest-TaggedBootDevicesTest-1369002241 None] Image download 20.69 MB at 20.69 MB/s Sep 10 21:11:06 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d94fec-7476-48c6-b27d-127704d51b26]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:11:06 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-8e5a37cf-a88a-4e0c-97e5-a488e1efb4b9 tempest-TaggedBootDevicesTest-1369002241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_844acb65-e174-4c79-a335-b56b5bb82298_q5d_0yq9devstack@QuobyteHD {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:11:07 devstack sudo[87783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_844acb65-e174-4c79-a335-b56b5bb82298_q5d_0yq9devstack@QuobyteHD Sep 10 21:11:07 devstack sudo[87783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 21:11:10 devstack sudo[87783]: pam_unix(sudo:session): session closed for user root Sep 10 21:11:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-8e5a37cf-a88a-4e0c-97e5-a488e1efb4b9 tempest-TaggedBootDevicesTest-1369002241 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_844acb65-e174-4c79-a335-b56b5bb82298_q5d_0yq9devstack@QuobyteHD" returned: 0 in 3.871s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:11:10 devstack cinder-volume[82780]: DEBUG cinder.image.image_utils [None req-8e5a37cf-a88a-4e0c-97e5-a488e1efb4b9 tempest-TaggedBootDevicesTest-1369002241 None] Temporary image 844acb65-e174-4c79-a335-b56b5bb82298 is fetched for user b5d2b44d076e4a99826fd312b6614b5c. {{(pid=82780) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 10 21:11:11 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5597d73-6515-4990-9306-ed0a14224dc5]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:11:11 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-8e5a37cf-a88a-4e0c-97e5-a488e1efb4b9 tempest-TaggedBootDevicesTest-1369002241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_844acb65-e174-4c79-a335-b56b5bb82298_q5d_0yq9devstack@QuobyteHD {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:11:11 devstack sudo[87839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_844acb65-e174-4c79-a335-b56b5bb82298_q5d_0yq9devstack@QuobyteHD Sep 10 21:11:11 devstack sudo[87839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 21:11:14 devstack sudo[87839]: pam_unix(sudo:session): session closed for user root Sep 10 21:11:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-8e5a37cf-a88a-4e0c-97e5-a488e1efb4b9 tempest-TaggedBootDevicesTest-1369002241 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_844acb65-e174-4c79-a335-b56b5bb82298_q5d_0yq9devstack@QuobyteHD" returned: 0 in 3.036s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:11:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-8e5a37cf-a88a-4e0c-97e5-a488e1efb4b9 tempest-TaggedBootDevicesTest-1369002241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:11:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-8e5a37cf-a88a-4e0c-97e5-a488e1efb4b9 tempest-TaggedBootDevicesTest-1369002241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:11:14 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-8e5a37cf-a88a-4e0c-97e5-a488e1efb4b9 tempest-TaggedBootDevicesTest-1369002241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-956401863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c2f424f-6634-4eab-a7d4-8673a507b137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e51c150950964e27ab3a56a42d0fa9fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:11:05Z,use_quota=True,user_id='b5d2b44d076e4a99826fd312b6614b5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:11:14 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-8e5a37cf-a88a-4e0c-97e5-a488e1efb4b9 tempest-TaggedBootDevicesTest-1369002241 None] Creating volume 8c2f424f-6634-4eab-a7d4-8673a507b137 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:11:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-8e5a37cf-a88a-4e0c-97e5-a488e1efb4b9 tempest-TaggedBootDevicesTest-1369002241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:11:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-8e5a37cf-a88a-4e0c-97e5-a488e1efb4b9 tempest-TaggedBootDevicesTest-1369002241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:11:14 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-8e5a37cf-a88a-4e0c-97e5-a488e1efb4b9 tempest-TaggedBootDevicesTest-1369002241 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:11:14 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-8e5a37cf-a88a-4e0c-97e5-a488e1efb4b9 tempest-TaggedBootDevicesTest-1369002241 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:11:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-8e5a37cf-a88a-4e0c-97e5-a488e1efb4b9 tempest-TaggedBootDevicesTest-1369002241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:11:14 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-8e5a37cf-a88a-4e0c-97e5-a488e1efb4b9 tempest-TaggedBootDevicesTest-1369002241 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:11:14 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-8e5a37cf-a88a-4e0c-97e5-a488e1efb4b9 tempest-TaggedBootDevicesTest-1369002241 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:11:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-8e5a37cf-a88a-4e0c-97e5-a488e1efb4b9 tempest-TaggedBootDevicesTest-1369002241 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-8c2f424f-6634-4eab-a7d4-8673a507b137 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:11:14 devstack quobyte-client[82807]: System call of process 87846 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:11:14 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=26, name=volume-8c2f424f-6634-4eab-a7d4-8673a507b137, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:11:15 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-8e5a37cf-a88a-4e0c-97e5-a488e1efb4b9 tempest-TaggedBootDevicesTest-1369002241 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-8c2f424f-6634-4eab-a7d4-8673a507b137 1073741824" returned: 0 in 0.540s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:11:15 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-8e5a37cf-a88a-4e0c-97e5-a488e1efb4b9 tempest-TaggedBootDevicesTest-1369002241 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-8c2f424f-6634-4eab-a7d4-8673a507b137 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:11:15 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-8e5a37cf-a88a-4e0c-97e5-a488e1efb4b9 tempest-TaggedBootDevicesTest-1369002241 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-8c2f424f-6634-4eab-a7d4-8673a507b137" returned: 0 in 0.166s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:11:15 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-8e5a37cf-a88a-4e0c-97e5-a488e1efb4b9 tempest-TaggedBootDevicesTest-1369002241 None] <== create_volume: return (884ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:11:15 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-8e5a37cf-a88a-4e0c-97e5-a488e1efb4b9 tempest-TaggedBootDevicesTest-1369002241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:11:15 devstack cinder-volume[82780]: DEBUG cinder.volume.volume_utils [None req-8e5a37cf-a88a-4e0c-97e5-a488e1efb4b9 tempest-TaggedBootDevicesTest-1369002241 None] Attempting download of 844acb65-e174-4c79-a335-b56b5bb82298 ((None, None)) to volume 8c2f424f-6634-4eab-a7d4-8673a507b137. {{(pid=82780) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 10 21:11:16 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d37a727-ded0-4174-9096-88845487e935]: (4, 'raw') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:11:16 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-8e5a37cf-a88a-4e0c-97e5-a488e1efb4b9 tempest-TaggedBootDevicesTest-1369002241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_844acb65-e174-4c79-a335-b56b5bb82298_bbazwuo4 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:11:16 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-8e5a37cf-a88a-4e0c-97e5-a488e1efb4b9 tempest-TaggedBootDevicesTest-1369002241 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_844acb65-e174-4c79-a335-b56b5bb82298_bbazwuo4" returned: 0 in 0.789s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:11:16 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-8e5a37cf-a88a-4e0c-97e5-a488e1efb4b9 tempest-TaggedBootDevicesTest-1369002241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_844acb65-e174-4c79-a335-b56b5bb82298_bbazwuo4 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:11:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-8e5a37cf-a88a-4e0c-97e5-a488e1efb4b9 tempest-TaggedBootDevicesTest-1369002241 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_844acb65-e174-4c79-a335-b56b5bb82298_bbazwuo4" returned: 1 in 0.749s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:11:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-8e5a37cf-a88a-4e0c-97e5-a488e1efb4b9 tempest-TaggedBootDevicesTest-1369002241 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_844acb65-e174-4c79-a335-b56b5bb82298_bbazwuo4' failed. Not Retrying. {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 21:11:17 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d6b2470-f3d4-435d-84d1-01e6359b64f0]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:11:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-8e5a37cf-a88a-4e0c-97e5-a488e1efb4b9 tempest-TaggedBootDevicesTest-1369002241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_844acb65-e174-4c79-a335-b56b5bb82298_q5d_0yq9devstack@QuobyteHD {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:11:18 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-8e5a37cf-a88a-4e0c-97e5-a488e1efb4b9 tempest-TaggedBootDevicesTest-1369002241 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_844acb65-e174-4c79-a335-b56b5bb82298_q5d_0yq9devstack@QuobyteHD" returned: 0 in 0.871s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:11:18 devstack cinder-volume[82780]: DEBUG cinder.image.image_utils [None req-8e5a37cf-a88a-4e0c-97e5-a488e1efb4b9 tempest-TaggedBootDevicesTest-1369002241 None] 844acb65-e174-4c79-a335-b56b5bb82298 was qcow2, converting to raw {{(pid=82780) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 10 21:11:18 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-8e5a37cf-a88a-4e0c-97e5-a488e1efb4b9 tempest-TaggedBootDevicesTest-1369002241 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_844acb65-e174-4c79-a335-b56b5bb82298_q5d_0yq9devstack@QuobyteHD /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-8c2f424f-6634-4eab-a7d4-8673a507b137 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:11:18 devstack quobyte-client[82807]: System call of process 87871 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:11:18 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=26, name=volume-8c2f424f-6634-4eab-a7d4-8673a507b137, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:11:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-8e5a37cf-a88a-4e0c-97e5-a488e1efb4b9 tempest-TaggedBootDevicesTest-1369002241 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_844acb65-e174-4c79-a335-b56b5bb82298_q5d_0yq9devstack@QuobyteHD /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-8c2f424f-6634-4eab-a7d4-8673a507b137" returned: 0 in 1.474s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:11:20 devstack cinder-volume[82780]: DEBUG cinder.image.image_utils [None req-8e5a37cf-a88a-4e0c-97e5-a488e1efb4b9 tempest-TaggedBootDevicesTest-1369002241 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_844acb65-e174-4c79-a335-b56b5bb82298_q5d_0yq9devstack@QuobyteHD, size 112.00 MB, duration 1.50 sec, destination /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-8c2f424f-6634-4eab-a7d4-8673a507b137 {{(pid=82780) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 10 21:11:20 devstack cinder-volume[82780]: INFO cinder.image.image_utils [None req-8e5a37cf-a88a-4e0c-97e5-a488e1efb4b9 tempest-TaggedBootDevicesTest-1369002241 None] Converted 112.00 MB image at 74.73 MB/s Sep 10 21:11:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-8e5a37cf-a88a-4e0c-97e5-a488e1efb4b9 tempest-TaggedBootDevicesTest-1369002241 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-8c2f424f-6634-4eab-a7d4-8673a507b137 1G {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:11:20 devstack quobyte-client[82807]: System call of process 87884 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:11:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-8e5a37cf-a88a-4e0c-97e5-a488e1efb4b9 tempest-TaggedBootDevicesTest-1369002241 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-8c2f424f-6634-4eab-a7d4-8673a507b137 1G" returned: 0 in 0.142s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:11:20 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0d903c-2e85-4146-a44e-799b1388806c]: (4, 'raw') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:11:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-8e5a37cf-a88a-4e0c-97e5-a488e1efb4b9 tempest-TaggedBootDevicesTest-1369002241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-8c2f424f-6634-4eab-a7d4-8673a507b137 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:11:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-8e5a37cf-a88a-4e0c-97e5-a488e1efb4b9 tempest-TaggedBootDevicesTest-1369002241 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-8c2f424f-6634-4eab-a7d4-8673a507b137" returned: 0 in 0.385s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:11:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-8e5a37cf-a88a-4e0c-97e5-a488e1efb4b9 tempest-TaggedBootDevicesTest-1369002241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-8c2f424f-6634-4eab-a7d4-8673a507b137 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:11:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-8e5a37cf-a88a-4e0c-97e5-a488e1efb4b9 tempest-TaggedBootDevicesTest-1369002241 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-8c2f424f-6634-4eab-a7d4-8673a507b137" returned: 1 in 0.495s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:11:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-8e5a37cf-a88a-4e0c-97e5-a488e1efb4b9 tempest-TaggedBootDevicesTest-1369002241 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-8c2f424f-6634-4eab-a7d4-8673a507b137' failed. Not Retrying. {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 21:11:21 devstack cinder-volume[82780]: DEBUG cinder.volume.volume_utils [None req-8e5a37cf-a88a-4e0c-97e5-a488e1efb4b9 tempest-TaggedBootDevicesTest-1369002241 None] Downloaded image 844acb65-e174-4c79-a335-b56b5bb82298 ((None, None)) to volume 8c2f424f-6634-4eab-a7d4-8673a507b137 successfully. {{(pid=82780) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 10 21:11:21 devstack cinder-volume[82780]: DEBUG cinder.image.image_utils [None req-8e5a37cf-a88a-4e0c-97e5-a488e1efb4b9 tempest-TaggedBootDevicesTest-1369002241 None] Temporary image 844acb65-e174-4c79-a335-b56b5bb82298 for user b5d2b44d076e4a99826fd312b6614b5c is deleted. {{(pid=82780) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 10 21:11:21 devstack cinder-volume[82780]: DEBUG cinder.volume.volume_utils [None req-8e5a37cf-a88a-4e0c-97e5-a488e1efb4b9 tempest-TaggedBootDevicesTest-1369002241 None] Marking volume 8c2f424f-6634-4eab-a7d4-8673a507b137 as bootable. {{(pid=82780) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 10 21:11:21 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e5a37cf-a88a-4e0c-97e5-a488e1efb4b9 tempest-TaggedBootDevicesTest-1369002241 None] Copying metadata from image 844acb65-e174-4c79-a335-b56b5bb82298 to 8c2f424f-6634-4eab-a7d4-8673a507b137. {{(pid=82780) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 10 21:11:21 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e5a37cf-a88a-4e0c-97e5-a488e1efb4b9 tempest-TaggedBootDevicesTest-1369002241 None] Creating volume glance metadata for volume 8c2f424f-6634-4eab-a7d4-8673a507b137 backed by image 844acb65-e174-4c79-a335-b56b5bb82298 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '844acb65-e174-4c79-a335-b56b5bb82298', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82780) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 10 21:11:21 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-8e5a37cf-a88a-4e0c-97e5-a488e1efb4b9 tempest-TaggedBootDevicesTest-1369002241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49b9eaaa-314f-463a-852a-d10e029ca1c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c2f424f-6634-4eab-a7d4-8673a507b137', 'volume_size': 1, 'image_id': '844acb65-e174-4c79-a335-b56b5bb82298', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2bf6d32ea4d94e048fb27411155cf2e9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '844acb65-e174-4c79-a335-b56b5bb82298', 'created_at': datetime.datetime(2025, 9, 10, 18, 53, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 18, 53, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/844acb65-e174-4c79-a335-b56b5bb82298/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:11:21 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-8e5a37cf-a88a-4e0c-97e5-a488e1efb4b9 tempest-TaggedBootDevicesTest-1369002241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e0b813e-acaa-4958-a6b6-643d6773dec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:11:21 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-8e5a37cf-a88a-4e0c-97e5-a488e1efb4b9 tempest-TaggedBootDevicesTest-1369002241 None] Volume volume-8c2f424f-6634-4eab-a7d4-8673a507b137 (8c2f424f-6634-4eab-a7d4-8673a507b137): created successfully Sep 10 21:11:21 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-8e5a37cf-a88a-4e0c-97e5-a488e1efb4b9 tempest-TaggedBootDevicesTest-1369002241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e0b813e-acaa-4958-a6b6-643d6773dec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:11:21 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-8e5a37cf-a88a-4e0c-97e5-a488e1efb4b9 tempest-TaggedBootDevicesTest-1369002241 None] Flow 'volume_create_manager' (9ccbe459-5179-407f-b179-24a16b4cfce9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:11:21 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-8e5a37cf-a88a-4e0c-97e5-a488e1efb4b9 tempest-TaggedBootDevicesTest-1369002241 None] Created volume successfully. Sep 10 21:11:22 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-6643308a-4a0c-4951-82e4-3fe2c1619e94 tempest-TaggedBootDevicesTest-1369002241 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:11:22 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-6643308a-4a0c-4951-82e4-3fe2c1619e94 tempest-TaggedBootDevicesTest-1369002241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:11:23 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-6643308a-4a0c-4951-82e4-3fe2c1619e94 tempest-TaggedBootDevicesTest-1369002241 None] Flow 'volume_create_manager' (bb94418d-189d-4960-a5dd-e608cb50f0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:11:23 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-6643308a-4a0c-4951-82e4-3fe2c1619e94 tempest-TaggedBootDevicesTest-1369002241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98d01673-9aa6-44a7-82f1-2e0b4e44d0c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:11:23 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-6643308a-4a0c-4951-82e4-3fe2c1619e94 tempest-TaggedBootDevicesTest-1369002241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98d01673-9aa6-44a7-82f1-2e0b4e44d0c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:11:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-197247449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0af6e7a3-c94d-4831-80fa-ff84a93305f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e51c150950964e27ab3a56a42d0fa9fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:11:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:11:23Z,use_quota=True,user_id='b5d2b44d076e4a99826fd312b6614b5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:11:23 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-6643308a-4a0c-4951-82e4-3fe2c1619e94 tempest-TaggedBootDevicesTest-1369002241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bd48a56-dfd0-4751-928d-580a30e1c6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:11:23 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-6643308a-4a0c-4951-82e4-3fe2c1619e94 tempest-TaggedBootDevicesTest-1369002241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bd48a56-dfd0-4751-928d-580a30e1c6b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:11:23 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-6643308a-4a0c-4951-82e4-3fe2c1619e94 tempest-TaggedBootDevicesTest-1369002241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e1b1af9-b5fc-4193-ac2f-e4553784f32f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:11:23 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-6643308a-4a0c-4951-82e4-3fe2c1619e94 tempest-TaggedBootDevicesTest-1369002241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e1b1af9-b5fc-4193-ac2f-e4553784f32f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0af6e7a3-c94d-4831-80fa-ff84a93305f0', 'volume_name': 'volume-0af6e7a3-c94d-4831-80fa-ff84a93305f0', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:11:23 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-6643308a-4a0c-4951-82e4-3fe2c1619e94 tempest-TaggedBootDevicesTest-1369002241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a2dfd77-9a0b-4e4a-898c-b7b8f33c2666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:11:23 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-6643308a-4a0c-4951-82e4-3fe2c1619e94 tempest-TaggedBootDevicesTest-1369002241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a2dfd77-9a0b-4e4a-898c-b7b8f33c2666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:11:23 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-6643308a-4a0c-4951-82e4-3fe2c1619e94 tempest-TaggedBootDevicesTest-1369002241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (046ccb10-fae3-4f9f-8773-43d9bb0b7893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:11:23 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-6643308a-4a0c-4951-82e4-3fe2c1619e94 tempest-TaggedBootDevicesTest-1369002241 None] Volume 0af6e7a3-c94d-4831-80fa-ff84a93305f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0af6e7a3-c94d-4831-80fa-ff84a93305f0', 'volume_size': 1} Sep 10 21:11:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-6643308a-4a0c-4951-82e4-3fe2c1619e94 tempest-TaggedBootDevicesTest-1369002241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:11:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-6643308a-4a0c-4951-82e4-3fe2c1619e94 tempest-TaggedBootDevicesTest-1369002241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:11:23 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-6643308a-4a0c-4951-82e4-3fe2c1619e94 tempest-TaggedBootDevicesTest-1369002241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:11:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-197247449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0af6e7a3-c94d-4831-80fa-ff84a93305f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e51c150950964e27ab3a56a42d0fa9fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:11:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:11:23Z,use_quota=True,user_id='b5d2b44d076e4a99826fd312b6614b5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:11:23 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-6643308a-4a0c-4951-82e4-3fe2c1619e94 tempest-TaggedBootDevicesTest-1369002241 None] Creating volume 0af6e7a3-c94d-4831-80fa-ff84a93305f0 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:11:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-6643308a-4a0c-4951-82e4-3fe2c1619e94 tempest-TaggedBootDevicesTest-1369002241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:11:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-6643308a-4a0c-4951-82e4-3fe2c1619e94 tempest-TaggedBootDevicesTest-1369002241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:11:23 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-6643308a-4a0c-4951-82e4-3fe2c1619e94 tempest-TaggedBootDevicesTest-1369002241 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:11:23 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-6643308a-4a0c-4951-82e4-3fe2c1619e94 tempest-TaggedBootDevicesTest-1369002241 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:11:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-6643308a-4a0c-4951-82e4-3fe2c1619e94 tempest-TaggedBootDevicesTest-1369002241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:11:23 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-6643308a-4a0c-4951-82e4-3fe2c1619e94 tempest-TaggedBootDevicesTest-1369002241 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:11:23 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-6643308a-4a0c-4951-82e4-3fe2c1619e94 tempest-TaggedBootDevicesTest-1369002241 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:11:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-6643308a-4a0c-4951-82e4-3fe2c1619e94 tempest-TaggedBootDevicesTest-1369002241 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-0af6e7a3-c94d-4831-80fa-ff84a93305f0 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:11:23 devstack quobyte-client[82807]: System call of process 87909 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:11:23 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=27, name=volume-0af6e7a3-c94d-4831-80fa-ff84a93305f0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:11:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-6643308a-4a0c-4951-82e4-3fe2c1619e94 tempest-TaggedBootDevicesTest-1369002241 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-0af6e7a3-c94d-4831-80fa-ff84a93305f0 1073741824" returned: 0 in 0.400s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:11:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-6643308a-4a0c-4951-82e4-3fe2c1619e94 tempest-TaggedBootDevicesTest-1369002241 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-0af6e7a3-c94d-4831-80fa-ff84a93305f0 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:11:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-6643308a-4a0c-4951-82e4-3fe2c1619e94 tempest-TaggedBootDevicesTest-1369002241 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-0af6e7a3-c94d-4831-80fa-ff84a93305f0" returned: 0 in 0.279s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:11:24 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-6643308a-4a0c-4951-82e4-3fe2c1619e94 tempest-TaggedBootDevicesTest-1369002241 None] <== create_volume: return (810ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:11:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-6643308a-4a0c-4951-82e4-3fe2c1619e94 tempest-TaggedBootDevicesTest-1369002241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:11:24 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-6643308a-4a0c-4951-82e4-3fe2c1619e94 tempest-TaggedBootDevicesTest-1369002241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (046ccb10-fae3-4f9f-8773-43d9bb0b7893) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0af6e7a3-c94d-4831-80fa-ff84a93305f0', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:11:24 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-6643308a-4a0c-4951-82e4-3fe2c1619e94 tempest-TaggedBootDevicesTest-1369002241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa06b281-9835-4f14-b9f3-d8b24b53de2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:11:24 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-6643308a-4a0c-4951-82e4-3fe2c1619e94 tempest-TaggedBootDevicesTest-1369002241 None] Volume volume-0af6e7a3-c94d-4831-80fa-ff84a93305f0 (0af6e7a3-c94d-4831-80fa-ff84a93305f0): created successfully Sep 10 21:11:24 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-6643308a-4a0c-4951-82e4-3fe2c1619e94 tempest-TaggedBootDevicesTest-1369002241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa06b281-9835-4f14-b9f3-d8b24b53de2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:11:24 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-6643308a-4a0c-4951-82e4-3fe2c1619e94 tempest-TaggedBootDevicesTest-1369002241 None] Flow 'volume_create_manager' (bb94418d-189d-4960-a5dd-e608cb50f0b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:11:24 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-6643308a-4a0c-4951-82e4-3fe2c1619e94 tempest-TaggedBootDevicesTest-1369002241 None] Created volume successfully. Sep 10 21:11:26 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-af908c54-7978-47fb-8732-45ecd11225aa tempest-TaggedBootDevicesTest-1369002241 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:11:26 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-af908c54-7978-47fb-8732-45ecd11225aa tempest-TaggedBootDevicesTest-1369002241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:11:26 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-af908c54-7978-47fb-8732-45ecd11225aa tempest-TaggedBootDevicesTest-1369002241 None] Flow 'volume_create_manager' (e6a68310-3480-48e4-ab15-242c6e739d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:11:26 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-af908c54-7978-47fb-8732-45ecd11225aa tempest-TaggedBootDevicesTest-1369002241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e534220e-b113-44a0-ae2b-39d42f9b8390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:11:26 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-af908c54-7978-47fb-8732-45ecd11225aa tempest-TaggedBootDevicesTest-1369002241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e534220e-b113-44a0-ae2b-39d42f9b8390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:11:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-516222553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59b82959-6c72-4dbd-b407-19233e624c30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e51c150950964e27ab3a56a42d0fa9fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:11:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:11:26Z,use_quota=True,user_id='b5d2b44d076e4a99826fd312b6614b5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:11:26 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-af908c54-7978-47fb-8732-45ecd11225aa tempest-TaggedBootDevicesTest-1369002241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (620ab63a-3779-46bc-b565-33d42c7f4d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:11:26 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-af908c54-7978-47fb-8732-45ecd11225aa tempest-TaggedBootDevicesTest-1369002241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (620ab63a-3779-46bc-b565-33d42c7f4d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:11:26 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-af908c54-7978-47fb-8732-45ecd11225aa tempest-TaggedBootDevicesTest-1369002241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bce3747-81e8-4377-b0a6-8e21b547472c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:11:26 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-af908c54-7978-47fb-8732-45ecd11225aa tempest-TaggedBootDevicesTest-1369002241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bce3747-81e8-4377-b0a6-8e21b547472c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59b82959-6c72-4dbd-b407-19233e624c30', 'volume_name': 'volume-59b82959-6c72-4dbd-b407-19233e624c30', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:11:26 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-af908c54-7978-47fb-8732-45ecd11225aa tempest-TaggedBootDevicesTest-1369002241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5cc4811-fdaf-420c-a38f-9a9ffcbad732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:11:26 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-af908c54-7978-47fb-8732-45ecd11225aa tempest-TaggedBootDevicesTest-1369002241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5cc4811-fdaf-420c-a38f-9a9ffcbad732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:11:26 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-af908c54-7978-47fb-8732-45ecd11225aa tempest-TaggedBootDevicesTest-1369002241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de7611c0-5be3-4571-8a70-6056b3e0038d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:11:26 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-af908c54-7978-47fb-8732-45ecd11225aa tempest-TaggedBootDevicesTest-1369002241 None] Volume 59b82959-6c72-4dbd-b407-19233e624c30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59b82959-6c72-4dbd-b407-19233e624c30', 'volume_size': 1} Sep 10 21:11:26 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-af908c54-7978-47fb-8732-45ecd11225aa tempest-TaggedBootDevicesTest-1369002241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:11:26 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-af908c54-7978-47fb-8732-45ecd11225aa tempest-TaggedBootDevicesTest-1369002241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:11:26 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-af908c54-7978-47fb-8732-45ecd11225aa tempest-TaggedBootDevicesTest-1369002241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:11:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-516222553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59b82959-6c72-4dbd-b407-19233e624c30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e51c150950964e27ab3a56a42d0fa9fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:11:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:11:26Z,use_quota=True,user_id='b5d2b44d076e4a99826fd312b6614b5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:11:26 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-af908c54-7978-47fb-8732-45ecd11225aa tempest-TaggedBootDevicesTest-1369002241 None] Creating volume 59b82959-6c72-4dbd-b407-19233e624c30 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:11:26 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-af908c54-7978-47fb-8732-45ecd11225aa tempest-TaggedBootDevicesTest-1369002241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:11:26 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-af908c54-7978-47fb-8732-45ecd11225aa tempest-TaggedBootDevicesTest-1369002241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:11:26 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-af908c54-7978-47fb-8732-45ecd11225aa tempest-TaggedBootDevicesTest-1369002241 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:11:26 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-af908c54-7978-47fb-8732-45ecd11225aa tempest-TaggedBootDevicesTest-1369002241 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:11:26 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-af908c54-7978-47fb-8732-45ecd11225aa tempest-TaggedBootDevicesTest-1369002241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:11:26 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-af908c54-7978-47fb-8732-45ecd11225aa tempest-TaggedBootDevicesTest-1369002241 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:11:26 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-af908c54-7978-47fb-8732-45ecd11225aa tempest-TaggedBootDevicesTest-1369002241 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:11:26 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-af908c54-7978-47fb-8732-45ecd11225aa tempest-TaggedBootDevicesTest-1369002241 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-59b82959-6c72-4dbd-b407-19233e624c30 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:11:27 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=28, name=volume-59b82959-6c72-4dbd-b407-19233e624c30, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:11:27 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-af908c54-7978-47fb-8732-45ecd11225aa tempest-TaggedBootDevicesTest-1369002241 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-59b82959-6c72-4dbd-b407-19233e624c30 1073741824" returned: 0 in 0.616s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:11:27 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-af908c54-7978-47fb-8732-45ecd11225aa tempest-TaggedBootDevicesTest-1369002241 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-59b82959-6c72-4dbd-b407-19233e624c30 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:11:27 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-af908c54-7978-47fb-8732-45ecd11225aa tempest-TaggedBootDevicesTest-1369002241 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-59b82959-6c72-4dbd-b407-19233e624c30" returned: 0 in 0.182s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:11:27 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-af908c54-7978-47fb-8732-45ecd11225aa tempest-TaggedBootDevicesTest-1369002241 None] <== create_volume: return (930ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:11:27 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-af908c54-7978-47fb-8732-45ecd11225aa tempest-TaggedBootDevicesTest-1369002241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:11:28 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-af908c54-7978-47fb-8732-45ecd11225aa tempest-TaggedBootDevicesTest-1369002241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de7611c0-5be3-4571-8a70-6056b3e0038d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59b82959-6c72-4dbd-b407-19233e624c30', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:11:28 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-af908c54-7978-47fb-8732-45ecd11225aa tempest-TaggedBootDevicesTest-1369002241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c557077-9243-4bed-99b8-bce13787c16c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:11:28 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-af908c54-7978-47fb-8732-45ecd11225aa tempest-TaggedBootDevicesTest-1369002241 None] Volume volume-59b82959-6c72-4dbd-b407-19233e624c30 (59b82959-6c72-4dbd-b407-19233e624c30): created successfully Sep 10 21:11:28 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-af908c54-7978-47fb-8732-45ecd11225aa tempest-TaggedBootDevicesTest-1369002241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c557077-9243-4bed-99b8-bce13787c16c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:11:28 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-af908c54-7978-47fb-8732-45ecd11225aa tempest-TaggedBootDevicesTest-1369002241 None] Flow 'volume_create_manager' (e6a68310-3480-48e4-ab15-242c6e739d8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:11:28 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-af908c54-7978-47fb-8732-45ecd11225aa tempest-TaggedBootDevicesTest-1369002241 None] Created volume successfully. Sep 10 21:11:38 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=14,cinder:UPDATE=11,cinder:INSERT=4,cinder:DELETE=1 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:11:38 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=9,cinder:UPDATE=8,cinder:DELETE=3,cinder:INSERT=9 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:11:40 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-044c2206-b1d8-4c66-97fc-bf12b2d3d617 tempest-VolumesActionsTest-1621937453 None] Acquiring lock "cinder-5ba4dc01-f436-4319-9ebc-16c2724bdfde" by "attach_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:11:40 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-044c2206-b1d8-4c66-97fc-bf12b2d3d617 tempest-VolumesActionsTest-1621937453 None] Lock "cinder-5ba4dc01-f436-4319-9ebc-16c2724bdfde" acquired by "attach_volume" :: waited 0.063s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:11:40 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-044c2206-b1d8-4c66-97fc-bf12b2d3d617 tempest-VolumesActionsTest-1621937453 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:11:40 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-044c2206-b1d8-4c66-97fc-bf12b2d3d617 tempest-VolumesActionsTest-1621937453 None] Attaching volume 5ba4dc01-f436-4319-9ebc-16c2724bdfde to instance ed129643-a449-46a7-95f2-9c5855dadbf7 at mountpoint /dev/vdb on host None. Sep 10 21:11:40 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-044c2206-b1d8-4c66-97fc-bf12b2d3d617 tempest-VolumesActionsTest-1621937453 None] Attach volume completed successfully. Sep 10 21:11:40 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-044c2206-b1d8-4c66-97fc-bf12b2d3d617 tempest-VolumesActionsTest-1621937453 None] Lock "cinder-5ba4dc01-f436-4319-9ebc-16c2724bdfde" released by "attach_volume" :: held 0.842s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:11:41 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-f47faaa1-1699-47a0-a238-17f1b18464fa tempest-VolumesActionsTest-1621937453 None] Acquiring lock "cinder-5ba4dc01-f436-4319-9ebc-16c2724bdfde-detach_volume" by "detach_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:11:42 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-f47faaa1-1699-47a0-a238-17f1b18464fa tempest-VolumesActionsTest-1621937453 None] Lock "cinder-5ba4dc01-f436-4319-9ebc-16c2724bdfde-detach_volume" acquired by "detach_volume" :: waited 0.045s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:11:42 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-f47faaa1-1699-47a0-a238-17f1b18464fa tempest-VolumesActionsTest-1621937453 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:11:42 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-f47faaa1-1699-47a0-a238-17f1b18464fa tempest-VolumesActionsTest-1621937453 None] Detaching volume 5ba4dc01-f436-4319-9ebc-16c2724bdfde from instance ed129643-a449-46a7-95f2-9c5855dadbf7. Sep 10 21:11:42 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-f47faaa1-1699-47a0-a238-17f1b18464fa tempest-VolumesActionsTest-1621937453 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:11:42 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-f47faaa1-1699-47a0-a238-17f1b18464fa tempest-VolumesActionsTest-1621937453 None] Detach volume completed successfully. Sep 10 21:11:42 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-f47faaa1-1699-47a0-a238-17f1b18464fa tempest-VolumesActionsTest-1621937453 None] Lock "cinder-5ba4dc01-f436-4319-9ebc-16c2724bdfde-detach_volume" released by "detach_volume" :: held 0.287s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:11:52 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:11:56 devstack cinder-volume[82780]: DEBUG oslo_service.periodic_task [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82780) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 21:11:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:11:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:11:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:11:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:11:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:11:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:11:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.154s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:11:56 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:11:59 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=5 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:12:08 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-1e15af81-b2c5-499d-b4e8-9f6273281321 req-eb23b63e-379b-44c3-9ffd-3bfd79ff77a9 tempest-TaggedBootDevicesTest-1369002241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:12:08 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-1e15af81-b2c5-499d-b4e8-9f6273281321 req-eb23b63e-379b-44c3-9ffd-3bfd79ff77a9 tempest-TaggedBootDevicesTest-1369002241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.010s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:12:08 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd43eb43-5e80-4f45-9917-f1f360c85509]: (4, 'raw') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:12:08 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-1e15af81-b2c5-499d-b4e8-9f6273281321 req-eb23b63e-379b-44c3-9ffd-3bfd79ff77a9 tempest-TaggedBootDevicesTest-1369002241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-8c2f424f-6634-4eab-a7d4-8673a507b137 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:12:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-1e15af81-b2c5-499d-b4e8-9f6273281321 req-eb23b63e-379b-44c3-9ffd-3bfd79ff77a9 tempest-TaggedBootDevicesTest-1369002241 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-8c2f424f-6634-4eab-a7d4-8673a507b137" returned: 0 in 0.700s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:12:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-1e15af81-b2c5-499d-b4e8-9f6273281321 req-eb23b63e-379b-44c3-9ffd-3bfd79ff77a9 tempest-TaggedBootDevicesTest-1369002241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-8c2f424f-6634-4eab-a7d4-8673a507b137 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:12:10 devstack quobyte-client[82807]: System call of process 88182 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:12:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-1e15af81-b2c5-499d-b4e8-9f6273281321 req-eb23b63e-379b-44c3-9ffd-3bfd79ff77a9 tempest-TaggedBootDevicesTest-1369002241 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-8c2f424f-6634-4eab-a7d4-8673a507b137" returned: 1 in 1.343s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:12:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-1e15af81-b2c5-499d-b4e8-9f6273281321 req-eb23b63e-379b-44c3-9ffd-3bfd79ff77a9 tempest-TaggedBootDevicesTest-1369002241 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-8c2f424f-6634-4eab-a7d4-8673a507b137' failed. Not Retrying. {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 21:12:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-1e15af81-b2c5-499d-b4e8-9f6273281321 req-eb23b63e-379b-44c3-9ffd-3bfd79ff77a9 tempest-TaggedBootDevicesTest-1369002241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.619s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:12:11 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-1e15af81-b2c5-499d-b4e8-9f6273281321 req-eb23b63e-379b-44c3-9ffd-3bfd79ff77a9 tempest-TaggedBootDevicesTest-1369002241 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b', 'name': 'volume-8c2f424f-6634-4eab-a7d4-8673a507b137', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cfd669cf-d575-4076-a1dc-a033618e207f', 'enforce_multipath': True} {{(pid=82780) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 21:12:11 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-1e15af81-b2c5-499d-b4e8-9f6273281321 req-eb23b63e-379b-44c3-9ffd-3bfd79ff77a9 tempest-TaggedBootDevicesTest-1369002241 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:12:11 devstack cinder-volume[82780]: INFO cinder.volume.manager [req-1e15af81-b2c5-499d-b4e8-9f6273281321 req-eb23b63e-379b-44c3-9ffd-3bfd79ff77a9 tempest-TaggedBootDevicesTest-1369002241 None] attachment_update completed successfully. Sep 10 21:12:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-1e15af81-b2c5-499d-b4e8-9f6273281321 req-35d6633f-1304-4e99-90f4-ee8973f5f81c tempest-TaggedBootDevicesTest-1369002241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:12:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-1e15af81-b2c5-499d-b4e8-9f6273281321 req-35d6633f-1304-4e99-90f4-ee8973f5f81c tempest-TaggedBootDevicesTest-1369002241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:12:14 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ea44f6-04bf-4895-9d95-0169fcd30128]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:12:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-1e15af81-b2c5-499d-b4e8-9f6273281321 req-35d6633f-1304-4e99-90f4-ee8973f5f81c tempest-TaggedBootDevicesTest-1369002241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-0af6e7a3-c94d-4831-80fa-ff84a93305f0 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:12:15 devstack quobyte-client[82807]: System call of process 88235 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:12:15 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-1e15af81-b2c5-499d-b4e8-9f6273281321 req-35d6633f-1304-4e99-90f4-ee8973f5f81c tempest-TaggedBootDevicesTest-1369002241 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-0af6e7a3-c94d-4831-80fa-ff84a93305f0" returned: 0 in 0.805s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:12:15 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-1e15af81-b2c5-499d-b4e8-9f6273281321 req-35d6633f-1304-4e99-90f4-ee8973f5f81c tempest-TaggedBootDevicesTest-1369002241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.873s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:12:15 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-1e15af81-b2c5-499d-b4e8-9f6273281321 req-35d6633f-1304-4e99-90f4-ee8973f5f81c tempest-TaggedBootDevicesTest-1369002241 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b', 'name': 'volume-0af6e7a3-c94d-4831-80fa-ff84a93305f0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6791a3f4-fecf-4c26-847d-b8a1e6a1aead', 'enforce_multipath': True} {{(pid=82780) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 21:12:15 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-1e15af81-b2c5-499d-b4e8-9f6273281321 req-35d6633f-1304-4e99-90f4-ee8973f5f81c tempest-TaggedBootDevicesTest-1369002241 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:12:16 devstack cinder-volume[82780]: INFO cinder.volume.manager [req-1e15af81-b2c5-499d-b4e8-9f6273281321 req-35d6633f-1304-4e99-90f4-ee8973f5f81c tempest-TaggedBootDevicesTest-1369002241 None] attachment_update completed successfully. Sep 10 21:12:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-1e15af81-b2c5-499d-b4e8-9f6273281321 req-2d10a66c-be70-4553-8026-2869bf9b5eda tempest-TaggedBootDevicesTest-1369002241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:12:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-1e15af81-b2c5-499d-b4e8-9f6273281321 req-2d10a66c-be70-4553-8026-2869bf9b5eda tempest-TaggedBootDevicesTest-1369002241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.011s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:12:20 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd334e13-1a0e-4205-bcea-dff74f4ee5a9]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:12:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-1e15af81-b2c5-499d-b4e8-9f6273281321 req-2d10a66c-be70-4553-8026-2869bf9b5eda tempest-TaggedBootDevicesTest-1369002241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-59b82959-6c72-4dbd-b407-19233e624c30 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:12:21 devstack quobyte-client[82807]: System call of process 88307 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:12:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-1e15af81-b2c5-499d-b4e8-9f6273281321 req-2d10a66c-be70-4553-8026-2869bf9b5eda tempest-TaggedBootDevicesTest-1369002241 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-59b82959-6c72-4dbd-b407-19233e624c30" returned: 0 in 1.196s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:12:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-1e15af81-b2c5-499d-b4e8-9f6273281321 req-2d10a66c-be70-4553-8026-2869bf9b5eda tempest-TaggedBootDevicesTest-1369002241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.322s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:12:22 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-1e15af81-b2c5-499d-b4e8-9f6273281321 req-2d10a66c-be70-4553-8026-2869bf9b5eda tempest-TaggedBootDevicesTest-1369002241 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b', 'name': 'volume-59b82959-6c72-4dbd-b407-19233e624c30', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8f5ef8fb-9f9d-482f-92c3-659a27f8e36a', 'enforce_multipath': True} {{(pid=82780) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 21:12:22 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-1e15af81-b2c5-499d-b4e8-9f6273281321 req-2d10a66c-be70-4553-8026-2869bf9b5eda tempest-TaggedBootDevicesTest-1369002241 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:12:23 devstack cinder-volume[82780]: INFO cinder.volume.manager [req-1e15af81-b2c5-499d-b4e8-9f6273281321 req-2d10a66c-be70-4553-8026-2869bf9b5eda tempest-TaggedBootDevicesTest-1369002241 None] attachment_update completed successfully. Sep 10 21:12:27 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-69e6b200-a23d-4bd7-b228-fa7900eb41ec tempest-VolumesActionsTest-1621937453 None] Acquiring lock "cinder-5ba4dc01-f436-4319-9ebc-16c2724bdfde" by "attach_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:12:27 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-69e6b200-a23d-4bd7-b228-fa7900eb41ec tempest-VolumesActionsTest-1621937453 None] Lock "cinder-5ba4dc01-f436-4319-9ebc-16c2724bdfde" acquired by "attach_volume" :: waited 0.162s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:12:28 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-69e6b200-a23d-4bd7-b228-fa7900eb41ec tempest-VolumesActionsTest-1621937453 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:12:28 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-69e6b200-a23d-4bd7-b228-fa7900eb41ec tempest-VolumesActionsTest-1621937453 None] Attaching volume 5ba4dc01-f436-4319-9ebc-16c2724bdfde to instance 26a52867-ba5c-4070-ae5d-2d3904aafab8 at mountpoint /dev/vdb on host None. Sep 10 21:12:28 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-69e6b200-a23d-4bd7-b228-fa7900eb41ec tempest-VolumesActionsTest-1621937453 None] Attach volume completed successfully. Sep 10 21:12:28 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-69e6b200-a23d-4bd7-b228-fa7900eb41ec tempest-VolumesActionsTest-1621937453 None] Lock "cinder-5ba4dc01-f436-4319-9ebc-16c2724bdfde" released by "attach_volume" :: held 0.342s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:12:29 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-f1a7e014-1ec4-4b7b-aa54-c2c168e7d434 tempest-VolumesActionsTest-1621937453 None] Acquiring lock "cinder-5ba4dc01-f436-4319-9ebc-16c2724bdfde-detach_volume" by "detach_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:12:29 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-f1a7e014-1ec4-4b7b-aa54-c2c168e7d434 tempest-VolumesActionsTest-1621937453 None] Lock "cinder-5ba4dc01-f436-4319-9ebc-16c2724bdfde-detach_volume" acquired by "detach_volume" :: waited 0.052s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:12:29 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-f1a7e014-1ec4-4b7b-aa54-c2c168e7d434 tempest-VolumesActionsTest-1621937453 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:12:29 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-f1a7e014-1ec4-4b7b-aa54-c2c168e7d434 tempest-VolumesActionsTest-1621937453 None] Detaching volume 5ba4dc01-f436-4319-9ebc-16c2724bdfde from instance 26a52867-ba5c-4070-ae5d-2d3904aafab8. Sep 10 21:12:29 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-f1a7e014-1ec4-4b7b-aa54-c2c168e7d434 tempest-VolumesActionsTest-1621937453 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:12:29 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-f1a7e014-1ec4-4b7b-aa54-c2c168e7d434 tempest-VolumesActionsTest-1621937453 None] Detach volume completed successfully. Sep 10 21:12:29 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-f1a7e014-1ec4-4b7b-aa54-c2c168e7d434 tempest-VolumesActionsTest-1621937453 None] Lock "cinder-5ba4dc01-f436-4319-9ebc-16c2724bdfde-detach_volume" released by "detach_volume" :: held 0.244s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:12:39 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=22,cinder:UPDATE=8,cinder:INSERT=2 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:12:39 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=24,cinder:UPDATE=7 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:12:42 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-9f7294df-f169-442f-9544-b8a39fab1d77 tempest-VolumesActionsTest-1621937453 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:12:42 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-9f7294df-f169-442f-9544-b8a39fab1d77 tempest-VolumesActionsTest-1621937453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:12:42 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-9f7294df-f169-442f-9544-b8a39fab1d77 tempest-VolumesActionsTest-1621937453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:12:43 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb6961b-5ea7-4dfa-84b0-551fa1a7fddf]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:12:43 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9f7294df-f169-442f-9544-b8a39fab1d77 tempest-VolumesActionsTest-1621937453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5ba4dc01-f436-4319-9ebc-16c2724bdfde {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:12:44 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9f7294df-f169-442f-9544-b8a39fab1d77 tempest-VolumesActionsTest-1621937453 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5ba4dc01-f436-4319-9ebc-16c2724bdfde" returned: 0 in 1.618s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:12:44 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fed8568-d653-43c2-b447-b9e87295d173]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:12:44 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9f7294df-f169-442f-9544-b8a39fab1d77 tempest-VolumesActionsTest-1621937453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5ba4dc01-f436-4319-9ebc-16c2724bdfde {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:12:45 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9f7294df-f169-442f-9544-b8a39fab1d77 tempest-VolumesActionsTest-1621937453 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5ba4dc01-f436-4319-9ebc-16c2724bdfde" returned: 0 in 0.635s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:12:45 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9f7294df-f169-442f-9544-b8a39fab1d77 tempest-VolumesActionsTest-1621937453 None] Running cmd (subprocess): qemu-img convert -O raw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5ba4dc01-f436-4319-9ebc-16c2724bdfde /opt/stack/data/cinder/conversion/5ba4dc01-f436-4319-9ebc-16c2724bdfde.temp_image.4e8d7210-b5f6-4b52-93a3-b4c5bc0f529doj7w1akw.img {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:12:52 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=1 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:12:53 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9f7294df-f169-442f-9544-b8a39fab1d77 tempest-VolumesActionsTest-1621937453 None] CMD "qemu-img convert -O raw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5ba4dc01-f436-4319-9ebc-16c2724bdfde /opt/stack/data/cinder/conversion/5ba4dc01-f436-4319-9ebc-16c2724bdfde.temp_image.4e8d7210-b5f6-4b52-93a3-b4c5bc0f529doj7w1akw.img" returned: 0 in 8.262s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:12:53 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[e166656e-f9c7-4bb2-b311-c56e6b81174c]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:12:53 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9f7294df-f169-442f-9544-b8a39fab1d77 tempest-VolumesActionsTest-1621937453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5ba4dc01-f436-4319-9ebc-16c2724bdfde {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:12:54 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9f7294df-f169-442f-9544-b8a39fab1d77 tempest-VolumesActionsTest-1621937453 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5ba4dc01-f436-4319-9ebc-16c2724bdfde" returned: 0 in 0.956s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:12:54 devstack cinder-volume[82780]: DEBUG cinder.image.image_utils [None req-9f7294df-f169-442f-9544-b8a39fab1d77 tempest-VolumesActionsTest-1621937453 None] Image conversion details: src /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5ba4dc01-f436-4319-9ebc-16c2724bdfde, size 1024.00 MB, duration 8.28 sec, destination /opt/stack/data/cinder/conversion/5ba4dc01-f436-4319-9ebc-16c2724bdfde.temp_image.4e8d7210-b5f6-4b52-93a3-b4c5bc0f529doj7w1akw.img {{(pid=82780) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 10 21:12:54 devstack cinder-volume[82780]: INFO cinder.image.image_utils [None req-9f7294df-f169-442f-9544-b8a39fab1d77 tempest-VolumesActionsTest-1621937453 None] Converted 1024.00 MB image at 123.74 MB/s Sep 10 21:12:54 devstack cinder-volume[82780]: DEBUG cinder.image.image_utils [None req-9f7294df-f169-442f-9544-b8a39fab1d77 tempest-VolumesActionsTest-1621937453 None] 4e8d7210-b5f6-4b52-93a3-b4c5bc0f529d was raw, no need to convert to raw {{(pid=82780) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1127}} Sep 10 21:13:04 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=2 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:13:07 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-45ec26c2-bb11-47f6-b17b-5ee0ae16f1ea tempest-AttachVolumeShelveTestJSON-724512628 None] Acquiring lock "cinder-2dcc93b5-fc71-40f0-bdb1-84076e8851c5-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:13:08 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-45ec26c2-bb11-47f6-b17b-5ee0ae16f1ea tempest-AttachVolumeShelveTestJSON-724512628 None] Lock "cinder-2dcc93b5-fc71-40f0-bdb1-84076e8851c5-delete_volume" acquired by "delete_volume" :: waited 0.587s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:13:09 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-45ec26c2-bb11-47f6-b17b-5ee0ae16f1ea tempest-AttachVolumeShelveTestJSON-724512628 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:13:09 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-45ec26c2-bb11-47f6-b17b-5ee0ae16f1ea tempest-AttachVolumeShelveTestJSON-724512628 None] Acquiring lock "cinder-quobyte-2dcc93b5-fc71-40f0-bdb1-84076e8851c5" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:13:09 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-45ec26c2-bb11-47f6-b17b-5ee0ae16f1ea tempest-AttachVolumeShelveTestJSON-724512628 None] Lock "cinder-quobyte-2dcc93b5-fc71-40f0-bdb1-84076e8851c5" acquired by "delete_volume" :: waited 0.500s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:13:10 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6c2450-1a71-4e1d-8309-d99cc4349b3f]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:13:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-45ec26c2-bb11-47f6-b17b-5ee0ae16f1ea tempest-AttachVolumeShelveTestJSON-724512628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-2dcc93b5-fc71-40f0-bdb1-84076e8851c5 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:13:13 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-45ec26c2-bb11-47f6-b17b-5ee0ae16f1ea tempest-AttachVolumeShelveTestJSON-724512628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-2dcc93b5-fc71-40f0-bdb1-84076e8851c5" returned: 0 in 3.028s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:13:13 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-45ec26c2-bb11-47f6-b17b-5ee0ae16f1ea tempest-AttachVolumeShelveTestJSON-724512628 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-2dcc93b5-fc71-40f0-bdb1-84076e8851c5 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:13:13 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-45ec26c2-bb11-47f6-b17b-5ee0ae16f1ea tempest-AttachVolumeShelveTestJSON-724512628 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-2dcc93b5-fc71-40f0-bdb1-84076e8851c5" returned: 0 in 0.231s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:13:13 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-45ec26c2-bb11-47f6-b17b-5ee0ae16f1ea tempest-AttachVolumeShelveTestJSON-724512628 None] Lock "cinder-quobyte-2dcc93b5-fc71-40f0-bdb1-84076e8851c5" released by "delete_volume" :: held 4.091s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:13:15 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-45ec26c2-bb11-47f6-b17b-5ee0ae16f1ea tempest-AttachVolumeShelveTestJSON-724512628 None] Created reservations ['90b293d5-ed50-4c7e-bb5b-ee80b95f77bd', '052ccbc7-ce37-46d8-8f11-6794ff1b2c8f', 'd6e1c2bb-00e9-4096-a3bc-ab6821695c2f', '2d0226c8-722f-4c34-8fd6-ee5f1a629673'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:13:16 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-45ec26c2-bb11-47f6-b17b-5ee0ae16f1ea tempest-AttachVolumeShelveTestJSON-724512628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:13:16 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-45ec26c2-bb11-47f6-b17b-5ee0ae16f1ea tempest-AttachVolumeShelveTestJSON-724512628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:13:16 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-45ec26c2-bb11-47f6-b17b-5ee0ae16f1ea tempest-AttachVolumeShelveTestJSON-724512628 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:13:16 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-45ec26c2-bb11-47f6-b17b-5ee0ae16f1ea tempest-AttachVolumeShelveTestJSON-724512628 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:13:16 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-45ec26c2-bb11-47f6-b17b-5ee0ae16f1ea tempest-AttachVolumeShelveTestJSON-724512628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:13:16 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-45ec26c2-bb11-47f6-b17b-5ee0ae16f1ea tempest-AttachVolumeShelveTestJSON-724512628 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:13:16 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-45ec26c2-bb11-47f6-b17b-5ee0ae16f1ea tempest-AttachVolumeShelveTestJSON-724512628 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.220s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:13:16 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-45ec26c2-bb11-47f6-b17b-5ee0ae16f1ea tempest-AttachVolumeShelveTestJSON-724512628 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:13:16 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-45ec26c2-bb11-47f6-b17b-5ee0ae16f1ea tempest-AttachVolumeShelveTestJSON-724512628 None] Deleted volume successfully. Sep 10 21:13:17 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-45ec26c2-bb11-47f6-b17b-5ee0ae16f1ea tempest-AttachVolumeShelveTestJSON-724512628 None] Lock "cinder-2dcc93b5-fc71-40f0-bdb1-84076e8851c5-delete_volume" released by "delete_volume" :: held 9.536s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:13:18 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-626aba2c-0af1-46ea-a344-85b1bd148611 tempest-AttachVolumeShelveTestJSON-724512628 None] Acquiring lock "cinder-1820ef43-e278-4739-b51e-e108ae69eccb-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:13:18 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-626aba2c-0af1-46ea-a344-85b1bd148611 tempest-AttachVolumeShelveTestJSON-724512628 None] Lock "cinder-1820ef43-e278-4739-b51e-e108ae69eccb-delete_volume" acquired by "delete_volume" :: waited 0.311s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:13:18 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-626aba2c-0af1-46ea-a344-85b1bd148611 tempest-AttachVolumeShelveTestJSON-724512628 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:13:18 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-626aba2c-0af1-46ea-a344-85b1bd148611 tempest-AttachVolumeShelveTestJSON-724512628 None] Acquiring lock "cinder-quobyte-1820ef43-e278-4739-b51e-e108ae69eccb" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:13:19 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-626aba2c-0af1-46ea-a344-85b1bd148611 tempest-AttachVolumeShelveTestJSON-724512628 None] Lock "cinder-quobyte-1820ef43-e278-4739-b51e-e108ae69eccb" acquired by "delete_volume" :: waited 0.514s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:13:19 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e85d24d-fdd9-4590-96cf-b37ec74b255b]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:13:19 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-626aba2c-0af1-46ea-a344-85b1bd148611 tempest-AttachVolumeShelveTestJSON-724512628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1820ef43-e278-4739-b51e-e108ae69eccb {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:13:20 devstack quobyte-client[82807]: System call of process 89309 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:13:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-626aba2c-0af1-46ea-a344-85b1bd148611 tempest-AttachVolumeShelveTestJSON-724512628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1820ef43-e278-4739-b51e-e108ae69eccb" returned: 0 in 2.261s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:13:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-626aba2c-0af1-46ea-a344-85b1bd148611 tempest-AttachVolumeShelveTestJSON-724512628 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1820ef43-e278-4739-b51e-e108ae69eccb {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:13:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-626aba2c-0af1-46ea-a344-85b1bd148611 tempest-AttachVolumeShelveTestJSON-724512628 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1820ef43-e278-4739-b51e-e108ae69eccb" returned: 0 in 0.604s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:13:22 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-626aba2c-0af1-46ea-a344-85b1bd148611 tempest-AttachVolumeShelveTestJSON-724512628 None] Lock "cinder-quobyte-1820ef43-e278-4739-b51e-e108ae69eccb" released by "delete_volume" :: held 3.541s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:13:23 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-626aba2c-0af1-46ea-a344-85b1bd148611 tempest-AttachVolumeShelveTestJSON-724512628 None] Created reservations ['c8a557dc-8ff7-45bd-b3df-e24399cca486', '0a272c92-111d-42ee-9ef2-57821fc751b2', '6951411e-e5f5-4a10-821b-f46d64ae0fbc', '974ea868-95c3-4c48-a549-1429aafe0b4f'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:13:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-626aba2c-0af1-46ea-a344-85b1bd148611 tempest-AttachVolumeShelveTestJSON-724512628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:13:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-626aba2c-0af1-46ea-a344-85b1bd148611 tempest-AttachVolumeShelveTestJSON-724512628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:13:24 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-626aba2c-0af1-46ea-a344-85b1bd148611 tempest-AttachVolumeShelveTestJSON-724512628 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:13:24 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-626aba2c-0af1-46ea-a344-85b1bd148611 tempest-AttachVolumeShelveTestJSON-724512628 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:13:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-626aba2c-0af1-46ea-a344-85b1bd148611 tempest-AttachVolumeShelveTestJSON-724512628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:13:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-626aba2c-0af1-46ea-a344-85b1bd148611 tempest-AttachVolumeShelveTestJSON-724512628 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:13:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-626aba2c-0af1-46ea-a344-85b1bd148611 tempest-AttachVolumeShelveTestJSON-724512628 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.405s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:13:24 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-626aba2c-0af1-46ea-a344-85b1bd148611 tempest-AttachVolumeShelveTestJSON-724512628 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:13:24 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-626aba2c-0af1-46ea-a344-85b1bd148611 tempest-AttachVolumeShelveTestJSON-724512628 None] Deleted volume successfully. Sep 10 21:13:25 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-626aba2c-0af1-46ea-a344-85b1bd148611 tempest-AttachVolumeShelveTestJSON-724512628 None] Lock "cinder-1820ef43-e278-4739-b51e-e108ae69eccb-delete_volume" released by "delete_volume" :: held 7.374s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:13:34 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=9,cinder:UPDATE=16,cinder:DELETE=1 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:13:35 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:UPDATE=16,cinder:SELECT=11,cinder:INSERT=8,cinder:DELETE=1 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:13:56 devstack cinder-volume[82780]: DEBUG oslo_service.periodic_task [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82780) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 21:13:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:13:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:13:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:13:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:13:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:13:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:13:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.178s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:13:56 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:13:59 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=1 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:13:59 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:UPDATE=1 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:14:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-9f7294df-f169-442f-9544-b8a39fab1d77 tempest-VolumesActionsTest-1621937453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 108.230s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:14:31 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-9f7294df-f169-442f-9544-b8a39fab1d77 tempest-VolumesActionsTest-1621937453 None] Uploaded volume to glance image-id: 4e8d7210-b5f6-4b52-93a3-b4c5bc0f529d. {{(pid=82780) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}} Sep 10 21:14:31 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-9f7294df-f169-442f-9544-b8a39fab1d77 tempest-VolumesActionsTest-1621937453 None] Copy volume to image completed successfully. Sep 10 21:14:33 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-9e05d99f-51ee-4949-9863-15354a697aed tempest-VolumesActionsTest-1621937453 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:14:33 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-9e05d99f-51ee-4949-9863-15354a697aed tempest-VolumesActionsTest-1621937453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:14:33 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-9e05d99f-51ee-4949-9863-15354a697aed tempest-VolumesActionsTest-1621937453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.011s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:14:33 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76f50ae-0a9f-416f-ad06-4fee5a3bf144]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:14:33 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9e05d99f-51ee-4949-9863-15354a697aed tempest-VolumesActionsTest-1621937453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5ba4dc01-f436-4319-9ebc-16c2724bdfde {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:14:34 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9e05d99f-51ee-4949-9863-15354a697aed tempest-VolumesActionsTest-1621937453 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5ba4dc01-f436-4319-9ebc-16c2724bdfde" returned: 0 in 0.634s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:14:34 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fab0cfb-9b56-4373-ba63-d81368740284]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:14:34 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9e05d99f-51ee-4949-9863-15354a697aed tempest-VolumesActionsTest-1621937453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5ba4dc01-f436-4319-9ebc-16c2724bdfde {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:14:35 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9e05d99f-51ee-4949-9863-15354a697aed tempest-VolumesActionsTest-1621937453 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5ba4dc01-f436-4319-9ebc-16c2724bdfde" returned: 0 in 0.449s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:14:35 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9e05d99f-51ee-4949-9863-15354a697aed tempest-VolumesActionsTest-1621937453 None] Running cmd (subprocess): qemu-img convert -O raw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5ba4dc01-f436-4319-9ebc-16c2724bdfde /opt/stack/data/cinder/conversion/5ba4dc01-f436-4319-9ebc-16c2724bdfde.temp_image.765543ec-1c7e-4b61-8c73-0c7488d5721fvbbyfol3.img {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:14:35 devstack quobyte-client[82807]: System call of process 89482 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:14:41 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:UPDATE=1 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:14:43 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=2 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:14:47 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9e05d99f-51ee-4949-9863-15354a697aed tempest-VolumesActionsTest-1621937453 None] CMD "qemu-img convert -O raw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5ba4dc01-f436-4319-9ebc-16c2724bdfde /opt/stack/data/cinder/conversion/5ba4dc01-f436-4319-9ebc-16c2724bdfde.temp_image.765543ec-1c7e-4b61-8c73-0c7488d5721fvbbyfol3.img" returned: 0 in 12.201s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:14:47 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2b01f8-212e-4ee2-bcfe-34bf962e6b61]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:14:47 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9e05d99f-51ee-4949-9863-15354a697aed tempest-VolumesActionsTest-1621937453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5ba4dc01-f436-4319-9ebc-16c2724bdfde {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:14:49 devstack quobyte-client[82807]: System call of process 89550 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:14:49 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9e05d99f-51ee-4949-9863-15354a697aed tempest-VolumesActionsTest-1621937453 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5ba4dc01-f436-4319-9ebc-16c2724bdfde" returned: 0 in 2.077s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:14:49 devstack cinder-volume[82780]: DEBUG cinder.image.image_utils [None req-9e05d99f-51ee-4949-9863-15354a697aed tempest-VolumesActionsTest-1621937453 None] Image conversion details: src /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5ba4dc01-f436-4319-9ebc-16c2724bdfde, size 1024.00 MB, duration 12.25 sec, destination /opt/stack/data/cinder/conversion/5ba4dc01-f436-4319-9ebc-16c2724bdfde.temp_image.765543ec-1c7e-4b61-8c73-0c7488d5721fvbbyfol3.img {{(pid=82780) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 10 21:14:49 devstack cinder-volume[82780]: INFO cinder.image.image_utils [None req-9e05d99f-51ee-4949-9863-15354a697aed tempest-VolumesActionsTest-1621937453 None] Converted 1024.00 MB image at 83.60 MB/s Sep 10 21:14:49 devstack cinder-volume[82780]: DEBUG cinder.image.image_utils [None req-9e05d99f-51ee-4949-9863-15354a697aed tempest-VolumesActionsTest-1621937453 None] 765543ec-1c7e-4b61-8c73-0c7488d5721f was raw, converting to qcow2 {{(pid=82780) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1144}} Sep 10 21:14:50 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1fe4d8c-b979-49c2-8fdd-29f0f7644e02]: (4, 'raw') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:14:50 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9e05d99f-51ee-4949-9863-15354a697aed tempest-VolumesActionsTest-1621937453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5ba4dc01-f436-4319-9ebc-16c2724bdfde.temp_image.765543ec-1c7e-4b61-8c73-0c7488d5721fvbbyfol3.img {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:14:51 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9e05d99f-51ee-4949-9863-15354a697aed tempest-VolumesActionsTest-1621937453 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5ba4dc01-f436-4319-9ebc-16c2724bdfde.temp_image.765543ec-1c7e-4b61-8c73-0c7488d5721fvbbyfol3.img" returned: 0 in 1.169s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:14:51 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9e05d99f-51ee-4949-9863-15354a697aed tempest-VolumesActionsTest-1621937453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5ba4dc01-f436-4319-9ebc-16c2724bdfde.temp_image.765543ec-1c7e-4b61-8c73-0c7488d5721fvbbyfol3.img {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:14:53 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9e05d99f-51ee-4949-9863-15354a697aed tempest-VolumesActionsTest-1621937453 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5ba4dc01-f436-4319-9ebc-16c2724bdfde.temp_image.765543ec-1c7e-4b61-8c73-0c7488d5721fvbbyfol3.img" returned: 1 in 2.566s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:14:53 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9e05d99f-51ee-4949-9863-15354a697aed tempest-VolumesActionsTest-1621937453 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5ba4dc01-f436-4319-9ebc-16c2724bdfde.temp_image.765543ec-1c7e-4b61-8c73-0c7488d5721fvbbyfol3.img' failed. Not Retrying. {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 21:14:53 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9e05d99f-51ee-4949-9863-15354a697aed tempest-VolumesActionsTest-1621937453 None] Running cmd (subprocess): qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5ba4dc01-f436-4319-9ebc-16c2724bdfde.temp_image.765543ec-1c7e-4b61-8c73-0c7488d5721fvbbyfol3.img /opt/stack/data/cinder/conversion/vol_upload_oduzk__6 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:14:54 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9e05d99f-51ee-4949-9863-15354a697aed tempest-VolumesActionsTest-1621937453 None] CMD "qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5ba4dc01-f436-4319-9ebc-16c2724bdfde.temp_image.765543ec-1c7e-4b61-8c73-0c7488d5721fvbbyfol3.img /opt/stack/data/cinder/conversion/vol_upload_oduzk__6" returned: 0 in 0.510s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:14:54 devstack cinder-volume[82780]: DEBUG cinder.image.image_utils [None req-9e05d99f-51ee-4949-9863-15354a697aed tempest-VolumesActionsTest-1621937453 None] Image conversion details: src /opt/stack/data/cinder/conversion/5ba4dc01-f436-4319-9ebc-16c2724bdfde.temp_image.765543ec-1c7e-4b61-8c73-0c7488d5721fvbbyfol3.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_oduzk__6 {{(pid=82780) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 10 21:14:54 devstack cinder-volume[82780]: INFO cinder.image.image_utils [None req-9e05d99f-51ee-4949-9863-15354a697aed tempest-VolumesActionsTest-1621937453 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 10 21:14:54 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d68a53-0498-489b-af71-4110b141bbc5]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:14:54 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9e05d99f-51ee-4949-9863-15354a697aed tempest-VolumesActionsTest-1621937453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_oduzk__6 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:14:55 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9e05d99f-51ee-4949-9863-15354a697aed tempest-VolumesActionsTest-1621937453 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_oduzk__6" returned: 0 in 1.054s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:14:56 devstack cinder-volume[82780]: DEBUG oslo_service.periodic_task [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82780) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 21:14:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:14:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:14:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:14:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:14:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.138s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:14:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:14:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.287s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:14:57 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:14:59 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=2 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:15:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-9e05d99f-51ee-4949-9863-15354a697aed tempest-VolumesActionsTest-1621937453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 27.462s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:15:01 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-9e05d99f-51ee-4949-9863-15354a697aed tempest-VolumesActionsTest-1621937453 None] Uploaded volume to glance image-id: 765543ec-1c7e-4b61-8c73-0c7488d5721f. {{(pid=82780) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}} Sep 10 21:15:01 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-9e05d99f-51ee-4949-9863-15354a697aed tempest-VolumesActionsTest-1621937453 None] Copy volume to image completed successfully. Sep 10 21:15:04 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-e4a78233-3b45-4d1a-8b03-844e3eca94b9 tempest-VolumesActionsTest-1621937453 None] Acquiring lock "cinder-5ba4dc01-f436-4319-9ebc-16c2724bdfde-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:15:04 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-e4a78233-3b45-4d1a-8b03-844e3eca94b9 tempest-VolumesActionsTest-1621937453 None] Lock "cinder-5ba4dc01-f436-4319-9ebc-16c2724bdfde-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:15:04 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-e4a78233-3b45-4d1a-8b03-844e3eca94b9 tempest-VolumesActionsTest-1621937453 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:15:04 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-e4a78233-3b45-4d1a-8b03-844e3eca94b9 tempest-VolumesActionsTest-1621937453 None] Acquiring lock "cinder-quobyte-5ba4dc01-f436-4319-9ebc-16c2724bdfde" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:15:04 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-e4a78233-3b45-4d1a-8b03-844e3eca94b9 tempest-VolumesActionsTest-1621937453 None] Lock "cinder-quobyte-5ba4dc01-f436-4319-9ebc-16c2724bdfde" acquired by "delete_volume" :: waited 0.030s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:15:04 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45cdfb4-0712-445b-9e0c-3b97b81d7d71]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:15:04 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e4a78233-3b45-4d1a-8b03-844e3eca94b9 tempest-VolumesActionsTest-1621937453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5ba4dc01-f436-4319-9ebc-16c2724bdfde {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:15:05 devstack quobyte-client[82807]: System call of process 89604 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:15:05 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e4a78233-3b45-4d1a-8b03-844e3eca94b9 tempest-VolumesActionsTest-1621937453 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5ba4dc01-f436-4319-9ebc-16c2724bdfde" returned: 0 in 0.707s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:15:05 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e4a78233-3b45-4d1a-8b03-844e3eca94b9 tempest-VolumesActionsTest-1621937453 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5ba4dc01-f436-4319-9ebc-16c2724bdfde {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:15:05 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e4a78233-3b45-4d1a-8b03-844e3eca94b9 tempest-VolumesActionsTest-1621937453 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5ba4dc01-f436-4319-9ebc-16c2724bdfde" returned: 0 in 0.144s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:15:05 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-e4a78233-3b45-4d1a-8b03-844e3eca94b9 tempest-VolumesActionsTest-1621937453 None] Lock "cinder-quobyte-5ba4dc01-f436-4319-9ebc-16c2724bdfde" released by "delete_volume" :: held 1.098s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:15:05 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-e4a78233-3b45-4d1a-8b03-844e3eca94b9 tempest-VolumesActionsTest-1621937453 None] Created reservations ['065caacf-09b8-41fa-bc14-2e341efe13ec', 'f9092824-0c44-40fb-bcca-87eaea699f8c', 'f881d375-992f-484d-91af-2b3a23e29bce', '2963ef09-70e2-470e-b793-19ac837b4da5'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:15:06 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-e4a78233-3b45-4d1a-8b03-844e3eca94b9 tempest-VolumesActionsTest-1621937453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:15:06 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-e4a78233-3b45-4d1a-8b03-844e3eca94b9 tempest-VolumesActionsTest-1621937453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:15:06 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-e4a78233-3b45-4d1a-8b03-844e3eca94b9 tempest-VolumesActionsTest-1621937453 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:15:06 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-e4a78233-3b45-4d1a-8b03-844e3eca94b9 tempest-VolumesActionsTest-1621937453 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:15:06 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-e4a78233-3b45-4d1a-8b03-844e3eca94b9 tempest-VolumesActionsTest-1621937453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:15:06 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e4a78233-3b45-4d1a-8b03-844e3eca94b9 tempest-VolumesActionsTest-1621937453 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:15:06 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e4a78233-3b45-4d1a-8b03-844e3eca94b9 tempest-VolumesActionsTest-1621937453 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.258s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:15:06 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-e4a78233-3b45-4d1a-8b03-844e3eca94b9 tempest-VolumesActionsTest-1621937453 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:15:07 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-e4a78233-3b45-4d1a-8b03-844e3eca94b9 tempest-VolumesActionsTest-1621937453 None] Deleted volume successfully. Sep 10 21:15:07 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-e4a78233-3b45-4d1a-8b03-844e3eca94b9 tempest-VolumesActionsTest-1621937453 None] Lock "cinder-5ba4dc01-f436-4319-9ebc-16c2724bdfde-delete_volume" released by "delete_volume" :: held 3.399s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:15:16 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=5,cinder:UPDATE=8 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:15:17 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=6,cinder:UPDATE=9,cinder:INSERT=4,cinder:DELETE=1 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:15:35 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-c93dc157-0094-4a65-a02e-0778266e4ed8 tempest-VolumesNegativeTest-1741836851 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:15:35 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-c93dc157-0094-4a65-a02e-0778266e4ed8 tempest-VolumesNegativeTest-1741836851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:15:35 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c93dc157-0094-4a65-a02e-0778266e4ed8 tempest-VolumesNegativeTest-1741836851 None] Flow 'volume_create_manager' (33107c03-e58f-4e95-9925-669898c7f2f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:15:35 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c93dc157-0094-4a65-a02e-0778266e4ed8 tempest-VolumesNegativeTest-1741836851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db21b03b-6a95-41ce-9d48-ac605a783ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:15:36 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c93dc157-0094-4a65-a02e-0778266e4ed8 tempest-VolumesNegativeTest-1741836851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db21b03b-6a95-41ce-9d48-ac605a783ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:15:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-56450241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71c1837d-63e9-4235-9390-67b73c85eb49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='246b8ffd4a974c3b97a8bf888f98cc36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:15:35Z,use_quota=True,user_id='82b0bd5b31584fc19b4d873b45f6927a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:15:36 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c93dc157-0094-4a65-a02e-0778266e4ed8 tempest-VolumesNegativeTest-1741836851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6a589a6-b655-4357-a213-926863c43c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:15:36 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c93dc157-0094-4a65-a02e-0778266e4ed8 tempest-VolumesNegativeTest-1741836851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6a589a6-b655-4357-a213-926863c43c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:15:36 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c93dc157-0094-4a65-a02e-0778266e4ed8 tempest-VolumesNegativeTest-1741836851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00822a5f-bdba-43d5-adad-6a86b266be84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:15:36 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c93dc157-0094-4a65-a02e-0778266e4ed8 tempest-VolumesNegativeTest-1741836851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00822a5f-bdba-43d5-adad-6a86b266be84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71c1837d-63e9-4235-9390-67b73c85eb49', 'volume_name': 'volume-71c1837d-63e9-4235-9390-67b73c85eb49', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:15:36 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c93dc157-0094-4a65-a02e-0778266e4ed8 tempest-VolumesNegativeTest-1741836851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b997bc8-bd82-4ce2-a1b4-fbb25be11782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:15:36 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c93dc157-0094-4a65-a02e-0778266e4ed8 tempest-VolumesNegativeTest-1741836851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b997bc8-bd82-4ce2-a1b4-fbb25be11782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:15:36 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c93dc157-0094-4a65-a02e-0778266e4ed8 tempest-VolumesNegativeTest-1741836851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec7e611e-ed47-4b61-9d5a-a38faee7bc09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:15:36 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-c93dc157-0094-4a65-a02e-0778266e4ed8 tempest-VolumesNegativeTest-1741836851 None] Volume 71c1837d-63e9-4235-9390-67b73c85eb49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71c1837d-63e9-4235-9390-67b73c85eb49', 'volume_size': 1} Sep 10 21:15:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-c93dc157-0094-4a65-a02e-0778266e4ed8 tempest-VolumesNegativeTest-1741836851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:15:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-c93dc157-0094-4a65-a02e-0778266e4ed8 tempest-VolumesNegativeTest-1741836851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:15:36 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-c93dc157-0094-4a65-a02e-0778266e4ed8 tempest-VolumesNegativeTest-1741836851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:15:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-56450241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71c1837d-63e9-4235-9390-67b73c85eb49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='246b8ffd4a974c3b97a8bf888f98cc36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:15:35Z,use_quota=True,user_id='82b0bd5b31584fc19b4d873b45f6927a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:15:36 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-c93dc157-0094-4a65-a02e-0778266e4ed8 tempest-VolumesNegativeTest-1741836851 None] Creating volume 71c1837d-63e9-4235-9390-67b73c85eb49 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:15:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-c93dc157-0094-4a65-a02e-0778266e4ed8 tempest-VolumesNegativeTest-1741836851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:15:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-c93dc157-0094-4a65-a02e-0778266e4ed8 tempest-VolumesNegativeTest-1741836851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:15:36 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-c93dc157-0094-4a65-a02e-0778266e4ed8 tempest-VolumesNegativeTest-1741836851 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:15:36 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-c93dc157-0094-4a65-a02e-0778266e4ed8 tempest-VolumesNegativeTest-1741836851 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:15:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-c93dc157-0094-4a65-a02e-0778266e4ed8 tempest-VolumesNegativeTest-1741836851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:15:36 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-c93dc157-0094-4a65-a02e-0778266e4ed8 tempest-VolumesNegativeTest-1741836851 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:15:36 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-c93dc157-0094-4a65-a02e-0778266e4ed8 tempest-VolumesNegativeTest-1741836851 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:15:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c93dc157-0094-4a65-a02e-0778266e4ed8 tempest-VolumesNegativeTest-1741836851 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-71c1837d-63e9-4235-9390-67b73c85eb49 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:15:36 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=29, name=volume-71c1837d-63e9-4235-9390-67b73c85eb49, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:15:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c93dc157-0094-4a65-a02e-0778266e4ed8 tempest-VolumesNegativeTest-1741836851 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-71c1837d-63e9-4235-9390-67b73c85eb49 1073741824" returned: 0 in 0.796s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:15:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c93dc157-0094-4a65-a02e-0778266e4ed8 tempest-VolumesNegativeTest-1741836851 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-71c1837d-63e9-4235-9390-67b73c85eb49 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:15:37 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c93dc157-0094-4a65-a02e-0778266e4ed8 tempest-VolumesNegativeTest-1741836851 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-71c1837d-63e9-4235-9390-67b73c85eb49" returned: 0 in 0.232s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:15:37 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-c93dc157-0094-4a65-a02e-0778266e4ed8 tempest-VolumesNegativeTest-1741836851 None] <== create_volume: return (1157ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:15:37 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-c93dc157-0094-4a65-a02e-0778266e4ed8 tempest-VolumesNegativeTest-1741836851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.194s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:15:38 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c93dc157-0094-4a65-a02e-0778266e4ed8 tempest-VolumesNegativeTest-1741836851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec7e611e-ed47-4b61-9d5a-a38faee7bc09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71c1837d-63e9-4235-9390-67b73c85eb49', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:15:38 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c93dc157-0094-4a65-a02e-0778266e4ed8 tempest-VolumesNegativeTest-1741836851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (466932b6-06cf-4fe1-a626-8d455b0117f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:15:38 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-c93dc157-0094-4a65-a02e-0778266e4ed8 tempest-VolumesNegativeTest-1741836851 None] Volume volume-71c1837d-63e9-4235-9390-67b73c85eb49 (71c1837d-63e9-4235-9390-67b73c85eb49): created successfully Sep 10 21:15:38 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c93dc157-0094-4a65-a02e-0778266e4ed8 tempest-VolumesNegativeTest-1741836851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (466932b6-06cf-4fe1-a626-8d455b0117f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:15:38 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c93dc157-0094-4a65-a02e-0778266e4ed8 tempest-VolumesNegativeTest-1741836851 None] Flow 'volume_create_manager' (33107c03-e58f-4e95-9925-669898c7f2f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:15:38 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-c93dc157-0094-4a65-a02e-0778266e4ed8 tempest-VolumesNegativeTest-1741836851 None] Created volume successfully. Sep 10 21:15:41 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-81e13023-0df8-4d4b-8e9f-9e61e166f11f req-32d93e85-b46f-4ebb-bffe-ac734c0fe73b tempest-TaggedBootDevicesTest-1369002241 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:15:41 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-81e13023-0df8-4d4b-8e9f-9e61e166f11f req-32d93e85-b46f-4ebb-bffe-ac734c0fe73b tempest-TaggedBootDevicesTest-1369002241 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:15:41 devstack cinder-volume[82780]: INFO cinder.volume.manager [req-81e13023-0df8-4d4b-8e9f-9e61e166f11f req-32d93e85-b46f-4ebb-bffe-ac734c0fe73b tempest-TaggedBootDevicesTest-1369002241 None] Terminate volume connection completed successfully. Sep 10 21:15:41 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-81e13023-0df8-4d4b-8e9f-9e61e166f11f req-32d93e85-b46f-4ebb-bffe-ac734c0fe73b tempest-TaggedBootDevicesTest-1369002241 None] Deleting attachment 6791a3f4-fecf-4c26-847d-b8a1e6a1aead. {{(pid=82780) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 21:15:42 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-81e13023-0df8-4d4b-8e9f-9e61e166f11f req-5c1126bc-913d-4d83-8f61-add30febfee5 tempest-TaggedBootDevicesTest-1369002241 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:15:42 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-81e13023-0df8-4d4b-8e9f-9e61e166f11f req-5c1126bc-913d-4d83-8f61-add30febfee5 tempest-TaggedBootDevicesTest-1369002241 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:15:42 devstack cinder-volume[82780]: INFO cinder.volume.manager [req-81e13023-0df8-4d4b-8e9f-9e61e166f11f req-5c1126bc-913d-4d83-8f61-add30febfee5 tempest-TaggedBootDevicesTest-1369002241 None] Terminate volume connection completed successfully. Sep 10 21:15:42 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-81e13023-0df8-4d4b-8e9f-9e61e166f11f req-5c1126bc-913d-4d83-8f61-add30febfee5 tempest-TaggedBootDevicesTest-1369002241 None] Deleting attachment 8f5ef8fb-9f9d-482f-92c3-659a27f8e36a. {{(pid=82780) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 21:15:42 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-81e13023-0df8-4d4b-8e9f-9e61e166f11f req-eab0f701-2d01-4451-be7a-5f8484df891b tempest-TaggedBootDevicesTest-1369002241 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:15:42 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-81e13023-0df8-4d4b-8e9f-9e61e166f11f req-eab0f701-2d01-4451-be7a-5f8484df891b tempest-TaggedBootDevicesTest-1369002241 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:15:42 devstack cinder-volume[82780]: INFO cinder.volume.manager [req-81e13023-0df8-4d4b-8e9f-9e61e166f11f req-eab0f701-2d01-4451-be7a-5f8484df891b tempest-TaggedBootDevicesTest-1369002241 None] Terminate volume connection completed successfully. Sep 10 21:15:42 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-81e13023-0df8-4d4b-8e9f-9e61e166f11f req-eab0f701-2d01-4451-be7a-5f8484df891b tempest-TaggedBootDevicesTest-1369002241 None] Deleting attachment cfd669cf-d575-4076-a1dc-a033618e207f. {{(pid=82780) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 21:15:54 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-c53f64b6-f248-4e5f-828a-c7ac63cc5219 tempest-TaggedBootDevicesTest-1369002241 None] Acquiring lock "cinder-59b82959-6c72-4dbd-b407-19233e624c30-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:15:54 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-c53f64b6-f248-4e5f-828a-c7ac63cc5219 tempest-TaggedBootDevicesTest-1369002241 None] Lock "cinder-59b82959-6c72-4dbd-b407-19233e624c30-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:15:55 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-c53f64b6-f248-4e5f-828a-c7ac63cc5219 tempest-TaggedBootDevicesTest-1369002241 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:15:55 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-c53f64b6-f248-4e5f-828a-c7ac63cc5219 tempest-TaggedBootDevicesTest-1369002241 None] Acquiring lock "cinder-quobyte-59b82959-6c72-4dbd-b407-19233e624c30" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:15:55 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-c53f64b6-f248-4e5f-828a-c7ac63cc5219 tempest-TaggedBootDevicesTest-1369002241 None] Lock "cinder-quobyte-59b82959-6c72-4dbd-b407-19233e624c30" acquired by "delete_volume" :: waited 0.017s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:15:55 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[470e9b5e-f4aa-406a-8472-62695f7e2229]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:15:55 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c53f64b6-f248-4e5f-828a-c7ac63cc5219 tempest-TaggedBootDevicesTest-1369002241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-59b82959-6c72-4dbd-b407-19233e624c30 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:15:55 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c53f64b6-f248-4e5f-828a-c7ac63cc5219 tempest-TaggedBootDevicesTest-1369002241 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-59b82959-6c72-4dbd-b407-19233e624c30" returned: 0 in 0.555s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:15:55 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c53f64b6-f248-4e5f-828a-c7ac63cc5219 tempest-TaggedBootDevicesTest-1369002241 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-59b82959-6c72-4dbd-b407-19233e624c30 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:15:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c53f64b6-f248-4e5f-828a-c7ac63cc5219 tempest-TaggedBootDevicesTest-1369002241 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-59b82959-6c72-4dbd-b407-19233e624c30" returned: 0 in 0.143s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:15:56 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-c53f64b6-f248-4e5f-828a-c7ac63cc5219 tempest-TaggedBootDevicesTest-1369002241 None] Lock "cinder-quobyte-59b82959-6c72-4dbd-b407-19233e624c30" released by "delete_volume" :: held 1.026s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:15:56 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-c53f64b6-f248-4e5f-828a-c7ac63cc5219 tempest-TaggedBootDevicesTest-1369002241 None] Created reservations ['225771c0-2806-4b21-b73c-228a9470e5f0', 'c2c7a726-da8e-47bb-b6d4-2cdf89766b6b', '51f1803a-a062-49eb-a05b-3bd3e534e104', 'e9f4d889-5c02-4d85-b14e-c6e11399d5c1'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:15:56 devstack cinder-volume[82780]: DEBUG oslo_service.periodic_task [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82780) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 21:15:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:15:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:15:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:15:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:15:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:15:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:15:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-c53f64b6-f248-4e5f-828a-c7ac63cc5219 tempest-TaggedBootDevicesTest-1369002241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:15:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-c53f64b6-f248-4e5f-828a-c7ac63cc5219 tempest-TaggedBootDevicesTest-1369002241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.026s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:15:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-c53f64b6-f248-4e5f-828a-c7ac63cc5219 tempest-TaggedBootDevicesTest-1369002241 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:15:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-c53f64b6-f248-4e5f-828a-c7ac63cc5219 tempest-TaggedBootDevicesTest-1369002241 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:15:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-c53f64b6-f248-4e5f-828a-c7ac63cc5219 tempest-TaggedBootDevicesTest-1369002241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.059s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:15:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c53f64b6-f248-4e5f-828a-c7ac63cc5219 tempest-TaggedBootDevicesTest-1369002241 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:15:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.315s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:15:57 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:15:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c53f64b6-f248-4e5f-828a-c7ac63cc5219 tempest-TaggedBootDevicesTest-1369002241 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.227s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:15:57 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-c53f64b6-f248-4e5f-828a-c7ac63cc5219 tempest-TaggedBootDevicesTest-1369002241 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:15:57 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-c53f64b6-f248-4e5f-828a-c7ac63cc5219 tempest-TaggedBootDevicesTest-1369002241 None] Deleted volume successfully. Sep 10 21:15:57 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-03c77166-eed9-4f6d-abd8-fe150d977cc1 tempest-TaggedBootDevicesTest-1369002241 None] Acquiring lock "cinder-0af6e7a3-c94d-4831-80fa-ff84a93305f0-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:15:57 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-c53f64b6-f248-4e5f-828a-c7ac63cc5219 tempest-TaggedBootDevicesTest-1369002241 None] Lock "cinder-59b82959-6c72-4dbd-b407-19233e624c30-delete_volume" released by "delete_volume" :: held 2.862s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:15:57 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-03c77166-eed9-4f6d-abd8-fe150d977cc1 tempest-TaggedBootDevicesTest-1369002241 None] Lock "cinder-0af6e7a3-c94d-4831-80fa-ff84a93305f0-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:15:57 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-03c77166-eed9-4f6d-abd8-fe150d977cc1 tempest-TaggedBootDevicesTest-1369002241 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:15:57 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-03c77166-eed9-4f6d-abd8-fe150d977cc1 tempest-TaggedBootDevicesTest-1369002241 None] Acquiring lock "cinder-quobyte-0af6e7a3-c94d-4831-80fa-ff84a93305f0" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:15:57 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-03c77166-eed9-4f6d-abd8-fe150d977cc1 tempest-TaggedBootDevicesTest-1369002241 None] Lock "cinder-quobyte-0af6e7a3-c94d-4831-80fa-ff84a93305f0" acquired by "delete_volume" :: waited 0.025s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:15:57 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ab22cf-b06c-40d6-8ac1-42d6eaabad39]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:15:58 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-03c77166-eed9-4f6d-abd8-fe150d977cc1 tempest-TaggedBootDevicesTest-1369002241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-0af6e7a3-c94d-4831-80fa-ff84a93305f0 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:15:58 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-03c77166-eed9-4f6d-abd8-fe150d977cc1 tempest-TaggedBootDevicesTest-1369002241 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-0af6e7a3-c94d-4831-80fa-ff84a93305f0" returned: 0 in 0.537s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:15:58 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-03c77166-eed9-4f6d-abd8-fe150d977cc1 tempest-TaggedBootDevicesTest-1369002241 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-0af6e7a3-c94d-4831-80fa-ff84a93305f0 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:15:58 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-03c77166-eed9-4f6d-abd8-fe150d977cc1 tempest-TaggedBootDevicesTest-1369002241 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-0af6e7a3-c94d-4831-80fa-ff84a93305f0" returned: 0 in 0.098s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:15:58 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-03c77166-eed9-4f6d-abd8-fe150d977cc1 tempest-TaggedBootDevicesTest-1369002241 None] Lock "cinder-quobyte-0af6e7a3-c94d-4831-80fa-ff84a93305f0" released by "delete_volume" :: held 0.808s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:15:59 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-03c77166-eed9-4f6d-abd8-fe150d977cc1 tempest-TaggedBootDevicesTest-1369002241 None] Created reservations ['aec2170e-e8dc-4056-a47f-20714e2aef21', 'c42c505b-7206-4995-931d-379e4f9e21d4', '95842e60-3809-45c5-bfd0-ad05b7599759', '266c2a37-6c35-4b35-b3b9-fa86aac9d2c0'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:15:59 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-03c77166-eed9-4f6d-abd8-fe150d977cc1 tempest-TaggedBootDevicesTest-1369002241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:15:59 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-03c77166-eed9-4f6d-abd8-fe150d977cc1 tempest-TaggedBootDevicesTest-1369002241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:15:59 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-03c77166-eed9-4f6d-abd8-fe150d977cc1 tempest-TaggedBootDevicesTest-1369002241 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:15:59 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-03c77166-eed9-4f6d-abd8-fe150d977cc1 tempest-TaggedBootDevicesTest-1369002241 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:15:59 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-03c77166-eed9-4f6d-abd8-fe150d977cc1 tempest-TaggedBootDevicesTest-1369002241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:15:59 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-03c77166-eed9-4f6d-abd8-fe150d977cc1 tempest-TaggedBootDevicesTest-1369002241 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:15:59 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-03c77166-eed9-4f6d-abd8-fe150d977cc1 tempest-TaggedBootDevicesTest-1369002241 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.105s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:15:59 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-03c77166-eed9-4f6d-abd8-fe150d977cc1 tempest-TaggedBootDevicesTest-1369002241 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:15:59 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-03c77166-eed9-4f6d-abd8-fe150d977cc1 tempest-TaggedBootDevicesTest-1369002241 None] Deleted volume successfully. Sep 10 21:15:59 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-03c77166-eed9-4f6d-abd8-fe150d977cc1 tempest-TaggedBootDevicesTest-1369002241 None] Lock "cinder-0af6e7a3-c94d-4831-80fa-ff84a93305f0-delete_volume" released by "delete_volume" :: held 2.015s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:16:00 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-6d2f4095-b090-4575-a4b2-84df3a364bc5 tempest-TaggedBootDevicesTest-1369002241 None] Acquiring lock "cinder-8c2f424f-6634-4eab-a7d4-8673a507b137-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:16:00 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-6d2f4095-b090-4575-a4b2-84df3a364bc5 tempest-TaggedBootDevicesTest-1369002241 None] Lock "cinder-8c2f424f-6634-4eab-a7d4-8673a507b137-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:16:00 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-6d2f4095-b090-4575-a4b2-84df3a364bc5 tempest-TaggedBootDevicesTest-1369002241 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:16:00 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-6d2f4095-b090-4575-a4b2-84df3a364bc5 tempest-TaggedBootDevicesTest-1369002241 None] Acquiring lock "cinder-quobyte-8c2f424f-6634-4eab-a7d4-8673a507b137" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:16:00 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-6d2f4095-b090-4575-a4b2-84df3a364bc5 tempest-TaggedBootDevicesTest-1369002241 None] Lock "cinder-quobyte-8c2f424f-6634-4eab-a7d4-8673a507b137" acquired by "delete_volume" :: waited 0.027s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:16:00 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[4adcf5b2-ecc4-4b63-82fd-82da06c50799]: (4, 'raw') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:16:00 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-6d2f4095-b090-4575-a4b2-84df3a364bc5 tempest-TaggedBootDevicesTest-1369002241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-8c2f424f-6634-4eab-a7d4-8673a507b137 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:16:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-6d2f4095-b090-4575-a4b2-84df3a364bc5 tempest-TaggedBootDevicesTest-1369002241 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-8c2f424f-6634-4eab-a7d4-8673a507b137" returned: 0 in 0.568s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:16:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-6d2f4095-b090-4575-a4b2-84df3a364bc5 tempest-TaggedBootDevicesTest-1369002241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-8c2f424f-6634-4eab-a7d4-8673a507b137 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:16:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-6d2f4095-b090-4575-a4b2-84df3a364bc5 tempest-TaggedBootDevicesTest-1369002241 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-8c2f424f-6634-4eab-a7d4-8673a507b137" returned: 1 in 0.626s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:16:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-6d2f4095-b090-4575-a4b2-84df3a364bc5 tempest-TaggedBootDevicesTest-1369002241 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-8c2f424f-6634-4eab-a7d4-8673a507b137' failed. Not Retrying. {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 21:16:02 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-6d2f4095-b090-4575-a4b2-84df3a364bc5 tempest-TaggedBootDevicesTest-1369002241 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-8c2f424f-6634-4eab-a7d4-8673a507b137 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:16:02 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-6d2f4095-b090-4575-a4b2-84df3a364bc5 tempest-TaggedBootDevicesTest-1369002241 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-8c2f424f-6634-4eab-a7d4-8673a507b137" returned: 0 in 0.135s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:16:02 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-6d2f4095-b090-4575-a4b2-84df3a364bc5 tempest-TaggedBootDevicesTest-1369002241 None] Lock "cinder-quobyte-8c2f424f-6634-4eab-a7d4-8673a507b137" released by "delete_volume" :: held 1.872s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:16:02 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-6d2f4095-b090-4575-a4b2-84df3a364bc5 tempest-TaggedBootDevicesTest-1369002241 None] Created reservations ['ef4ee46b-7d8b-4b81-bd73-681323193ec0', 'e6775de3-d6ca-431c-8ba1-e980a10bfd76', '3eba309c-a8a9-4c6f-880f-4ac934e68e21', '21d46a3e-f2bd-4781-8763-9fb98075b331'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:16:03 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-6d2f4095-b090-4575-a4b2-84df3a364bc5 tempest-TaggedBootDevicesTest-1369002241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:16:03 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-6d2f4095-b090-4575-a4b2-84df3a364bc5 tempest-TaggedBootDevicesTest-1369002241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:16:03 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-6d2f4095-b090-4575-a4b2-84df3a364bc5 tempest-TaggedBootDevicesTest-1369002241 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:16:03 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-6d2f4095-b090-4575-a4b2-84df3a364bc5 tempest-TaggedBootDevicesTest-1369002241 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:16:03 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-6d2f4095-b090-4575-a4b2-84df3a364bc5 tempest-TaggedBootDevicesTest-1369002241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:16:03 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-6d2f4095-b090-4575-a4b2-84df3a364bc5 tempest-TaggedBootDevicesTest-1369002241 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:16:03 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-6d2f4095-b090-4575-a4b2-84df3a364bc5 tempest-TaggedBootDevicesTest-1369002241 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.130s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:16:03 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-6d2f4095-b090-4575-a4b2-84df3a364bc5 tempest-TaggedBootDevicesTest-1369002241 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:16:03 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-6d2f4095-b090-4575-a4b2-84df3a364bc5 tempest-TaggedBootDevicesTest-1369002241 None] Deleted volume successfully. Sep 10 21:16:03 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-6d2f4095-b090-4575-a4b2-84df3a364bc5 tempest-TaggedBootDevicesTest-1369002241 None] Lock "cinder-8c2f424f-6634-4eab-a7d4-8673a507b137-delete_volume" released by "delete_volume" :: held 3.543s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:16:10 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-c5d44470-4322-4195-bf29-d3716606d3fd tempest-AttachVolumeTestJSON-828295401 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:16:10 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5d44470-4322-4195-bf29-d3716606d3fd tempest-AttachVolumeTestJSON-828295401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:16:11 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c5d44470-4322-4195-bf29-d3716606d3fd tempest-AttachVolumeTestJSON-828295401 None] Flow 'volume_create_manager' (d1e68f29-3894-446e-b418-e672be98a8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:16:11 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c5d44470-4322-4195-bf29-d3716606d3fd tempest-AttachVolumeTestJSON-828295401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (561e09f4-a94e-4253-8bd6-6d0ce92f122f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:16:11 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c5d44470-4322-4195-bf29-d3716606d3fd tempest-AttachVolumeTestJSON-828295401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (561e09f4-a94e-4253-8bd6-6d0ce92f122f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:16:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-911891919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=073cd789-3c6c-4b05-840c-ba0fd5a97c64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca9244a504ae49c69b10542efaeba576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:16:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:16:10Z,use_quota=True,user_id='bc73940cbe674db99581f2d99ba44839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:16:11 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c5d44470-4322-4195-bf29-d3716606d3fd tempest-AttachVolumeTestJSON-828295401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dc4fb9c-1d3f-4bda-afc9-a20d9192a7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:16:11 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c5d44470-4322-4195-bf29-d3716606d3fd tempest-AttachVolumeTestJSON-828295401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dc4fb9c-1d3f-4bda-afc9-a20d9192a7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:16:11 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c5d44470-4322-4195-bf29-d3716606d3fd tempest-AttachVolumeTestJSON-828295401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e3dbfc6-63dd-40f8-bbda-015fd457c7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:16:11 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c5d44470-4322-4195-bf29-d3716606d3fd tempest-AttachVolumeTestJSON-828295401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e3dbfc6-63dd-40f8-bbda-015fd457c7ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '073cd789-3c6c-4b05-840c-ba0fd5a97c64', 'volume_name': 'volume-073cd789-3c6c-4b05-840c-ba0fd5a97c64', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:16:11 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c5d44470-4322-4195-bf29-d3716606d3fd tempest-AttachVolumeTestJSON-828295401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82827145-beb8-44bd-859c-37950164e539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:16:11 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c5d44470-4322-4195-bf29-d3716606d3fd tempest-AttachVolumeTestJSON-828295401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82827145-beb8-44bd-859c-37950164e539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:16:11 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c5d44470-4322-4195-bf29-d3716606d3fd tempest-AttachVolumeTestJSON-828295401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3827d20a-c7d3-46fe-b59f-13b207c27cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:16:11 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-c5d44470-4322-4195-bf29-d3716606d3fd tempest-AttachVolumeTestJSON-828295401 None] Volume 073cd789-3c6c-4b05-840c-ba0fd5a97c64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-073cd789-3c6c-4b05-840c-ba0fd5a97c64', 'volume_size': 1} Sep 10 21:16:11 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-c5d44470-4322-4195-bf29-d3716606d3fd tempest-AttachVolumeTestJSON-828295401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:16:11 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-c5d44470-4322-4195-bf29-d3716606d3fd tempest-AttachVolumeTestJSON-828295401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:16:11 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-c5d44470-4322-4195-bf29-d3716606d3fd tempest-AttachVolumeTestJSON-828295401 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:16:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-911891919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=073cd789-3c6c-4b05-840c-ba0fd5a97c64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca9244a504ae49c69b10542efaeba576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:16:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:16:10Z,use_quota=True,user_id='bc73940cbe674db99581f2d99ba44839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:16:11 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-c5d44470-4322-4195-bf29-d3716606d3fd tempest-AttachVolumeTestJSON-828295401 None] Creating volume 073cd789-3c6c-4b05-840c-ba0fd5a97c64 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:16:11 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-c5d44470-4322-4195-bf29-d3716606d3fd tempest-AttachVolumeTestJSON-828295401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:16:11 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-c5d44470-4322-4195-bf29-d3716606d3fd tempest-AttachVolumeTestJSON-828295401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:16:11 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-c5d44470-4322-4195-bf29-d3716606d3fd tempest-AttachVolumeTestJSON-828295401 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:16:11 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-c5d44470-4322-4195-bf29-d3716606d3fd tempest-AttachVolumeTestJSON-828295401 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:16:11 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-c5d44470-4322-4195-bf29-d3716606d3fd tempest-AttachVolumeTestJSON-828295401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:16:11 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-c5d44470-4322-4195-bf29-d3716606d3fd tempest-AttachVolumeTestJSON-828295401 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:16:11 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-c5d44470-4322-4195-bf29-d3716606d3fd tempest-AttachVolumeTestJSON-828295401 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:16:11 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c5d44470-4322-4195-bf29-d3716606d3fd tempest-AttachVolumeTestJSON-828295401 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-073cd789-3c6c-4b05-840c-ba0fd5a97c64 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:16:11 devstack quobyte-client[82807]: System call of process 90246 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:16:12 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=30, name=volume-073cd789-3c6c-4b05-840c-ba0fd5a97c64, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:16:12 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c5d44470-4322-4195-bf29-d3716606d3fd tempest-AttachVolumeTestJSON-828295401 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-073cd789-3c6c-4b05-840c-ba0fd5a97c64 1073741824" returned: 0 in 1.058s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:16:12 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c5d44470-4322-4195-bf29-d3716606d3fd tempest-AttachVolumeTestJSON-828295401 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-073cd789-3c6c-4b05-840c-ba0fd5a97c64 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:16:13 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c5d44470-4322-4195-bf29-d3716606d3fd tempest-AttachVolumeTestJSON-828295401 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-073cd789-3c6c-4b05-840c-ba0fd5a97c64" returned: 0 in 0.641s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:16:13 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-c5d44470-4322-4195-bf29-d3716606d3fd tempest-AttachVolumeTestJSON-828295401 None] <== create_volume: return (2036ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:16:13 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-c5d44470-4322-4195-bf29-d3716606d3fd tempest-AttachVolumeTestJSON-828295401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.092s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:16:14 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c5d44470-4322-4195-bf29-d3716606d3fd tempest-AttachVolumeTestJSON-828295401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3827d20a-c7d3-46fe-b59f-13b207c27cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-073cd789-3c6c-4b05-840c-ba0fd5a97c64', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:16:14 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c5d44470-4322-4195-bf29-d3716606d3fd tempest-AttachVolumeTestJSON-828295401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed24cd4b-711e-41c4-bbc9-346a0944c2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:16:14 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-c5d44470-4322-4195-bf29-d3716606d3fd tempest-AttachVolumeTestJSON-828295401 None] Volume volume-073cd789-3c6c-4b05-840c-ba0fd5a97c64 (073cd789-3c6c-4b05-840c-ba0fd5a97c64): created successfully Sep 10 21:16:14 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c5d44470-4322-4195-bf29-d3716606d3fd tempest-AttachVolumeTestJSON-828295401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed24cd4b-711e-41c4-bbc9-346a0944c2a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:16:14 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c5d44470-4322-4195-bf29-d3716606d3fd tempest-AttachVolumeTestJSON-828295401 None] Flow 'volume_create_manager' (d1e68f29-3894-446e-b418-e672be98a8e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:16:14 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-c5d44470-4322-4195-bf29-d3716606d3fd tempest-AttachVolumeTestJSON-828295401 None] Created volume successfully. Sep 10 21:16:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-348bbc7a-b28a-490a-a312-4c5de563fcdf req-6a64be62-1bf1-4bdf-bbbf-e964424ac92e tempest-AttachVolumeTestJSON-828295401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:16:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-348bbc7a-b28a-490a-a312-4c5de563fcdf req-6a64be62-1bf1-4bdf-bbbf-e964424ac92e tempest-AttachVolumeTestJSON-828295401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:16:22 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0a09dd-f1ec-4bd0-908c-01690e5de573]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:16:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-348bbc7a-b28a-490a-a312-4c5de563fcdf req-6a64be62-1bf1-4bdf-bbbf-e964424ac92e tempest-AttachVolumeTestJSON-828295401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-073cd789-3c6c-4b05-840c-ba0fd5a97c64 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:16:23 devstack quobyte-client[82807]: System call of process 90339 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:16:23 devstack quobyte-client[82807]: System call of process 90339 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:16:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-348bbc7a-b28a-490a-a312-4c5de563fcdf req-6a64be62-1bf1-4bdf-bbbf-e964424ac92e tempest-AttachVolumeTestJSON-828295401 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-073cd789-3c6c-4b05-840c-ba0fd5a97c64" returned: 0 in 0.766s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:16:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-348bbc7a-b28a-490a-a312-4c5de563fcdf req-6a64be62-1bf1-4bdf-bbbf-e964424ac92e tempest-AttachVolumeTestJSON-828295401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.871s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:16:23 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-348bbc7a-b28a-490a-a312-4c5de563fcdf req-6a64be62-1bf1-4bdf-bbbf-e964424ac92e tempest-AttachVolumeTestJSON-828295401 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b', 'name': 'volume-073cd789-3c6c-4b05-840c-ba0fd5a97c64', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd8d3976c-55c4-42d1-87d7-7a7f6c4f0ed5', 'enforce_multipath': True} {{(pid=82780) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 21:16:23 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-348bbc7a-b28a-490a-a312-4c5de563fcdf req-6a64be62-1bf1-4bdf-bbbf-e964424ac92e tempest-AttachVolumeTestJSON-828295401 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:16:23 devstack cinder-volume[82780]: INFO cinder.volume.manager [req-348bbc7a-b28a-490a-a312-4c5de563fcdf req-6a64be62-1bf1-4bdf-bbbf-e964424ac92e tempest-AttachVolumeTestJSON-828295401 None] attachment_update completed successfully. Sep 10 21:16:33 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:UPDATE=39,cinder:SELECT=23,cinder:DELETE=2,cinder:INSERT=3 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:16:33 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=29,cinder:UPDATE=21,cinder:INSERT=9,cinder:DELETE=3 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:16:41 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-0eba5751-fca9-4cf4-bb02-246bd215cb31 tempest-VolumesNegativeTest-1741836851 None] Acquiring lock "cinder-71c1837d-63e9-4235-9390-67b73c85eb49-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:16:41 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-0eba5751-fca9-4cf4-bb02-246bd215cb31 tempest-VolumesNegativeTest-1741836851 None] Lock "cinder-71c1837d-63e9-4235-9390-67b73c85eb49-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:16:41 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-0eba5751-fca9-4cf4-bb02-246bd215cb31 tempest-VolumesNegativeTest-1741836851 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:16:41 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-0eba5751-fca9-4cf4-bb02-246bd215cb31 tempest-VolumesNegativeTest-1741836851 None] Acquiring lock "cinder-quobyte-71c1837d-63e9-4235-9390-67b73c85eb49" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:16:41 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-0eba5751-fca9-4cf4-bb02-246bd215cb31 tempest-VolumesNegativeTest-1741836851 None] Lock "cinder-quobyte-71c1837d-63e9-4235-9390-67b73c85eb49" acquired by "delete_volume" :: waited 0.019s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:16:41 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7279b2-aca6-4ad9-a7bd-6e8cd61e632e]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:16:41 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0eba5751-fca9-4cf4-bb02-246bd215cb31 tempest-VolumesNegativeTest-1741836851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-71c1837d-63e9-4235-9390-67b73c85eb49 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:16:42 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0eba5751-fca9-4cf4-bb02-246bd215cb31 tempest-VolumesNegativeTest-1741836851 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-71c1837d-63e9-4235-9390-67b73c85eb49" returned: 0 in 0.852s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:16:42 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0eba5751-fca9-4cf4-bb02-246bd215cb31 tempest-VolumesNegativeTest-1741836851 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-71c1837d-63e9-4235-9390-67b73c85eb49 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:16:42 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0eba5751-fca9-4cf4-bb02-246bd215cb31 tempest-VolumesNegativeTest-1741836851 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-71c1837d-63e9-4235-9390-67b73c85eb49" returned: 0 in 0.280s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:16:43 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-0eba5751-fca9-4cf4-bb02-246bd215cb31 tempest-VolumesNegativeTest-1741836851 None] Lock "cinder-quobyte-71c1837d-63e9-4235-9390-67b73c85eb49" released by "delete_volume" :: held 1.424s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:16:43 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-0eba5751-fca9-4cf4-bb02-246bd215cb31 tempest-VolumesNegativeTest-1741836851 None] Created reservations ['c66b3d06-6c73-48df-9899-88599f9e7162', 'aa02cfda-f965-4f79-aac0-0bc69dfd75df', '2e71e68d-d175-4849-b12b-2347d5b09ef7', '8d55a701-774d-4d5a-bedf-54f84552a86c'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:16:43 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-0eba5751-fca9-4cf4-bb02-246bd215cb31 tempest-VolumesNegativeTest-1741836851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:16:43 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-0eba5751-fca9-4cf4-bb02-246bd215cb31 tempest-VolumesNegativeTest-1741836851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:16:43 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-0eba5751-fca9-4cf4-bb02-246bd215cb31 tempest-VolumesNegativeTest-1741836851 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:16:43 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-0eba5751-fca9-4cf4-bb02-246bd215cb31 tempest-VolumesNegativeTest-1741836851 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:16:43 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-0eba5751-fca9-4cf4-bb02-246bd215cb31 tempest-VolumesNegativeTest-1741836851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:16:43 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0eba5751-fca9-4cf4-bb02-246bd215cb31 tempest-VolumesNegativeTest-1741836851 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:16:43 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0eba5751-fca9-4cf4-bb02-246bd215cb31 tempest-VolumesNegativeTest-1741836851 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.221s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:16:44 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-0eba5751-fca9-4cf4-bb02-246bd215cb31 tempest-VolumesNegativeTest-1741836851 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:16:44 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-0eba5751-fca9-4cf4-bb02-246bd215cb31 tempest-VolumesNegativeTest-1741836851 None] Deleted volume successfully. Sep 10 21:16:44 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-0eba5751-fca9-4cf4-bb02-246bd215cb31 tempest-VolumesNegativeTest-1741836851 None] Lock "cinder-71c1837d-63e9-4235-9390-67b73c85eb49-delete_volume" released by "delete_volume" :: held 3.071s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:16:50 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-d5e1d444-2894-4d54-9246-fed9e0611899 tempest-VolumesSnapshotListTestJSON-931035230 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:16:50 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5e1d444-2894-4d54-9246-fed9e0611899 tempest-VolumesSnapshotListTestJSON-931035230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:16:50 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-d5e1d444-2894-4d54-9246-fed9e0611899 tempest-VolumesSnapshotListTestJSON-931035230 None] Flow 'volume_create_manager' (bddfd1f8-8359-4f3d-982a-eed178c88fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:16:50 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-d5e1d444-2894-4d54-9246-fed9e0611899 tempest-VolumesSnapshotListTestJSON-931035230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a7e1697-ca38-4ed0-8c05-3e81a18bf24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:16:50 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-d5e1d444-2894-4d54-9246-fed9e0611899 tempest-VolumesSnapshotListTestJSON-931035230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a7e1697-ca38-4ed0-8c05-3e81a18bf24f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:16:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-316747325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a8f0242-4e23-4b10-a857-649d8e588fba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca6b44cb5fc8401fbb60e5c8876c1b71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:16:50Z,use_quota=True,user_id='88cb2c6d588a462297019c6d74ad0491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:16:50 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-d5e1d444-2894-4d54-9246-fed9e0611899 tempest-VolumesSnapshotListTestJSON-931035230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee6b6026-87f9-4df9-9387-930a28e1af03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:16:50 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-d5e1d444-2894-4d54-9246-fed9e0611899 tempest-VolumesSnapshotListTestJSON-931035230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee6b6026-87f9-4df9-9387-930a28e1af03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:16:50 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-d5e1d444-2894-4d54-9246-fed9e0611899 tempest-VolumesSnapshotListTestJSON-931035230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76907ec0-cbd5-4467-bd25-1db523b52fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:16:50 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-d5e1d444-2894-4d54-9246-fed9e0611899 tempest-VolumesSnapshotListTestJSON-931035230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76907ec0-cbd5-4467-bd25-1db523b52fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a8f0242-4e23-4b10-a857-649d8e588fba', 'volume_name': 'volume-3a8f0242-4e23-4b10-a857-649d8e588fba', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:16:50 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-d5e1d444-2894-4d54-9246-fed9e0611899 tempest-VolumesSnapshotListTestJSON-931035230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e22867b0-eec7-4281-8a68-ea34a18e4590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:16:50 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-d5e1d444-2894-4d54-9246-fed9e0611899 tempest-VolumesSnapshotListTestJSON-931035230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e22867b0-eec7-4281-8a68-ea34a18e4590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:16:50 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-d5e1d444-2894-4d54-9246-fed9e0611899 tempest-VolumesSnapshotListTestJSON-931035230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (653859a9-0434-4713-b095-2c125a8e9dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:16:50 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-d5e1d444-2894-4d54-9246-fed9e0611899 tempest-VolumesSnapshotListTestJSON-931035230 None] Volume 3a8f0242-4e23-4b10-a857-649d8e588fba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a8f0242-4e23-4b10-a857-649d8e588fba', 'volume_size': 1} Sep 10 21:16:50 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-d5e1d444-2894-4d54-9246-fed9e0611899 tempest-VolumesSnapshotListTestJSON-931035230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:16:50 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-d5e1d444-2894-4d54-9246-fed9e0611899 tempest-VolumesSnapshotListTestJSON-931035230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:16:50 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-d5e1d444-2894-4d54-9246-fed9e0611899 tempest-VolumesSnapshotListTestJSON-931035230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:16:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-316747325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a8f0242-4e23-4b10-a857-649d8e588fba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca6b44cb5fc8401fbb60e5c8876c1b71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:16:50Z,use_quota=True,user_id='88cb2c6d588a462297019c6d74ad0491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:16:50 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-d5e1d444-2894-4d54-9246-fed9e0611899 tempest-VolumesSnapshotListTestJSON-931035230 None] Creating volume 3a8f0242-4e23-4b10-a857-649d8e588fba {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:16:50 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-d5e1d444-2894-4d54-9246-fed9e0611899 tempest-VolumesSnapshotListTestJSON-931035230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:16:50 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-d5e1d444-2894-4d54-9246-fed9e0611899 tempest-VolumesSnapshotListTestJSON-931035230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:16:50 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-d5e1d444-2894-4d54-9246-fed9e0611899 tempest-VolumesSnapshotListTestJSON-931035230 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:16:50 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-d5e1d444-2894-4d54-9246-fed9e0611899 tempest-VolumesSnapshotListTestJSON-931035230 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:16:50 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-d5e1d444-2894-4d54-9246-fed9e0611899 tempest-VolumesSnapshotListTestJSON-931035230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:16:50 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-d5e1d444-2894-4d54-9246-fed9e0611899 tempest-VolumesSnapshotListTestJSON-931035230 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:16:50 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-d5e1d444-2894-4d54-9246-fed9e0611899 tempest-VolumesSnapshotListTestJSON-931035230 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:16:50 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-d5e1d444-2894-4d54-9246-fed9e0611899 tempest-VolumesSnapshotListTestJSON-931035230 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:16:50 devstack quobyte-client[82807]: System call of process 90844 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:16:50 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=31, name=volume-3a8f0242-4e23-4b10-a857-649d8e588fba, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:16:51 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-d5e1d444-2894-4d54-9246-fed9e0611899 tempest-VolumesSnapshotListTestJSON-931035230 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba 1073741824" returned: 0 in 0.668s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:16:51 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-d5e1d444-2894-4d54-9246-fed9e0611899 tempest-VolumesSnapshotListTestJSON-931035230 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:16:51 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-d5e1d444-2894-4d54-9246-fed9e0611899 tempest-VolumesSnapshotListTestJSON-931035230 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba" returned: 0 in 0.156s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:16:51 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-d5e1d444-2894-4d54-9246-fed9e0611899 tempest-VolumesSnapshotListTestJSON-931035230 None] <== create_volume: return (969ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:16:51 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-d5e1d444-2894-4d54-9246-fed9e0611899 tempest-VolumesSnapshotListTestJSON-931035230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:16:51 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-d5e1d444-2894-4d54-9246-fed9e0611899 tempest-VolumesSnapshotListTestJSON-931035230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (653859a9-0434-4713-b095-2c125a8e9dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a8f0242-4e23-4b10-a857-649d8e588fba', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:16:51 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-d5e1d444-2894-4d54-9246-fed9e0611899 tempest-VolumesSnapshotListTestJSON-931035230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f5c7dcc-bc21-40ab-b225-da42c5bf20ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:16:51 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-d5e1d444-2894-4d54-9246-fed9e0611899 tempest-VolumesSnapshotListTestJSON-931035230 None] Volume volume-3a8f0242-4e23-4b10-a857-649d8e588fba (3a8f0242-4e23-4b10-a857-649d8e588fba): created successfully Sep 10 21:16:51 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-d5e1d444-2894-4d54-9246-fed9e0611899 tempest-VolumesSnapshotListTestJSON-931035230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f5c7dcc-bc21-40ab-b225-da42c5bf20ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:16:51 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-d5e1d444-2894-4d54-9246-fed9e0611899 tempest-VolumesSnapshotListTestJSON-931035230 None] Flow 'volume_create_manager' (bddfd1f8-8359-4f3d-982a-eed178c88fe5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:16:51 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-d5e1d444-2894-4d54-9246-fed9e0611899 tempest-VolumesSnapshotListTestJSON-931035230 None] Created volume successfully. Sep 10 21:16:52 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-a053553c-baf2-40af-b443-5ae56956d981 tempest-VolumesSnapshotListTestJSON-931035230 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:16:52 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a053553c-baf2-40af-b443-5ae56956d981 tempest-VolumesSnapshotListTestJSON-931035230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:16:52 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a053553c-baf2-40af-b443-5ae56956d981 tempest-VolumesSnapshotListTestJSON-931035230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:16:53 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-a053553c-baf2-40af-b443-5ae56956d981 tempest-VolumesSnapshotListTestJSON-931035230 None] Creating offline snapshot e7dafee5-dd01-4eb3-9125-71424b9c3991 of volume 3a8f0242-4e23-4b10-a857-649d8e588fba {{(pid=82780) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 21:16:53 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a54865-a932-4d31-94cc-8c47a29b9abe]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:16:53 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a053553c-baf2-40af-b443-5ae56956d981 tempest-VolumesSnapshotListTestJSON-931035230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:16:54 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a053553c-baf2-40af-b443-5ae56956d981 tempest-VolumesSnapshotListTestJSON-931035230 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba" returned: 0 in 0.885s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:16:54 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a053553c-baf2-40af-b443-5ae56956d981 tempest-VolumesSnapshotListTestJSON-931035230 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba.e7dafee5-dd01-4eb3-9125-71424b9c3991 1G {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:16:54 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=32, name=volume-3a8f0242-4e23-4b10-a857-649d8e588fba.e7dafee5-dd01-4eb3-9125-71424b9c3991, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:16:54 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a053553c-baf2-40af-b443-5ae56956d981 tempest-VolumesSnapshotListTestJSON-931035230 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba.e7dafee5-dd01-4eb3-9125-71424b9c3991 1G" returned: 0 in 0.327s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:16:54 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a053553c-baf2-40af-b443-5ae56956d981 tempest-VolumesSnapshotListTestJSON-931035230 None] Running cmd (subprocess): qemu-img rebase -u -b volume-3a8f0242-4e23-4b10-a857-649d8e588fba -F qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba.e7dafee5-dd01-4eb3-9125-71424b9c3991 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:16:54 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a053553c-baf2-40af-b443-5ae56956d981 tempest-VolumesSnapshotListTestJSON-931035230 None] CMD "qemu-img rebase -u -b volume-3a8f0242-4e23-4b10-a857-649d8e588fba -F qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba.e7dafee5-dd01-4eb3-9125-71424b9c3991" returned: 0 in 0.463s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:16:54 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-a053553c-baf2-40af-b443-5ae56956d981 tempest-VolumesSnapshotListTestJSON-931035230 None] File path /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba.e7dafee5-dd01-4eb3-9125-71424b9c3991 is being set with permissions: 660 {{(pid=82780) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 21:16:54 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a053553c-baf2-40af-b443-5ae56956d981 tempest-VolumesSnapshotListTestJSON-931035230 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba.e7dafee5-dd01-4eb3-9125-71424b9c3991 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:16:55 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a053553c-baf2-40af-b443-5ae56956d981 tempest-VolumesSnapshotListTestJSON-931035230 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba.e7dafee5-dd01-4eb3-9125-71424b9c3991" returned: 0 in 0.211s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:16:55 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-a053553c-baf2-40af-b443-5ae56956d981 tempest-VolumesSnapshotListTestJSON-931035230 None] Setting permissions: /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba -> 1000:1000 {{(pid=82780) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 21:16:55 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a053553c-baf2-40af-b443-5ae56956d981 tempest-VolumesSnapshotListTestJSON-931035230 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba.e7dafee5-dd01-4eb3-9125-71424b9c3991 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:16:55 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a053553c-baf2-40af-b443-5ae56956d981 tempest-VolumesSnapshotListTestJSON-931035230 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba.e7dafee5-dd01-4eb3-9125-71424b9c3991" returned: 0 in 0.255s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:16:55 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a053553c-baf2-40af-b443-5ae56956d981 tempest-VolumesSnapshotListTestJSON-931035230 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba.info {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:16:55 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a053553c-baf2-40af-b443-5ae56956d981 tempest-VolumesSnapshotListTestJSON-931035230 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba.info" returned: 0 in 0.258s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:16:55 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-a053553c-baf2-40af-b443-5ae56956d981 tempest-VolumesSnapshotListTestJSON-931035230 None] File path /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba.info is being set with permissions: 660 {{(pid=82780) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 21:16:55 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a053553c-baf2-40af-b443-5ae56956d981 tempest-VolumesSnapshotListTestJSON-931035230 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba.info {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:16:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a053553c-baf2-40af-b443-5ae56956d981 tempest-VolumesSnapshotListTestJSON-931035230 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba.info" returned: 0 in 0.194s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:16:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a053553c-baf2-40af-b443-5ae56956d981 tempest-VolumesSnapshotListTestJSON-931035230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.381s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:16:56 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-a053553c-baf2-40af-b443-5ae56956d981 tempest-VolumesSnapshotListTestJSON-931035230 None] Create snapshot completed successfully Sep 10 21:16:56 devstack cinder-volume[82780]: DEBUG oslo_service.periodic_task [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82780) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 21:16:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:16:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:16:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:16:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:16:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:16:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:16:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.310s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:16:57 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:16:58 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-f165a50e-d11a-413e-8821-e5bd9ebd2b72 tempest-VolumesSnapshotListTestJSON-931035230 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:16:58 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-f165a50e-d11a-413e-8821-e5bd9ebd2b72 tempest-VolumesSnapshotListTestJSON-931035230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:16:58 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-f165a50e-d11a-413e-8821-e5bd9ebd2b72 tempest-VolumesSnapshotListTestJSON-931035230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.009s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:16:58 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-f165a50e-d11a-413e-8821-e5bd9ebd2b72 tempest-VolumesSnapshotListTestJSON-931035230 None] Creating offline snapshot 7b1f4114-7ff9-4551-a172-97e542ce53e3 of volume 3a8f0242-4e23-4b10-a857-649d8e588fba {{(pid=82780) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 21:16:58 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f3bb74-beac-4e43-9f10-8d5aba0b2867]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:16:58 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f165a50e-d11a-413e-8821-e5bd9ebd2b72 tempest-VolumesSnapshotListTestJSON-931035230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba.e7dafee5-dd01-4eb3-9125-71424b9c3991 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:16:58 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f165a50e-d11a-413e-8821-e5bd9ebd2b72 tempest-VolumesSnapshotListTestJSON-931035230 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba.e7dafee5-dd01-4eb3-9125-71424b9c3991" returned: 0 in 0.531s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:16:58 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-f165a50e-d11a-413e-8821-e5bd9ebd2b72 tempest-VolumesSnapshotListTestJSON-931035230 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a8f0242-4e23-4b10-a857-649d8e588fba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82780) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 21:16:58 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f165a50e-d11a-413e-8821-e5bd9ebd2b72 tempest-VolumesSnapshotListTestJSON-931035230 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba.e7dafee5-dd01-4eb3-9125-71424b9c3991,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba.7b1f4114-7ff9-4551-a172-97e542ce53e3 1G {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:16:59 devstack quobyte-client[82807]: System call of process 91251 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:16:59 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=34, name=volume-3a8f0242-4e23-4b10-a857-649d8e588fba.7b1f4114-7ff9-4551-a172-97e542ce53e3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:16:59 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f165a50e-d11a-413e-8821-e5bd9ebd2b72 tempest-VolumesSnapshotListTestJSON-931035230 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba.e7dafee5-dd01-4eb3-9125-71424b9c3991,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba.7b1f4114-7ff9-4551-a172-97e542ce53e3 1G" returned: 0 in 0.703s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:16:59 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f165a50e-d11a-413e-8821-e5bd9ebd2b72 tempest-VolumesSnapshotListTestJSON-931035230 None] Running cmd (subprocess): qemu-img rebase -u -b volume-3a8f0242-4e23-4b10-a857-649d8e588fba.e7dafee5-dd01-4eb3-9125-71424b9c3991 -F qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba.7b1f4114-7ff9-4551-a172-97e542ce53e3 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:16:59 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f165a50e-d11a-413e-8821-e5bd9ebd2b72 tempest-VolumesSnapshotListTestJSON-931035230 None] CMD "qemu-img rebase -u -b volume-3a8f0242-4e23-4b10-a857-649d8e588fba.e7dafee5-dd01-4eb3-9125-71424b9c3991 -F qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba.7b1f4114-7ff9-4551-a172-97e542ce53e3" returned: 0 in 0.220s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:16:59 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-f165a50e-d11a-413e-8821-e5bd9ebd2b72 tempest-VolumesSnapshotListTestJSON-931035230 None] File path /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba.7b1f4114-7ff9-4551-a172-97e542ce53e3 is being set with permissions: 660 {{(pid=82780) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 21:16:59 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f165a50e-d11a-413e-8821-e5bd9ebd2b72 tempest-VolumesSnapshotListTestJSON-931035230 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba.7b1f4114-7ff9-4551-a172-97e542ce53e3 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:16:59 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f165a50e-d11a-413e-8821-e5bd9ebd2b72 tempest-VolumesSnapshotListTestJSON-931035230 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba.7b1f4114-7ff9-4551-a172-97e542ce53e3" returned: 0 in 0.129s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:16:59 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-f165a50e-d11a-413e-8821-e5bd9ebd2b72 tempest-VolumesSnapshotListTestJSON-931035230 None] Setting permissions: /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba.e7dafee5-dd01-4eb3-9125-71424b9c3991 -> 1000:1000 {{(pid=82780) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 21:16:59 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f165a50e-d11a-413e-8821-e5bd9ebd2b72 tempest-VolumesSnapshotListTestJSON-931035230 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba.e7dafee5-dd01-4eb3-9125-71424b9c3991 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba.7b1f4114-7ff9-4551-a172-97e542ce53e3 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:17:00 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f165a50e-d11a-413e-8821-e5bd9ebd2b72 tempest-VolumesSnapshotListTestJSON-931035230 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba.e7dafee5-dd01-4eb3-9125-71424b9c3991 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba.7b1f4114-7ff9-4551-a172-97e542ce53e3" returned: 0 in 0.261s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:17:00 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-f165a50e-d11a-413e-8821-e5bd9ebd2b72 tempest-VolumesSnapshotListTestJSON-931035230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.352s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:17:00 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-f165a50e-d11a-413e-8821-e5bd9ebd2b72 tempest-VolumesSnapshotListTestJSON-931035230 None] Create snapshot completed successfully Sep 10 21:17:01 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-647a3ba1-3af5-497e-abff-64858ff3989b tempest-VolumesSnapshotListTestJSON-931035230 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:17:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-647a3ba1-3af5-497e-abff-64858ff3989b tempest-VolumesSnapshotListTestJSON-931035230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:17:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-647a3ba1-3af5-497e-abff-64858ff3989b tempest-VolumesSnapshotListTestJSON-931035230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:17:01 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-647a3ba1-3af5-497e-abff-64858ff3989b tempest-VolumesSnapshotListTestJSON-931035230 None] Creating offline snapshot fa647df6-343c-4b5b-a747-9c364bd9e10f of volume 3a8f0242-4e23-4b10-a857-649d8e588fba {{(pid=82780) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 21:17:01 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc93b892-987b-452f-ba5b-0233e95d5ca8]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:17:02 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-647a3ba1-3af5-497e-abff-64858ff3989b tempest-VolumesSnapshotListTestJSON-931035230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba.7b1f4114-7ff9-4551-a172-97e542ce53e3 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:17:03 devstack quobyte-client[82807]: System call of process 91294 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:17:03 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-647a3ba1-3af5-497e-abff-64858ff3989b tempest-VolumesSnapshotListTestJSON-931035230 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba.7b1f4114-7ff9-4551-a172-97e542ce53e3" returned: 0 in 1.456s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:17:03 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-647a3ba1-3af5-497e-abff-64858ff3989b tempest-VolumesSnapshotListTestJSON-931035230 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a8f0242-4e23-4b10-a857-649d8e588fba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82780) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 21:17:03 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-647a3ba1-3af5-497e-abff-64858ff3989b tempest-VolumesSnapshotListTestJSON-931035230 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba.7b1f4114-7ff9-4551-a172-97e542ce53e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba.fa647df6-343c-4b5b-a747-9c364bd9e10f 1G {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:17:03 devstack quobyte-client[82807]: System call of process 91319 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:17:04 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=35, name=volume-3a8f0242-4e23-4b10-a857-649d8e588fba.fa647df6-343c-4b5b-a747-9c364bd9e10f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:17:04 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-647a3ba1-3af5-497e-abff-64858ff3989b tempest-VolumesSnapshotListTestJSON-931035230 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba.7b1f4114-7ff9-4551-a172-97e542ce53e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba.fa647df6-343c-4b5b-a747-9c364bd9e10f 1G" returned: 0 in 0.696s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:17:04 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-647a3ba1-3af5-497e-abff-64858ff3989b tempest-VolumesSnapshotListTestJSON-931035230 None] Running cmd (subprocess): qemu-img rebase -u -b volume-3a8f0242-4e23-4b10-a857-649d8e588fba.7b1f4114-7ff9-4551-a172-97e542ce53e3 -F qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba.fa647df6-343c-4b5b-a747-9c364bd9e10f {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:17:04 devstack quobyte-client[82807]: System call of process 91324 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:17:04 devstack quobyte-client[82807]: System call of process 91324 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:17:04 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-647a3ba1-3af5-497e-abff-64858ff3989b tempest-VolumesSnapshotListTestJSON-931035230 None] CMD "qemu-img rebase -u -b volume-3a8f0242-4e23-4b10-a857-649d8e588fba.7b1f4114-7ff9-4551-a172-97e542ce53e3 -F qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba.fa647df6-343c-4b5b-a747-9c364bd9e10f" returned: 0 in 0.287s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:17:04 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-647a3ba1-3af5-497e-abff-64858ff3989b tempest-VolumesSnapshotListTestJSON-931035230 None] File path /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba.fa647df6-343c-4b5b-a747-9c364bd9e10f is being set with permissions: 660 {{(pid=82780) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 21:17:04 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-647a3ba1-3af5-497e-abff-64858ff3989b tempest-VolumesSnapshotListTestJSON-931035230 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba.fa647df6-343c-4b5b-a747-9c364bd9e10f {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:17:04 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-647a3ba1-3af5-497e-abff-64858ff3989b tempest-VolumesSnapshotListTestJSON-931035230 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba.fa647df6-343c-4b5b-a747-9c364bd9e10f" returned: 0 in 0.225s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:17:04 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-647a3ba1-3af5-497e-abff-64858ff3989b tempest-VolumesSnapshotListTestJSON-931035230 None] Setting permissions: /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba.7b1f4114-7ff9-4551-a172-97e542ce53e3 -> 1000:1000 {{(pid=82780) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 21:17:04 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-647a3ba1-3af5-497e-abff-64858ff3989b tempest-VolumesSnapshotListTestJSON-931035230 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba.7b1f4114-7ff9-4551-a172-97e542ce53e3 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba.fa647df6-343c-4b5b-a747-9c364bd9e10f {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:17:05 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-647a3ba1-3af5-497e-abff-64858ff3989b tempest-VolumesSnapshotListTestJSON-931035230 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba.7b1f4114-7ff9-4551-a172-97e542ce53e3 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba.fa647df6-343c-4b5b-a747-9c364bd9e10f" returned: 0 in 0.221s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:17:05 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-647a3ba1-3af5-497e-abff-64858ff3989b tempest-VolumesSnapshotListTestJSON-931035230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.605s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:17:05 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-647a3ba1-3af5-497e-abff-64858ff3989b tempest-VolumesSnapshotListTestJSON-931035230 None] Create snapshot completed successfully Sep 10 21:17:10 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-d59a9b6f-a940-40cd-aa1e-03c7e27b3536 tempest-VolumesSnapshotListTestJSON-931035230 None] Acquiring lock "cinder-fa647df6-343c-4b5b-a747-9c364bd9e10f-delete_snapshot" by "delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:17:10 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-d59a9b6f-a940-40cd-aa1e-03c7e27b3536 tempest-VolumesSnapshotListTestJSON-931035230 None] Lock "cinder-fa647df6-343c-4b5b-a747-9c364bd9e10f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.067s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:17:10 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-d59a9b6f-a940-40cd-aa1e-03c7e27b3536 tempest-VolumesSnapshotListTestJSON-931035230 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:17:10 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-d59a9b6f-a940-40cd-aa1e-03c7e27b3536 tempest-VolumesSnapshotListTestJSON-931035230 None] Acquiring lock "cinder-quobyte-3a8f0242-4e23-4b10-a857-649d8e588fba" by "delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:17:10 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-d59a9b6f-a940-40cd-aa1e-03c7e27b3536 tempest-VolumesSnapshotListTestJSON-931035230 None] Lock "cinder-quobyte-3a8f0242-4e23-4b10-a857-649d8e588fba" acquired by "delete_snapshot" :: waited 0.028s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:17:10 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-d59a9b6f-a940-40cd-aa1e-03c7e27b3536 tempest-VolumesSnapshotListTestJSON-931035230 None] Acquiring lock "cinder-quobyte-fa647df6-343c-4b5b-a747-9c364bd9e10f" by "_delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:17:10 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-d59a9b6f-a940-40cd-aa1e-03c7e27b3536 tempest-VolumesSnapshotListTestJSON-931035230 None] Lock "cinder-quobyte-fa647df6-343c-4b5b-a747-9c364bd9e10f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:17:10 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-d59a9b6f-a940-40cd-aa1e-03c7e27b3536 tempest-VolumesSnapshotListTestJSON-931035230 None] Deleting offline snapshot fa647df6-343c-4b5b-a747-9c364bd9e10f of volume 3a8f0242-4e23-4b10-a857-649d8e588fba {{(pid=82780) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 21:17:10 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-d59a9b6f-a940-40cd-aa1e-03c7e27b3536 tempest-VolumesSnapshotListTestJSON-931035230 None] snapshot_file for this snap is: volume-3a8f0242-4e23-4b10-a857-649d8e588fba.fa647df6-343c-4b5b-a747-9c364bd9e10f {{(pid=82780) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 21:17:10 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[aceb8a97-3585-4854-ac43-561c63da0ac2]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:17:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-d59a9b6f-a940-40cd-aa1e-03c7e27b3536 tempest-VolumesSnapshotListTestJSON-931035230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba.fa647df6-343c-4b5b-a747-9c364bd9e10f {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:17:12 devstack quobyte-client[82807]: System call of process 91374 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:17:12 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-d59a9b6f-a940-40cd-aa1e-03c7e27b3536 tempest-VolumesSnapshotListTestJSON-931035230 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba.fa647df6-343c-4b5b-a747-9c364bd9e10f" returned: 0 in 1.434s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:17:12 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-d59a9b6f-a940-40cd-aa1e-03c7e27b3536 tempest-VolumesSnapshotListTestJSON-931035230 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a8f0242-4e23-4b10-a857-649d8e588fba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82780) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 21:17:12 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f6865a-b180-459d-982b-091d4794ba95]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:17:12 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-d59a9b6f-a940-40cd-aa1e-03c7e27b3536 tempest-VolumesSnapshotListTestJSON-931035230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba.7b1f4114-7ff9-4551-a172-97e542ce53e3 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:17:13 devstack quobyte-client[82807]: System call of process 91384 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:17:13 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-d59a9b6f-a940-40cd-aa1e-03c7e27b3536 tempest-VolumesSnapshotListTestJSON-931035230 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba.7b1f4114-7ff9-4551-a172-97e542ce53e3" returned: 0 in 0.933s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:17:13 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-d59a9b6f-a940-40cd-aa1e-03c7e27b3536 tempest-VolumesSnapshotListTestJSON-931035230 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a8f0242-4e23-4b10-a857-649d8e588fba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82780) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 21:17:13 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-d59a9b6f-a940-40cd-aa1e-03c7e27b3536 tempest-VolumesSnapshotListTestJSON-931035230 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba.fa647df6-343c-4b5b-a747-9c364bd9e10f {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:17:13 devstack quobyte-client[82807]: System call of process 91393 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:17:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-d59a9b6f-a940-40cd-aa1e-03c7e27b3536 tempest-VolumesSnapshotListTestJSON-931035230 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba.fa647df6-343c-4b5b-a747-9c364bd9e10f" returned: 0 in 0.795s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:17:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-d59a9b6f-a940-40cd-aa1e-03c7e27b3536 tempest-VolumesSnapshotListTestJSON-931035230 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba.fa647df6-343c-4b5b-a747-9c364bd9e10f {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:17:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-d59a9b6f-a940-40cd-aa1e-03c7e27b3536 tempest-VolumesSnapshotListTestJSON-931035230 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba.fa647df6-343c-4b5b-a747-9c364bd9e10f" returned: 0 in 0.136s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:17:14 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-d59a9b6f-a940-40cd-aa1e-03c7e27b3536 tempest-VolumesSnapshotListTestJSON-931035230 None] Lock "cinder-quobyte-fa647df6-343c-4b5b-a747-9c364bd9e10f" released by "_delete_snapshot" :: held 4.025s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:17:14 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-d59a9b6f-a940-40cd-aa1e-03c7e27b3536 tempest-VolumesSnapshotListTestJSON-931035230 None] Lock "cinder-quobyte-3a8f0242-4e23-4b10-a857-649d8e588fba" released by "delete_snapshot" :: held 4.072s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:17:15 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-d59a9b6f-a940-40cd-aa1e-03c7e27b3536 tempest-VolumesSnapshotListTestJSON-931035230 None] Created reservations ['3a4c0906-1a99-4890-a59e-2e88dd436ebc', '7c04be9f-1db7-4435-bdb6-b57d6e3b5db3', 'f11e82e8-1fa7-4088-adce-481b67be792e', '00e9f6c4-c74a-4b64-8636-a6eb11c461b3'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:17:15 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-d59a9b6f-a940-40cd-aa1e-03c7e27b3536 tempest-VolumesSnapshotListTestJSON-931035230 None] Delete snapshot completed successfully. Sep 10 21:17:15 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-d59a9b6f-a940-40cd-aa1e-03c7e27b3536 tempest-VolumesSnapshotListTestJSON-931035230 None] Lock "cinder-fa647df6-343c-4b5b-a747-9c364bd9e10f-delete_snapshot" released by "delete_snapshot" :: held 4.798s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:17:16 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-5fde8023-bd53-4a7a-be9b-2649ee808ae2 tempest-VolumesSnapshotListTestJSON-931035230 None] Acquiring lock "cinder-7b1f4114-7ff9-4551-a172-97e542ce53e3-delete_snapshot" by "delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:17:16 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-5fde8023-bd53-4a7a-be9b-2649ee808ae2 tempest-VolumesSnapshotListTestJSON-931035230 None] Lock "cinder-7b1f4114-7ff9-4551-a172-97e542ce53e3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:17:16 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-5fde8023-bd53-4a7a-be9b-2649ee808ae2 tempest-VolumesSnapshotListTestJSON-931035230 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:17:16 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-5fde8023-bd53-4a7a-be9b-2649ee808ae2 tempest-VolumesSnapshotListTestJSON-931035230 None] Acquiring lock "cinder-quobyte-3a8f0242-4e23-4b10-a857-649d8e588fba" by "delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:17:16 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-5fde8023-bd53-4a7a-be9b-2649ee808ae2 tempest-VolumesSnapshotListTestJSON-931035230 None] Lock "cinder-quobyte-3a8f0242-4e23-4b10-a857-649d8e588fba" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:17:16 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-5fde8023-bd53-4a7a-be9b-2649ee808ae2 tempest-VolumesSnapshotListTestJSON-931035230 None] Acquiring lock "cinder-quobyte-7b1f4114-7ff9-4551-a172-97e542ce53e3" by "_delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:17:16 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-5fde8023-bd53-4a7a-be9b-2649ee808ae2 tempest-VolumesSnapshotListTestJSON-931035230 None] Lock "cinder-quobyte-7b1f4114-7ff9-4551-a172-97e542ce53e3" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:17:16 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-5fde8023-bd53-4a7a-be9b-2649ee808ae2 tempest-VolumesSnapshotListTestJSON-931035230 None] Deleting offline snapshot 7b1f4114-7ff9-4551-a172-97e542ce53e3 of volume 3a8f0242-4e23-4b10-a857-649d8e588fba {{(pid=82780) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 21:17:16 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-5fde8023-bd53-4a7a-be9b-2649ee808ae2 tempest-VolumesSnapshotListTestJSON-931035230 None] snapshot_file for this snap is: volume-3a8f0242-4e23-4b10-a857-649d8e588fba.7b1f4114-7ff9-4551-a172-97e542ce53e3 {{(pid=82780) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 21:17:16 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c5e9d8-bc38-4294-9a91-aa9a0ca5501c]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:17:16 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-5fde8023-bd53-4a7a-be9b-2649ee808ae2 tempest-VolumesSnapshotListTestJSON-931035230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba.7b1f4114-7ff9-4551-a172-97e542ce53e3 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:17:16 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-5fde8023-bd53-4a7a-be9b-2649ee808ae2 tempest-VolumesSnapshotListTestJSON-931035230 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba.7b1f4114-7ff9-4551-a172-97e542ce53e3" returned: 0 in 0.433s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:17:16 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-5fde8023-bd53-4a7a-be9b-2649ee808ae2 tempest-VolumesSnapshotListTestJSON-931035230 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a8f0242-4e23-4b10-a857-649d8e588fba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82780) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 21:17:16 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77214b1-5c55-4c29-a824-a71315ca6a7e]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:17:16 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-5fde8023-bd53-4a7a-be9b-2649ee808ae2 tempest-VolumesSnapshotListTestJSON-931035230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba.e7dafee5-dd01-4eb3-9125-71424b9c3991 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:17:17 devstack quobyte-client[82807]: System call of process 91403 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:17:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-5fde8023-bd53-4a7a-be9b-2649ee808ae2 tempest-VolumesSnapshotListTestJSON-931035230 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba.e7dafee5-dd01-4eb3-9125-71424b9c3991" returned: 0 in 0.709s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:17:17 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-5fde8023-bd53-4a7a-be9b-2649ee808ae2 tempest-VolumesSnapshotListTestJSON-931035230 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a8f0242-4e23-4b10-a857-649d8e588fba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82780) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 21:17:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-5fde8023-bd53-4a7a-be9b-2649ee808ae2 tempest-VolumesSnapshotListTestJSON-931035230 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba.7b1f4114-7ff9-4551-a172-97e542ce53e3 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:17:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-5fde8023-bd53-4a7a-be9b-2649ee808ae2 tempest-VolumesSnapshotListTestJSON-931035230 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba.7b1f4114-7ff9-4551-a172-97e542ce53e3" returned: 0 in 0.321s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:17:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-5fde8023-bd53-4a7a-be9b-2649ee808ae2 tempest-VolumesSnapshotListTestJSON-931035230 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba.7b1f4114-7ff9-4551-a172-97e542ce53e3 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:17:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-5fde8023-bd53-4a7a-be9b-2649ee808ae2 tempest-VolumesSnapshotListTestJSON-931035230 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba.7b1f4114-7ff9-4551-a172-97e542ce53e3" returned: 0 in 0.131s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:17:18 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-5fde8023-bd53-4a7a-be9b-2649ee808ae2 tempest-VolumesSnapshotListTestJSON-931035230 None] Lock "cinder-quobyte-7b1f4114-7ff9-4551-a172-97e542ce53e3" released by "_delete_snapshot" :: held 1.914s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:17:18 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-5fde8023-bd53-4a7a-be9b-2649ee808ae2 tempest-VolumesSnapshotListTestJSON-931035230 None] Lock "cinder-quobyte-3a8f0242-4e23-4b10-a857-649d8e588fba" released by "delete_snapshot" :: held 1.940s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:17:18 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-5fde8023-bd53-4a7a-be9b-2649ee808ae2 tempest-VolumesSnapshotListTestJSON-931035230 None] Created reservations ['d1b520b9-2f9f-4bb0-a58e-09a79bb64859', 'e3331da3-d834-4b0f-9ac1-6f58b9f7d50e', 'f1ba8f9e-b164-46cd-bf1d-aa233c2cadd3', '30a9fe95-f2fe-477b-952a-ab6a07276c21'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:17:18 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-5fde8023-bd53-4a7a-be9b-2649ee808ae2 tempest-VolumesSnapshotListTestJSON-931035230 None] Delete snapshot completed successfully. Sep 10 21:17:18 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-5fde8023-bd53-4a7a-be9b-2649ee808ae2 tempest-VolumesSnapshotListTestJSON-931035230 None] Lock "cinder-7b1f4114-7ff9-4551-a172-97e542ce53e3-delete_snapshot" released by "delete_snapshot" :: held 2.722s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:17:19 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-1f0b585c-ce62-40d6-9931-ae4f24670927 tempest-VolumesSnapshotListTestJSON-931035230 None] Acquiring lock "cinder-e7dafee5-dd01-4eb3-9125-71424b9c3991-delete_snapshot" by "delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:17:19 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-1f0b585c-ce62-40d6-9931-ae4f24670927 tempest-VolumesSnapshotListTestJSON-931035230 None] Lock "cinder-e7dafee5-dd01-4eb3-9125-71424b9c3991-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:17:19 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-1f0b585c-ce62-40d6-9931-ae4f24670927 tempest-VolumesSnapshotListTestJSON-931035230 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:17:19 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-1f0b585c-ce62-40d6-9931-ae4f24670927 tempest-VolumesSnapshotListTestJSON-931035230 None] Acquiring lock "cinder-quobyte-3a8f0242-4e23-4b10-a857-649d8e588fba" by "delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:17:19 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-1f0b585c-ce62-40d6-9931-ae4f24670927 tempest-VolumesSnapshotListTestJSON-931035230 None] Lock "cinder-quobyte-3a8f0242-4e23-4b10-a857-649d8e588fba" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:17:19 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-1f0b585c-ce62-40d6-9931-ae4f24670927 tempest-VolumesSnapshotListTestJSON-931035230 None] Acquiring lock "cinder-quobyte-e7dafee5-dd01-4eb3-9125-71424b9c3991" by "_delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:17:19 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-1f0b585c-ce62-40d6-9931-ae4f24670927 tempest-VolumesSnapshotListTestJSON-931035230 None] Lock "cinder-quobyte-e7dafee5-dd01-4eb3-9125-71424b9c3991" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:17:19 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-1f0b585c-ce62-40d6-9931-ae4f24670927 tempest-VolumesSnapshotListTestJSON-931035230 None] Deleting offline snapshot e7dafee5-dd01-4eb3-9125-71424b9c3991 of volume 3a8f0242-4e23-4b10-a857-649d8e588fba {{(pid=82780) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 21:17:19 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-1f0b585c-ce62-40d6-9931-ae4f24670927 tempest-VolumesSnapshotListTestJSON-931035230 None] snapshot_file for this snap is: volume-3a8f0242-4e23-4b10-a857-649d8e588fba.e7dafee5-dd01-4eb3-9125-71424b9c3991 {{(pid=82780) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 21:17:19 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f31636-93c4-4f26-b34f-6494c2d44642]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:17:19 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1f0b585c-ce62-40d6-9931-ae4f24670927 tempest-VolumesSnapshotListTestJSON-931035230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba.e7dafee5-dd01-4eb3-9125-71424b9c3991 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:17:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1f0b585c-ce62-40d6-9931-ae4f24670927 tempest-VolumesSnapshotListTestJSON-931035230 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba.e7dafee5-dd01-4eb3-9125-71424b9c3991" returned: 0 in 0.550s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:17:20 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-1f0b585c-ce62-40d6-9931-ae4f24670927 tempest-VolumesSnapshotListTestJSON-931035230 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a8f0242-4e23-4b10-a857-649d8e588fba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82780) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 21:17:20 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1d3825-76e9-416c-8bc9-68500090cd16]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:17:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1f0b585c-ce62-40d6-9931-ae4f24670927 tempest-VolumesSnapshotListTestJSON-931035230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:17:20 devstack quobyte-client[82807]: System call of process 91418 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:17:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1f0b585c-ce62-40d6-9931-ae4f24670927 tempest-VolumesSnapshotListTestJSON-931035230 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba" returned: 0 in 0.655s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:17:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1f0b585c-ce62-40d6-9931-ae4f24670927 tempest-VolumesSnapshotListTestJSON-931035230 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba.e7dafee5-dd01-4eb3-9125-71424b9c3991 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:17:21 devstack quobyte-client[82807]: System call of process 91424 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:17:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1f0b585c-ce62-40d6-9931-ae4f24670927 tempest-VolumesSnapshotListTestJSON-931035230 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba.e7dafee5-dd01-4eb3-9125-71424b9c3991" returned: 0 in 0.455s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:17:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1f0b585c-ce62-40d6-9931-ae4f24670927 tempest-VolumesSnapshotListTestJSON-931035230 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba.e7dafee5-dd01-4eb3-9125-71424b9c3991 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:17:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1f0b585c-ce62-40d6-9931-ae4f24670927 tempest-VolumesSnapshotListTestJSON-931035230 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba.e7dafee5-dd01-4eb3-9125-71424b9c3991" returned: 0 in 0.186s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:17:21 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-1f0b585c-ce62-40d6-9931-ae4f24670927 tempest-VolumesSnapshotListTestJSON-931035230 None] Lock "cinder-quobyte-e7dafee5-dd01-4eb3-9125-71424b9c3991" released by "_delete_snapshot" :: held 2.326s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:17:21 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-1f0b585c-ce62-40d6-9931-ae4f24670927 tempest-VolumesSnapshotListTestJSON-931035230 None] Lock "cinder-quobyte-3a8f0242-4e23-4b10-a857-649d8e588fba" released by "delete_snapshot" :: held 2.349s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:17:22 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-1f0b585c-ce62-40d6-9931-ae4f24670927 tempest-VolumesSnapshotListTestJSON-931035230 None] Created reservations ['d525f58e-9ae6-4aaf-bc8a-6214898d76f7', '7136bea6-9228-428d-b3c3-83fcd1705bb6', '4f9bf03d-146c-4924-a438-2a76f33c4fd3', '88b361df-e514-4f8e-bd72-e4b147821058'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:17:22 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-1f0b585c-ce62-40d6-9931-ae4f24670927 tempest-VolumesSnapshotListTestJSON-931035230 None] Delete snapshot completed successfully. Sep 10 21:17:22 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-1f0b585c-ce62-40d6-9931-ae4f24670927 tempest-VolumesSnapshotListTestJSON-931035230 None] Lock "cinder-e7dafee5-dd01-4eb3-9125-71424b9c3991-delete_snapshot" released by "delete_snapshot" :: held 3.030s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:17:23 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-427b4bea-1307-49fc-9019-06b8980f6b0b tempest-VolumesSnapshotListTestJSON-931035230 None] Acquiring lock "cinder-3a8f0242-4e23-4b10-a857-649d8e588fba-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:17:23 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-427b4bea-1307-49fc-9019-06b8980f6b0b tempest-VolumesSnapshotListTestJSON-931035230 None] Lock "cinder-3a8f0242-4e23-4b10-a857-649d8e588fba-delete_volume" acquired by "delete_volume" :: waited 0.139s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:17:23 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-427b4bea-1307-49fc-9019-06b8980f6b0b tempest-VolumesSnapshotListTestJSON-931035230 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:17:23 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-427b4bea-1307-49fc-9019-06b8980f6b0b tempest-VolumesSnapshotListTestJSON-931035230 None] Acquiring lock "cinder-quobyte-3a8f0242-4e23-4b10-a857-649d8e588fba" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:17:24 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-427b4bea-1307-49fc-9019-06b8980f6b0b tempest-VolumesSnapshotListTestJSON-931035230 None] Lock "cinder-quobyte-3a8f0242-4e23-4b10-a857-649d8e588fba" acquired by "delete_volume" :: waited 0.045s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:17:24 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[736ead73-7b9a-41e7-9a2f-291740decafb]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:17:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-427b4bea-1307-49fc-9019-06b8980f6b0b tempest-VolumesSnapshotListTestJSON-931035230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:17:25 devstack quobyte-client[82807]: System call of process 91471 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:17:26 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-427b4bea-1307-49fc-9019-06b8980f6b0b tempest-VolumesSnapshotListTestJSON-931035230 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba" returned: 0 in 1.823s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:17:26 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-427b4bea-1307-49fc-9019-06b8980f6b0b tempest-VolumesSnapshotListTestJSON-931035230 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:17:26 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-427b4bea-1307-49fc-9019-06b8980f6b0b tempest-VolumesSnapshotListTestJSON-931035230 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a8f0242-4e23-4b10-a857-649d8e588fba" returned: 0 in 0.515s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:17:27 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-427b4bea-1307-49fc-9019-06b8980f6b0b tempest-VolumesSnapshotListTestJSON-931035230 None] Lock "cinder-quobyte-3a8f0242-4e23-4b10-a857-649d8e588fba" released by "delete_volume" :: held 3.184s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:17:28 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-427b4bea-1307-49fc-9019-06b8980f6b0b tempest-VolumesSnapshotListTestJSON-931035230 None] Created reservations ['851e9fcc-0ca8-4351-935b-9cdc0ca51f52', '8392ccbb-17a4-429d-a93f-96cd4eae934e', 'b324612e-d039-45b2-8ed2-10d5195fc01c', '411df069-dcaf-4296-80dc-0cc3956a5eaf'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:17:28 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-427b4bea-1307-49fc-9019-06b8980f6b0b tempest-VolumesSnapshotListTestJSON-931035230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:17:28 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-427b4bea-1307-49fc-9019-06b8980f6b0b tempest-VolumesSnapshotListTestJSON-931035230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:17:28 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-427b4bea-1307-49fc-9019-06b8980f6b0b tempest-VolumesSnapshotListTestJSON-931035230 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:17:28 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-427b4bea-1307-49fc-9019-06b8980f6b0b tempest-VolumesSnapshotListTestJSON-931035230 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:17:28 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-427b4bea-1307-49fc-9019-06b8980f6b0b tempest-VolumesSnapshotListTestJSON-931035230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:17:28 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-427b4bea-1307-49fc-9019-06b8980f6b0b tempest-VolumesSnapshotListTestJSON-931035230 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:17:29 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-427b4bea-1307-49fc-9019-06b8980f6b0b tempest-VolumesSnapshotListTestJSON-931035230 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.366s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:17:29 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-427b4bea-1307-49fc-9019-06b8980f6b0b tempest-VolumesSnapshotListTestJSON-931035230 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:17:29 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-427b4bea-1307-49fc-9019-06b8980f6b0b tempest-VolumesSnapshotListTestJSON-931035230 None] Deleted volume successfully. Sep 10 21:17:30 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-427b4bea-1307-49fc-9019-06b8980f6b0b tempest-VolumesSnapshotListTestJSON-931035230 None] Lock "cinder-3a8f0242-4e23-4b10-a857-649d8e588fba-delete_volume" released by "delete_volume" :: held 6.628s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:17:38 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:UPDATE=42,cinder:SELECT=28,cinder:DELETE=2,cinder:INSERT=8 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:17:40 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=30,cinder:INSERT=12,cinder:UPDATE=33,cinder:DELETE=4 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:17:56 devstack cinder-volume[82780]: DEBUG oslo_service.periodic_task [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82780) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 21:17:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:17:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:17:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:17:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:17:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:17:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:17:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.331s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:17:57 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:17:59 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=1 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:17:59 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:UPDATE=1 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:18:39 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-1f609a4d-ed0d-45aa-a2d5-864122fb7615 tempest-ServersNegativeTestJSON-282202013 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:18:40 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f609a4d-ed0d-45aa-a2d5-864122fb7615 tempest-ServersNegativeTestJSON-282202013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:18:40 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1f609a4d-ed0d-45aa-a2d5-864122fb7615 tempest-ServersNegativeTestJSON-282202013 None] Flow 'volume_create_manager' (204c5335-c335-44b5-a3c2-f046aba3bddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:18:40 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1f609a4d-ed0d-45aa-a2d5-864122fb7615 tempest-ServersNegativeTestJSON-282202013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (510aa169-04cf-4d28-874b-53d5b3aad8ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:18:40 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1f609a4d-ed0d-45aa-a2d5-864122fb7615 tempest-ServersNegativeTestJSON-282202013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (510aa169-04cf-4d28-874b-53d5b3aad8ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:18:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-474402714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=519cc57e-ae5a-4537-b0fd-08868ff5e660,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f4ecddda56a46799dbf1c5fb9e45b38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:18:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:18:40Z,use_quota=True,user_id='baf8e56fdfda429e8beccbe85567da00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:18:40 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1f609a4d-ed0d-45aa-a2d5-864122fb7615 tempest-ServersNegativeTestJSON-282202013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b60c7a2-66ec-4e16-a04f-7d9abc2d79eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:18:40 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1f609a4d-ed0d-45aa-a2d5-864122fb7615 tempest-ServersNegativeTestJSON-282202013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b60c7a2-66ec-4e16-a04f-7d9abc2d79eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:18:40 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1f609a4d-ed0d-45aa-a2d5-864122fb7615 tempest-ServersNegativeTestJSON-282202013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (395752aa-d5e8-4db7-8cf8-565e4ca3f359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:18:40 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1f609a4d-ed0d-45aa-a2d5-864122fb7615 tempest-ServersNegativeTestJSON-282202013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (395752aa-d5e8-4db7-8cf8-565e4ca3f359) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '519cc57e-ae5a-4537-b0fd-08868ff5e660', 'volume_name': 'volume-519cc57e-ae5a-4537-b0fd-08868ff5e660', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:18:40 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1f609a4d-ed0d-45aa-a2d5-864122fb7615 tempest-ServersNegativeTestJSON-282202013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0ebda26-069f-4e3b-b3e1-8f00b9fe57cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:18:40 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1f609a4d-ed0d-45aa-a2d5-864122fb7615 tempest-ServersNegativeTestJSON-282202013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0ebda26-069f-4e3b-b3e1-8f00b9fe57cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:18:40 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1f609a4d-ed0d-45aa-a2d5-864122fb7615 tempest-ServersNegativeTestJSON-282202013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (225c736b-309c-461b-9ff1-e0cd45754577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:18:40 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-1f609a4d-ed0d-45aa-a2d5-864122fb7615 tempest-ServersNegativeTestJSON-282202013 None] Volume 519cc57e-ae5a-4537-b0fd-08868ff5e660: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-519cc57e-ae5a-4537-b0fd-08868ff5e660', 'volume_size': 1} Sep 10 21:18:40 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-1f609a4d-ed0d-45aa-a2d5-864122fb7615 tempest-ServersNegativeTestJSON-282202013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:18:40 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-1f609a4d-ed0d-45aa-a2d5-864122fb7615 tempest-ServersNegativeTestJSON-282202013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:18:40 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-1f609a4d-ed0d-45aa-a2d5-864122fb7615 tempest-ServersNegativeTestJSON-282202013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:18:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-474402714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=519cc57e-ae5a-4537-b0fd-08868ff5e660,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f4ecddda56a46799dbf1c5fb9e45b38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:18:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:18:40Z,use_quota=True,user_id='baf8e56fdfda429e8beccbe85567da00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:18:40 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-1f609a4d-ed0d-45aa-a2d5-864122fb7615 tempest-ServersNegativeTestJSON-282202013 None] Creating volume 519cc57e-ae5a-4537-b0fd-08868ff5e660 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:18:40 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-1f609a4d-ed0d-45aa-a2d5-864122fb7615 tempest-ServersNegativeTestJSON-282202013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:18:40 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-1f609a4d-ed0d-45aa-a2d5-864122fb7615 tempest-ServersNegativeTestJSON-282202013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:18:40 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-1f609a4d-ed0d-45aa-a2d5-864122fb7615 tempest-ServersNegativeTestJSON-282202013 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:18:40 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-1f609a4d-ed0d-45aa-a2d5-864122fb7615 tempest-ServersNegativeTestJSON-282202013 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:18:40 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-1f609a4d-ed0d-45aa-a2d5-864122fb7615 tempest-ServersNegativeTestJSON-282202013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:18:40 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-1f609a4d-ed0d-45aa-a2d5-864122fb7615 tempest-ServersNegativeTestJSON-282202013 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:18:40 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-1f609a4d-ed0d-45aa-a2d5-864122fb7615 tempest-ServersNegativeTestJSON-282202013 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:18:40 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1f609a4d-ed0d-45aa-a2d5-864122fb7615 tempest-ServersNegativeTestJSON-282202013 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-519cc57e-ae5a-4537-b0fd-08868ff5e660 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:18:40 devstack quobyte-client[82807]: System call of process 91787 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:18:40 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=36, name=volume-519cc57e-ae5a-4537-b0fd-08868ff5e660, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:18:41 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1f609a4d-ed0d-45aa-a2d5-864122fb7615 tempest-ServersNegativeTestJSON-282202013 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-519cc57e-ae5a-4537-b0fd-08868ff5e660 1073741824" returned: 0 in 0.589s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:18:41 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1f609a4d-ed0d-45aa-a2d5-864122fb7615 tempest-ServersNegativeTestJSON-282202013 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-519cc57e-ae5a-4537-b0fd-08868ff5e660 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:18:41 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1f609a4d-ed0d-45aa-a2d5-864122fb7615 tempest-ServersNegativeTestJSON-282202013 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-519cc57e-ae5a-4537-b0fd-08868ff5e660" returned: 0 in 0.158s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:18:41 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-1f609a4d-ed0d-45aa-a2d5-864122fb7615 tempest-ServersNegativeTestJSON-282202013 None] <== create_volume: return (890ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:18:41 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-1f609a4d-ed0d-45aa-a2d5-864122fb7615 tempest-ServersNegativeTestJSON-282202013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:18:41 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1f609a4d-ed0d-45aa-a2d5-864122fb7615 tempest-ServersNegativeTestJSON-282202013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (225c736b-309c-461b-9ff1-e0cd45754577) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-519cc57e-ae5a-4537-b0fd-08868ff5e660', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:18:41 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1f609a4d-ed0d-45aa-a2d5-864122fb7615 tempest-ServersNegativeTestJSON-282202013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c08e9cf4-6518-4a7f-9a25-719fd0cc2c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:18:41 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-1f609a4d-ed0d-45aa-a2d5-864122fb7615 tempest-ServersNegativeTestJSON-282202013 None] Volume volume-519cc57e-ae5a-4537-b0fd-08868ff5e660 (519cc57e-ae5a-4537-b0fd-08868ff5e660): created successfully Sep 10 21:18:41 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1f609a4d-ed0d-45aa-a2d5-864122fb7615 tempest-ServersNegativeTestJSON-282202013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c08e9cf4-6518-4a7f-9a25-719fd0cc2c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:18:41 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1f609a4d-ed0d-45aa-a2d5-864122fb7615 tempest-ServersNegativeTestJSON-282202013 None] Flow 'volume_create_manager' (204c5335-c335-44b5-a3c2-f046aba3bddc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:18:41 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-1f609a4d-ed0d-45aa-a2d5-864122fb7615 tempest-ServersNegativeTestJSON-282202013 None] Created volume successfully. Sep 10 21:18:44 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-7bc7bffa-bb6d-49ce-9097-65fd502db433 req-f2837a29-99f4-427d-ab0d-3a32ce5af477 tempest-AttachVolumeTestJSON-828295401 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:18:45 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-7bc7bffa-bb6d-49ce-9097-65fd502db433 req-f2837a29-99f4-427d-ab0d-3a32ce5af477 tempest-AttachVolumeTestJSON-828295401 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:18:45 devstack cinder-volume[82780]: INFO cinder.volume.manager [req-7bc7bffa-bb6d-49ce-9097-65fd502db433 req-f2837a29-99f4-427d-ab0d-3a32ce5af477 tempest-AttachVolumeTestJSON-828295401 None] Terminate volume connection completed successfully. Sep 10 21:18:45 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-7bc7bffa-bb6d-49ce-9097-65fd502db433 req-f2837a29-99f4-427d-ab0d-3a32ce5af477 tempest-AttachVolumeTestJSON-828295401 None] Deleting attachment d8d3976c-55c4-42d1-87d7-7a7f6c4f0ed5. {{(pid=82780) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 21:18:47 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-b939a98f-f609-4cb8-b015-4c87d31f18ee tempest-ServersNegativeTestJSON-282202013 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:18:47 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-b939a98f-f609-4cb8-b015-4c87d31f18ee tempest-ServersNegativeTestJSON-282202013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:18:47 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-b939a98f-f609-4cb8-b015-4c87d31f18ee tempest-ServersNegativeTestJSON-282202013 None] Flow 'volume_create_manager' (a3b976b0-537f-4218-8c1b-2e540cea22f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:18:47 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-b939a98f-f609-4cb8-b015-4c87d31f18ee tempest-ServersNegativeTestJSON-282202013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aae31015-b755-485c-9ed1-89e491ef6428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:18:47 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-b939a98f-f609-4cb8-b015-4c87d31f18ee tempest-ServersNegativeTestJSON-282202013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aae31015-b755-485c-9ed1-89e491ef6428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:18:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1192813039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7edaebf7-f8e4-43d1-acea-40237f9da961,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f4ecddda56a46799dbf1c5fb9e45b38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:18:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:18:47Z,use_quota=True,user_id='baf8e56fdfda429e8beccbe85567da00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:18:47 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-b939a98f-f609-4cb8-b015-4c87d31f18ee tempest-ServersNegativeTestJSON-282202013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b01e221a-94cc-433f-83a9-4e9fa9548b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:18:47 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-b939a98f-f609-4cb8-b015-4c87d31f18ee tempest-ServersNegativeTestJSON-282202013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b01e221a-94cc-433f-83a9-4e9fa9548b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:18:47 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-b939a98f-f609-4cb8-b015-4c87d31f18ee tempest-ServersNegativeTestJSON-282202013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (248ede92-3cc6-4da3-b5f1-5ae13e5dac88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:18:47 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-b939a98f-f609-4cb8-b015-4c87d31f18ee tempest-ServersNegativeTestJSON-282202013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (248ede92-3cc6-4da3-b5f1-5ae13e5dac88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7edaebf7-f8e4-43d1-acea-40237f9da961', 'volume_name': 'volume-7edaebf7-f8e4-43d1-acea-40237f9da961', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:18:47 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-b939a98f-f609-4cb8-b015-4c87d31f18ee tempest-ServersNegativeTestJSON-282202013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd39b2c1-7c83-4e2b-a0c7-52a0875a9fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:18:47 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-b939a98f-f609-4cb8-b015-4c87d31f18ee tempest-ServersNegativeTestJSON-282202013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd39b2c1-7c83-4e2b-a0c7-52a0875a9fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:18:47 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-b939a98f-f609-4cb8-b015-4c87d31f18ee tempest-ServersNegativeTestJSON-282202013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (748da583-329b-4612-8eb5-26ad17a3233e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:18:47 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-b939a98f-f609-4cb8-b015-4c87d31f18ee tempest-ServersNegativeTestJSON-282202013 None] Volume 7edaebf7-f8e4-43d1-acea-40237f9da961: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7edaebf7-f8e4-43d1-acea-40237f9da961', 'volume_size': 1} Sep 10 21:18:47 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-b939a98f-f609-4cb8-b015-4c87d31f18ee tempest-ServersNegativeTestJSON-282202013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:18:47 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-b939a98f-f609-4cb8-b015-4c87d31f18ee tempest-ServersNegativeTestJSON-282202013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:18:47 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-b939a98f-f609-4cb8-b015-4c87d31f18ee tempest-ServersNegativeTestJSON-282202013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:18:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1192813039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7edaebf7-f8e4-43d1-acea-40237f9da961,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f4ecddda56a46799dbf1c5fb9e45b38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:18:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:18:47Z,use_quota=True,user_id='baf8e56fdfda429e8beccbe85567da00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:18:47 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-b939a98f-f609-4cb8-b015-4c87d31f18ee tempest-ServersNegativeTestJSON-282202013 None] Creating volume 7edaebf7-f8e4-43d1-acea-40237f9da961 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:18:47 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-b939a98f-f609-4cb8-b015-4c87d31f18ee tempest-ServersNegativeTestJSON-282202013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:18:47 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-b939a98f-f609-4cb8-b015-4c87d31f18ee tempest-ServersNegativeTestJSON-282202013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:18:47 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-b939a98f-f609-4cb8-b015-4c87d31f18ee tempest-ServersNegativeTestJSON-282202013 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:18:47 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-b939a98f-f609-4cb8-b015-4c87d31f18ee tempest-ServersNegativeTestJSON-282202013 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:18:47 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-b939a98f-f609-4cb8-b015-4c87d31f18ee tempest-ServersNegativeTestJSON-282202013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:18:47 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-b939a98f-f609-4cb8-b015-4c87d31f18ee tempest-ServersNegativeTestJSON-282202013 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:18:47 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-b939a98f-f609-4cb8-b015-4c87d31f18ee tempest-ServersNegativeTestJSON-282202013 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:18:47 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b939a98f-f609-4cb8-b015-4c87d31f18ee tempest-ServersNegativeTestJSON-282202013 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-7edaebf7-f8e4-43d1-acea-40237f9da961 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:18:48 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=37, name=volume-7edaebf7-f8e4-43d1-acea-40237f9da961, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:18:48 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b939a98f-f609-4cb8-b015-4c87d31f18ee tempest-ServersNegativeTestJSON-282202013 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-7edaebf7-f8e4-43d1-acea-40237f9da961 1073741824" returned: 0 in 0.605s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:18:48 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b939a98f-f609-4cb8-b015-4c87d31f18ee tempest-ServersNegativeTestJSON-282202013 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-7edaebf7-f8e4-43d1-acea-40237f9da961 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:18:49 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b939a98f-f609-4cb8-b015-4c87d31f18ee tempest-ServersNegativeTestJSON-282202013 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-7edaebf7-f8e4-43d1-acea-40237f9da961" returned: 0 in 0.755s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:18:49 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-b939a98f-f609-4cb8-b015-4c87d31f18ee tempest-ServersNegativeTestJSON-282202013 None] <== create_volume: return (1570ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:18:49 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-b939a98f-f609-4cb8-b015-4c87d31f18ee tempest-ServersNegativeTestJSON-282202013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.649s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:18:50 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-b939a98f-f609-4cb8-b015-4c87d31f18ee tempest-ServersNegativeTestJSON-282202013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (748da583-329b-4612-8eb5-26ad17a3233e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7edaebf7-f8e4-43d1-acea-40237f9da961', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:18:50 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-b939a98f-f609-4cb8-b015-4c87d31f18ee tempest-ServersNegativeTestJSON-282202013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ee70d41-a2f6-41b7-a350-acb164e88887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:18:50 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-b939a98f-f609-4cb8-b015-4c87d31f18ee tempest-ServersNegativeTestJSON-282202013 None] Volume volume-7edaebf7-f8e4-43d1-acea-40237f9da961 (7edaebf7-f8e4-43d1-acea-40237f9da961): created successfully Sep 10 21:18:50 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-b939a98f-f609-4cb8-b015-4c87d31f18ee tempest-ServersNegativeTestJSON-282202013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ee70d41-a2f6-41b7-a350-acb164e88887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:18:50 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-b939a98f-f609-4cb8-b015-4c87d31f18ee tempest-ServersNegativeTestJSON-282202013 None] Flow 'volume_create_manager' (a3b976b0-537f-4218-8c1b-2e540cea22f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:18:51 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-b939a98f-f609-4cb8-b015-4c87d31f18ee tempest-ServersNegativeTestJSON-282202013 None] Created volume successfully. Sep 10 21:18:52 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-4fc241fa-599f-495e-adda-2c4948173981 tempest-ServersNegativeTestJSON-282202013 None] Acquiring lock "cinder-7edaebf7-f8e4-43d1-acea-40237f9da961-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:18:52 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-4fc241fa-599f-495e-adda-2c4948173981 tempest-ServersNegativeTestJSON-282202013 None] Lock "cinder-7edaebf7-f8e4-43d1-acea-40237f9da961-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:18:52 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-4fc241fa-599f-495e-adda-2c4948173981 tempest-ServersNegativeTestJSON-282202013 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:18:52 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-4fc241fa-599f-495e-adda-2c4948173981 tempest-ServersNegativeTestJSON-282202013 None] Acquiring lock "cinder-quobyte-7edaebf7-f8e4-43d1-acea-40237f9da961" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:18:52 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-4fc241fa-599f-495e-adda-2c4948173981 tempest-ServersNegativeTestJSON-282202013 None] Lock "cinder-quobyte-7edaebf7-f8e4-43d1-acea-40237f9da961" acquired by "delete_volume" :: waited 0.016s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:18:52 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46574b7-ce94-48ee-af6c-be207f645992]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:18:52 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4fc241fa-599f-495e-adda-2c4948173981 tempest-ServersNegativeTestJSON-282202013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-7edaebf7-f8e4-43d1-acea-40237f9da961 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:18:53 devstack quobyte-client[82807]: System call of process 91872 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:18:53 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4fc241fa-599f-495e-adda-2c4948173981 tempest-ServersNegativeTestJSON-282202013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-7edaebf7-f8e4-43d1-acea-40237f9da961" returned: 0 in 1.044s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:18:53 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4fc241fa-599f-495e-adda-2c4948173981 tempest-ServersNegativeTestJSON-282202013 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-7edaebf7-f8e4-43d1-acea-40237f9da961 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:18:53 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4fc241fa-599f-495e-adda-2c4948173981 tempest-ServersNegativeTestJSON-282202013 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-7edaebf7-f8e4-43d1-acea-40237f9da961" returned: 0 in 0.290s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:18:54 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-4fc241fa-599f-495e-adda-2c4948173981 tempest-ServersNegativeTestJSON-282202013 None] Lock "cinder-quobyte-7edaebf7-f8e4-43d1-acea-40237f9da961" released by "delete_volume" :: held 1.584s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:18:54 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-4fc241fa-599f-495e-adda-2c4948173981 tempest-ServersNegativeTestJSON-282202013 None] Created reservations ['00b7fbb9-1dd7-41a5-9db8-c05f625177a6', 'ae1ff03a-fa29-4d35-8e94-7b6c63b8dc28', 'e4b9a89a-430a-49f8-93ab-7a84ff4b73b4', 'c9a6ab38-5be2-46ed-a961-7a936209e526'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:18:55 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-4fc241fa-599f-495e-adda-2c4948173981 tempest-ServersNegativeTestJSON-282202013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:18:55 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-4fc241fa-599f-495e-adda-2c4948173981 tempest-ServersNegativeTestJSON-282202013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:18:55 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-4fc241fa-599f-495e-adda-2c4948173981 tempest-ServersNegativeTestJSON-282202013 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:18:55 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-4fc241fa-599f-495e-adda-2c4948173981 tempest-ServersNegativeTestJSON-282202013 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:18:55 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-4fc241fa-599f-495e-adda-2c4948173981 tempest-ServersNegativeTestJSON-282202013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:18:55 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4fc241fa-599f-495e-adda-2c4948173981 tempest-ServersNegativeTestJSON-282202013 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:18:55 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4fc241fa-599f-495e-adda-2c4948173981 tempest-ServersNegativeTestJSON-282202013 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.376s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:18:56 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-4fc241fa-599f-495e-adda-2c4948173981 tempest-ServersNegativeTestJSON-282202013 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:18:56 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-4fc241fa-599f-495e-adda-2c4948173981 tempest-ServersNegativeTestJSON-282202013 None] Deleted volume successfully. Sep 10 21:18:56 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-978e6dff-e9ca-418e-9aee-e461fd439ebe tempest-ServersNegativeTestJSON-282202013 None] Acquiring lock "cinder-519cc57e-ae5a-4537-b0fd-08868ff5e660-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:18:56 devstack cinder-volume[82780]: DEBUG oslo_service.periodic_task [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82780) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 21:18:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:18:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:18:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:18:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:18:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:18:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:18:57 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-4fc241fa-599f-495e-adda-2c4948173981 tempest-ServersNegativeTestJSON-282202013 None] Lock "cinder-7edaebf7-f8e4-43d1-acea-40237f9da961-delete_volume" released by "delete_volume" :: held 4.881s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:18:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.430s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:18:57 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:18:57 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-978e6dff-e9ca-418e-9aee-e461fd439ebe tempest-ServersNegativeTestJSON-282202013 None] Lock "cinder-519cc57e-ae5a-4537-b0fd-08868ff5e660-delete_volume" acquired by "delete_volume" :: waited 0.555s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:18:57 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-978e6dff-e9ca-418e-9aee-e461fd439ebe tempest-ServersNegativeTestJSON-282202013 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:18:57 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-978e6dff-e9ca-418e-9aee-e461fd439ebe tempest-ServersNegativeTestJSON-282202013 None] Acquiring lock "cinder-quobyte-519cc57e-ae5a-4537-b0fd-08868ff5e660" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:18:57 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-978e6dff-e9ca-418e-9aee-e461fd439ebe tempest-ServersNegativeTestJSON-282202013 None] Lock "cinder-quobyte-519cc57e-ae5a-4537-b0fd-08868ff5e660" acquired by "delete_volume" :: waited 0.041s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:18:57 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd26aef-55f2-4a5b-a125-4aaef4369842]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:18:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-978e6dff-e9ca-418e-9aee-e461fd439ebe tempest-ServersNegativeTestJSON-282202013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-519cc57e-ae5a-4537-b0fd-08868ff5e660 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:18:58 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-978e6dff-e9ca-418e-9aee-e461fd439ebe tempest-ServersNegativeTestJSON-282202013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-519cc57e-ae5a-4537-b0fd-08868ff5e660" returned: 0 in 0.918s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:18:58 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-978e6dff-e9ca-418e-9aee-e461fd439ebe tempest-ServersNegativeTestJSON-282202013 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-519cc57e-ae5a-4537-b0fd-08868ff5e660 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:18:59 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-978e6dff-e9ca-418e-9aee-e461fd439ebe tempest-ServersNegativeTestJSON-282202013 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-519cc57e-ae5a-4537-b0fd-08868ff5e660" returned: 0 in 0.219s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:18:59 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-978e6dff-e9ca-418e-9aee-e461fd439ebe tempest-ServersNegativeTestJSON-282202013 None] Lock "cinder-quobyte-519cc57e-ae5a-4537-b0fd-08868ff5e660" released by "delete_volume" :: held 1.446s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:18:59 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-978e6dff-e9ca-418e-9aee-e461fd439ebe tempest-ServersNegativeTestJSON-282202013 None] Created reservations ['01397cc7-c634-490a-83c4-4cf12dd56f3c', 'ecdcbe42-5423-4737-8485-0322566b4bd1', 'bf60da51-ba62-49ab-ba4b-a82eb647873d', 'dc0f4c2d-dbe9-407c-81e3-6f688bd32ce9'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:18:59 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-978e6dff-e9ca-418e-9aee-e461fd439ebe tempest-ServersNegativeTestJSON-282202013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:18:59 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-978e6dff-e9ca-418e-9aee-e461fd439ebe tempest-ServersNegativeTestJSON-282202013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:18:59 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-978e6dff-e9ca-418e-9aee-e461fd439ebe tempest-ServersNegativeTestJSON-282202013 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:18:59 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-978e6dff-e9ca-418e-9aee-e461fd439ebe tempest-ServersNegativeTestJSON-282202013 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:18:59 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-978e6dff-e9ca-418e-9aee-e461fd439ebe tempest-ServersNegativeTestJSON-282202013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:19:00 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-978e6dff-e9ca-418e-9aee-e461fd439ebe tempest-ServersNegativeTestJSON-282202013 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:19:00 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-978e6dff-e9ca-418e-9aee-e461fd439ebe tempest-ServersNegativeTestJSON-282202013 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.207s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:19:00 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-978e6dff-e9ca-418e-9aee-e461fd439ebe tempest-ServersNegativeTestJSON-282202013 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:19:00 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-978e6dff-e9ca-418e-9aee-e461fd439ebe tempest-ServersNegativeTestJSON-282202013 None] Deleted volume successfully. Sep 10 21:19:00 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-978e6dff-e9ca-418e-9aee-e461fd439ebe tempest-ServersNegativeTestJSON-282202013 None] Lock "cinder-519cc57e-ae5a-4537-b0fd-08868ff5e660-delete_volume" released by "delete_volume" :: held 3.514s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:19:09 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:UPDATE=26,cinder:DELETE=2,cinder:SELECT=13,cinder:INSERT=4 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:19:10 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=13,cinder:UPDATE=14,cinder:INSERT=4,cinder:DELETE=2 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:19:28 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-4b9eab94-68a9-42c4-b1d7-dc681ba2edce tempest-TestMinimumBasicScenario-1822304413 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:19:28 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b9eab94-68a9-42c4-b1d7-dc681ba2edce tempest-TestMinimumBasicScenario-1822304413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:19:28 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4b9eab94-68a9-42c4-b1d7-dc681ba2edce tempest-TestMinimumBasicScenario-1822304413 None] Flow 'volume_create_manager' (4ecc2898-d338-4476-ae58-e212553c5b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:19:29 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4b9eab94-68a9-42c4-b1d7-dc681ba2edce tempest-TestMinimumBasicScenario-1822304413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e518016c-030c-42b3-8fec-351bdb174554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:19:29 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4b9eab94-68a9-42c4-b1d7-dc681ba2edce tempest-TestMinimumBasicScenario-1822304413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e518016c-030c-42b3-8fec-351bdb174554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:19:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-69317614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab5b6fa0-4676-4559-a049-c8ada1626ddf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9c1b8f37045499a9000b1ef5d751b5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:19:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:19:28Z,use_quota=True,user_id='f2315466adb84e08b403ff35686025d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:19:29 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4b9eab94-68a9-42c4-b1d7-dc681ba2edce tempest-TestMinimumBasicScenario-1822304413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85961f2f-7c79-4b28-90f2-78bf52a7f19b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:19:29 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4b9eab94-68a9-42c4-b1d7-dc681ba2edce tempest-TestMinimumBasicScenario-1822304413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85961f2f-7c79-4b28-90f2-78bf52a7f19b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:19:29 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4b9eab94-68a9-42c4-b1d7-dc681ba2edce tempest-TestMinimumBasicScenario-1822304413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c261b0af-c1ca-4375-8850-e8490132daa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:19:29 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4b9eab94-68a9-42c4-b1d7-dc681ba2edce tempest-TestMinimumBasicScenario-1822304413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c261b0af-c1ca-4375-8850-e8490132daa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab5b6fa0-4676-4559-a049-c8ada1626ddf', 'volume_name': 'volume-ab5b6fa0-4676-4559-a049-c8ada1626ddf', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:19:29 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4b9eab94-68a9-42c4-b1d7-dc681ba2edce tempest-TestMinimumBasicScenario-1822304413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39f5d0ac-85c2-4088-8ebe-3c525dd78ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:19:29 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4b9eab94-68a9-42c4-b1d7-dc681ba2edce tempest-TestMinimumBasicScenario-1822304413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39f5d0ac-85c2-4088-8ebe-3c525dd78ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:19:29 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4b9eab94-68a9-42c4-b1d7-dc681ba2edce tempest-TestMinimumBasicScenario-1822304413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc2406de-2dad-4bf6-ac6f-0daa3cac7c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:19:29 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-4b9eab94-68a9-42c4-b1d7-dc681ba2edce tempest-TestMinimumBasicScenario-1822304413 None] Volume ab5b6fa0-4676-4559-a049-c8ada1626ddf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab5b6fa0-4676-4559-a049-c8ada1626ddf', 'volume_size': 1} Sep 10 21:19:29 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-4b9eab94-68a9-42c4-b1d7-dc681ba2edce tempest-TestMinimumBasicScenario-1822304413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:19:29 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-4b9eab94-68a9-42c4-b1d7-dc681ba2edce tempest-TestMinimumBasicScenario-1822304413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:19:29 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-4b9eab94-68a9-42c4-b1d7-dc681ba2edce tempest-TestMinimumBasicScenario-1822304413 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:19:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-69317614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab5b6fa0-4676-4559-a049-c8ada1626ddf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9c1b8f37045499a9000b1ef5d751b5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:19:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:19:28Z,use_quota=True,user_id='f2315466adb84e08b403ff35686025d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:19:29 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-4b9eab94-68a9-42c4-b1d7-dc681ba2edce tempest-TestMinimumBasicScenario-1822304413 None] Creating volume ab5b6fa0-4676-4559-a049-c8ada1626ddf {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:19:29 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-4b9eab94-68a9-42c4-b1d7-dc681ba2edce tempest-TestMinimumBasicScenario-1822304413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:19:29 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-4b9eab94-68a9-42c4-b1d7-dc681ba2edce tempest-TestMinimumBasicScenario-1822304413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:19:29 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-4b9eab94-68a9-42c4-b1d7-dc681ba2edce tempest-TestMinimumBasicScenario-1822304413 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:19:29 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-4b9eab94-68a9-42c4-b1d7-dc681ba2edce tempest-TestMinimumBasicScenario-1822304413 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:19:29 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-4b9eab94-68a9-42c4-b1d7-dc681ba2edce tempest-TestMinimumBasicScenario-1822304413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:19:29 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-4b9eab94-68a9-42c4-b1d7-dc681ba2edce tempest-TestMinimumBasicScenario-1822304413 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:19:29 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-4b9eab94-68a9-42c4-b1d7-dc681ba2edce tempest-TestMinimumBasicScenario-1822304413 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:19:29 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4b9eab94-68a9-42c4-b1d7-dc681ba2edce tempest-TestMinimumBasicScenario-1822304413 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ab5b6fa0-4676-4559-a049-c8ada1626ddf 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:19:29 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=38, name=volume-ab5b6fa0-4676-4559-a049-c8ada1626ddf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:19:29 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4b9eab94-68a9-42c4-b1d7-dc681ba2edce tempest-TestMinimumBasicScenario-1822304413 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ab5b6fa0-4676-4559-a049-c8ada1626ddf 1073741824" returned: 0 in 0.687s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:19:29 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4b9eab94-68a9-42c4-b1d7-dc681ba2edce tempest-TestMinimumBasicScenario-1822304413 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ab5b6fa0-4676-4559-a049-c8ada1626ddf {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:19:30 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4b9eab94-68a9-42c4-b1d7-dc681ba2edce tempest-TestMinimumBasicScenario-1822304413 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ab5b6fa0-4676-4559-a049-c8ada1626ddf" returned: 0 in 0.170s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:19:30 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-4b9eab94-68a9-42c4-b1d7-dc681ba2edce tempest-TestMinimumBasicScenario-1822304413 None] <== create_volume: return (966ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:19:30 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-4b9eab94-68a9-42c4-b1d7-dc681ba2edce tempest-TestMinimumBasicScenario-1822304413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:19:30 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4b9eab94-68a9-42c4-b1d7-dc681ba2edce tempest-TestMinimumBasicScenario-1822304413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc2406de-2dad-4bf6-ac6f-0daa3cac7c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab5b6fa0-4676-4559-a049-c8ada1626ddf', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:19:30 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4b9eab94-68a9-42c4-b1d7-dc681ba2edce tempest-TestMinimumBasicScenario-1822304413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f08da3e1-a821-42f1-a631-ca767266a4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:19:30 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-4b9eab94-68a9-42c4-b1d7-dc681ba2edce tempest-TestMinimumBasicScenario-1822304413 None] Volume volume-ab5b6fa0-4676-4559-a049-c8ada1626ddf (ab5b6fa0-4676-4559-a049-c8ada1626ddf): created successfully Sep 10 21:19:30 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4b9eab94-68a9-42c4-b1d7-dc681ba2edce tempest-TestMinimumBasicScenario-1822304413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f08da3e1-a821-42f1-a631-ca767266a4ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:19:30 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4b9eab94-68a9-42c4-b1d7-dc681ba2edce tempest-TestMinimumBasicScenario-1822304413 None] Flow 'volume_create_manager' (4ecc2898-d338-4476-ae58-e212553c5b7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:19:30 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-4b9eab94-68a9-42c4-b1d7-dc681ba2edce tempest-TestMinimumBasicScenario-1822304413 None] Created volume successfully. Sep 10 21:19:34 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-2cae271a-0527-4526-9027-4ba74f918cf8 tempest-BackendsCapabilitiesAdminTestsJSON-77555602 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.9144744873047, 'free_capacity_gb': 924.9144744873047, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82780) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}} Sep 10 21:19:34 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-08d5f3a7-fef6-431f-8a0a-f2edc1db6b9c tempest-BackendsCapabilitiesAdminTestsJSON-77555602 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.9144744873047, 'free_capacity_gb': 924.9144744873047, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82780) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}} Sep 10 21:19:38 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-edad36ee-e43e-4fb4-9844-fc65829457fa req-725cbaff-8579-4372-94bd-76a66add674d tempest-TestMinimumBasicScenario-1822304413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:19:38 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-edad36ee-e43e-4fb4-9844-fc65829457fa req-725cbaff-8579-4372-94bd-76a66add674d tempest-TestMinimumBasicScenario-1822304413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.024s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:19:38 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[6945004d-1be8-4bec-a964-9f8f9f7e2dd5]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:19:38 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-edad36ee-e43e-4fb4-9844-fc65829457fa req-725cbaff-8579-4372-94bd-76a66add674d tempest-TestMinimumBasicScenario-1822304413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ab5b6fa0-4676-4559-a049-c8ada1626ddf {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:19:39 devstack quobyte-client[82807]: System call of process 92216 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:19:39 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-edad36ee-e43e-4fb4-9844-fc65829457fa req-725cbaff-8579-4372-94bd-76a66add674d tempest-TestMinimumBasicScenario-1822304413 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ab5b6fa0-4676-4559-a049-c8ada1626ddf" returned: 0 in 1.401s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:19:39 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-edad36ee-e43e-4fb4-9844-fc65829457fa req-725cbaff-8579-4372-94bd-76a66add674d tempest-TestMinimumBasicScenario-1822304413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.650s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:19:40 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-edad36ee-e43e-4fb4-9844-fc65829457fa req-725cbaff-8579-4372-94bd-76a66add674d tempest-TestMinimumBasicScenario-1822304413 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b', 'name': 'volume-ab5b6fa0-4676-4559-a049-c8ada1626ddf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '28828e42-5553-405a-a584-8c482fa1cd3e', 'enforce_multipath': True} {{(pid=82780) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 21:19:40 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-edad36ee-e43e-4fb4-9844-fc65829457fa req-725cbaff-8579-4372-94bd-76a66add674d tempest-TestMinimumBasicScenario-1822304413 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:19:40 devstack cinder-volume[82780]: INFO cinder.volume.manager [req-edad36ee-e43e-4fb4-9844-fc65829457fa req-725cbaff-8579-4372-94bd-76a66add674d tempest-TestMinimumBasicScenario-1822304413 None] attachment_update completed successfully. Sep 10 21:19:56 devstack cinder-volume[82780]: DEBUG oslo_service.periodic_task [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82780) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 21:19:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:19:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.024s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:19:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:19:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:19:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:19:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:19:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.134s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:19:57 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:19:59 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:19:59 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:UPDATE=5,cinder:DELETE=1,cinder:SELECT=4 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:20:07 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-5c66aa3c-6258-4f61-a9cc-ff5c3cce7263 tempest-VolumeQuotasAdminTestJSON-547456736 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:20:07 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c66aa3c-6258-4f61-a9cc-ff5c3cce7263 tempest-VolumeQuotasAdminTestJSON-547456736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:20:07 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-5c66aa3c-6258-4f61-a9cc-ff5c3cce7263 tempest-VolumeQuotasAdminTestJSON-547456736 None] Flow 'volume_create_manager' (e9ae65e4-8fa1-4ba1-b0b7-e80d14d6d88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:20:07 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-5c66aa3c-6258-4f61-a9cc-ff5c3cce7263 tempest-VolumeQuotasAdminTestJSON-547456736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85376b91-303e-44da-b007-33eba98dd8c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:20:07 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-5c66aa3c-6258-4f61-a9cc-ff5c3cce7263 tempest-VolumeQuotasAdminTestJSON-547456736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85376b91-303e-44da-b007-33eba98dd8c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:20:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2094649656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e11e495-03bf-44ff-ba4c-3cce77748e73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dee0e78882414da7a12fc05c21a9af4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:20:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:20:07Z,use_quota=True,user_id='2f9dec021f7945b5a6d68ad481375283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:20:07 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-5c66aa3c-6258-4f61-a9cc-ff5c3cce7263 tempest-VolumeQuotasAdminTestJSON-547456736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c7db2bd-3c1a-44f2-b8e4-41d1c35a81bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:20:07 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-5c66aa3c-6258-4f61-a9cc-ff5c3cce7263 tempest-VolumeQuotasAdminTestJSON-547456736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c7db2bd-3c1a-44f2-b8e4-41d1c35a81bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:20:07 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-5c66aa3c-6258-4f61-a9cc-ff5c3cce7263 tempest-VolumeQuotasAdminTestJSON-547456736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7bb1ee2-ad28-45b6-9feb-8add3342eb5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:20:07 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-5c66aa3c-6258-4f61-a9cc-ff5c3cce7263 tempest-VolumeQuotasAdminTestJSON-547456736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7bb1ee2-ad28-45b6-9feb-8add3342eb5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e11e495-03bf-44ff-ba4c-3cce77748e73', 'volume_name': 'volume-0e11e495-03bf-44ff-ba4c-3cce77748e73', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:20:07 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-5c66aa3c-6258-4f61-a9cc-ff5c3cce7263 tempest-VolumeQuotasAdminTestJSON-547456736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c4c69f8-59ca-4c7d-a9d4-ec31c0d2130b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:20:07 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-5c66aa3c-6258-4f61-a9cc-ff5c3cce7263 tempest-VolumeQuotasAdminTestJSON-547456736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c4c69f8-59ca-4c7d-a9d4-ec31c0d2130b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:20:07 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-5c66aa3c-6258-4f61-a9cc-ff5c3cce7263 tempest-VolumeQuotasAdminTestJSON-547456736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8035de3a-c4a3-4d6d-8360-522534153fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:20:07 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-5c66aa3c-6258-4f61-a9cc-ff5c3cce7263 tempest-VolumeQuotasAdminTestJSON-547456736 None] Volume 0e11e495-03bf-44ff-ba4c-3cce77748e73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e11e495-03bf-44ff-ba4c-3cce77748e73', 'volume_size': 1} Sep 10 21:20:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-5c66aa3c-6258-4f61-a9cc-ff5c3cce7263 tempest-VolumeQuotasAdminTestJSON-547456736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:20:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-5c66aa3c-6258-4f61-a9cc-ff5c3cce7263 tempest-VolumeQuotasAdminTestJSON-547456736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:20:07 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-5c66aa3c-6258-4f61-a9cc-ff5c3cce7263 tempest-VolumeQuotasAdminTestJSON-547456736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:20:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2094649656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e11e495-03bf-44ff-ba4c-3cce77748e73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dee0e78882414da7a12fc05c21a9af4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:20:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:20:07Z,use_quota=True,user_id='2f9dec021f7945b5a6d68ad481375283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:20:07 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-5c66aa3c-6258-4f61-a9cc-ff5c3cce7263 tempest-VolumeQuotasAdminTestJSON-547456736 None] Creating volume 0e11e495-03bf-44ff-ba4c-3cce77748e73 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:20:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-5c66aa3c-6258-4f61-a9cc-ff5c3cce7263 tempest-VolumeQuotasAdminTestJSON-547456736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:20:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-5c66aa3c-6258-4f61-a9cc-ff5c3cce7263 tempest-VolumeQuotasAdminTestJSON-547456736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:20:07 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-5c66aa3c-6258-4f61-a9cc-ff5c3cce7263 tempest-VolumeQuotasAdminTestJSON-547456736 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:20:07 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-5c66aa3c-6258-4f61-a9cc-ff5c3cce7263 tempest-VolumeQuotasAdminTestJSON-547456736 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:20:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-5c66aa3c-6258-4f61-a9cc-ff5c3cce7263 tempest-VolumeQuotasAdminTestJSON-547456736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:20:07 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-5c66aa3c-6258-4f61-a9cc-ff5c3cce7263 tempest-VolumeQuotasAdminTestJSON-547456736 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:20:07 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-5c66aa3c-6258-4f61-a9cc-ff5c3cce7263 tempest-VolumeQuotasAdminTestJSON-547456736 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:20:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-5c66aa3c-6258-4f61-a9cc-ff5c3cce7263 tempest-VolumeQuotasAdminTestJSON-547456736 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-0e11e495-03bf-44ff-ba4c-3cce77748e73 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:20:07 devstack quobyte-client[82807]: System call of process 92695 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:20:07 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=39, name=volume-0e11e495-03bf-44ff-ba4c-3cce77748e73, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:20:08 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-5c66aa3c-6258-4f61-a9cc-ff5c3cce7263 tempest-VolumeQuotasAdminTestJSON-547456736 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-0e11e495-03bf-44ff-ba4c-3cce77748e73 1073741824" returned: 0 in 0.649s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:20:08 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-5c66aa3c-6258-4f61-a9cc-ff5c3cce7263 tempest-VolumeQuotasAdminTestJSON-547456736 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-0e11e495-03bf-44ff-ba4c-3cce77748e73 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:20:08 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-5c66aa3c-6258-4f61-a9cc-ff5c3cce7263 tempest-VolumeQuotasAdminTestJSON-547456736 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-0e11e495-03bf-44ff-ba4c-3cce77748e73" returned: 0 in 0.126s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:20:08 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-5c66aa3c-6258-4f61-a9cc-ff5c3cce7263 tempest-VolumeQuotasAdminTestJSON-547456736 None] <== create_volume: return (868ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:20:08 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-5c66aa3c-6258-4f61-a9cc-ff5c3cce7263 tempest-VolumeQuotasAdminTestJSON-547456736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:20:08 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-5c66aa3c-6258-4f61-a9cc-ff5c3cce7263 tempest-VolumeQuotasAdminTestJSON-547456736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8035de3a-c4a3-4d6d-8360-522534153fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e11e495-03bf-44ff-ba4c-3cce77748e73', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:20:08 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-5c66aa3c-6258-4f61-a9cc-ff5c3cce7263 tempest-VolumeQuotasAdminTestJSON-547456736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af49b7eb-05d9-4af1-b7a5-fd4d5fb7dcaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:20:08 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-5c66aa3c-6258-4f61-a9cc-ff5c3cce7263 tempest-VolumeQuotasAdminTestJSON-547456736 None] Volume volume-0e11e495-03bf-44ff-ba4c-3cce77748e73 (0e11e495-03bf-44ff-ba4c-3cce77748e73): created successfully Sep 10 21:20:08 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-5c66aa3c-6258-4f61-a9cc-ff5c3cce7263 tempest-VolumeQuotasAdminTestJSON-547456736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af49b7eb-05d9-4af1-b7a5-fd4d5fb7dcaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:20:08 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-5c66aa3c-6258-4f61-a9cc-ff5c3cce7263 tempest-VolumeQuotasAdminTestJSON-547456736 None] Flow 'volume_create_manager' (e9ae65e4-8fa1-4ba1-b0b7-e80d14d6d88e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:20:08 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-5c66aa3c-6258-4f61-a9cc-ff5c3cce7263 tempest-VolumeQuotasAdminTestJSON-547456736 None] Created volume successfully. Sep 10 21:20:09 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-955eb02a-74db-4de7-aa9f-a3c7eb483e57 tempest-VolumeQuotasAdminTestJSON-547456736 None] Acquiring lock "cinder-0e11e495-03bf-44ff-ba4c-3cce77748e73-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:20:09 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-955eb02a-74db-4de7-aa9f-a3c7eb483e57 tempest-VolumeQuotasAdminTestJSON-547456736 None] Lock "cinder-0e11e495-03bf-44ff-ba4c-3cce77748e73-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:20:09 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-955eb02a-74db-4de7-aa9f-a3c7eb483e57 tempest-VolumeQuotasAdminTestJSON-547456736 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:20:09 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-955eb02a-74db-4de7-aa9f-a3c7eb483e57 tempest-VolumeQuotasAdminTestJSON-547456736 None] Acquiring lock "cinder-quobyte-0e11e495-03bf-44ff-ba4c-3cce77748e73" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:20:09 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-955eb02a-74db-4de7-aa9f-a3c7eb483e57 tempest-VolumeQuotasAdminTestJSON-547456736 None] Lock "cinder-quobyte-0e11e495-03bf-44ff-ba4c-3cce77748e73" acquired by "delete_volume" :: waited 0.021s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:20:09 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[630b962b-3592-42ab-ac45-da8746921ef4]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:20:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-955eb02a-74db-4de7-aa9f-a3c7eb483e57 tempest-VolumeQuotasAdminTestJSON-547456736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-0e11e495-03bf-44ff-ba4c-3cce77748e73 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:20:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-955eb02a-74db-4de7-aa9f-a3c7eb483e57 tempest-VolumeQuotasAdminTestJSON-547456736 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-0e11e495-03bf-44ff-ba4c-3cce77748e73" returned: 0 in 0.582s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:20:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-955eb02a-74db-4de7-aa9f-a3c7eb483e57 tempest-VolumeQuotasAdminTestJSON-547456736 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-0e11e495-03bf-44ff-ba4c-3cce77748e73 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:20:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-955eb02a-74db-4de7-aa9f-a3c7eb483e57 tempest-VolumeQuotasAdminTestJSON-547456736 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-0e11e495-03bf-44ff-ba4c-3cce77748e73" returned: 0 in 0.093s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:20:10 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-955eb02a-74db-4de7-aa9f-a3c7eb483e57 tempest-VolumeQuotasAdminTestJSON-547456736 None] Lock "cinder-quobyte-0e11e495-03bf-44ff-ba4c-3cce77748e73" released by "delete_volume" :: held 0.845s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:20:11 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-955eb02a-74db-4de7-aa9f-a3c7eb483e57 tempest-VolumeQuotasAdminTestJSON-547456736 None] Created reservations ['e62ecf86-ecf4-4a70-bc8b-1ab2bbbf479c', '0e422109-cbbd-4b46-ae74-9b546785a793', '49d90300-0538-4952-a566-54fea917448e', '4b932c6c-dcf8-48c3-be65-36d692b03844'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:20:11 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-955eb02a-74db-4de7-aa9f-a3c7eb483e57 tempest-VolumeQuotasAdminTestJSON-547456736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:20:11 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-955eb02a-74db-4de7-aa9f-a3c7eb483e57 tempest-VolumeQuotasAdminTestJSON-547456736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:20:11 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-955eb02a-74db-4de7-aa9f-a3c7eb483e57 tempest-VolumeQuotasAdminTestJSON-547456736 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:20:11 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-955eb02a-74db-4de7-aa9f-a3c7eb483e57 tempest-VolumeQuotasAdminTestJSON-547456736 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:20:11 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-955eb02a-74db-4de7-aa9f-a3c7eb483e57 tempest-VolumeQuotasAdminTestJSON-547456736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:20:11 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-955eb02a-74db-4de7-aa9f-a3c7eb483e57 tempest-VolumeQuotasAdminTestJSON-547456736 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:20:11 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-955eb02a-74db-4de7-aa9f-a3c7eb483e57 tempest-VolumeQuotasAdminTestJSON-547456736 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.106s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:20:11 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-955eb02a-74db-4de7-aa9f-a3c7eb483e57 tempest-VolumeQuotasAdminTestJSON-547456736 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:20:11 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-955eb02a-74db-4de7-aa9f-a3c7eb483e57 tempest-VolumeQuotasAdminTestJSON-547456736 None] Deleted volume successfully. Sep 10 21:20:11 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-955eb02a-74db-4de7-aa9f-a3c7eb483e57 tempest-VolumeQuotasAdminTestJSON-547456736 None] Lock "cinder-0e11e495-03bf-44ff-ba4c-3cce77748e73-delete_volume" released by "delete_volume" :: held 2.159s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:20:12 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-a662000d-1423-4517-836f-9783715ffa4a tempest-VolumeQuotasAdminTestJSON-547456736 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:20:12 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-a662000d-1423-4517-836f-9783715ffa4a tempest-VolumeQuotasAdminTestJSON-547456736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:20:12 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-a662000d-1423-4517-836f-9783715ffa4a tempest-VolumeQuotasAdminTestJSON-547456736 None] Flow 'volume_create_manager' (937e59cd-1af6-49aa-bb06-00fc502a77f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:20:12 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-a662000d-1423-4517-836f-9783715ffa4a tempest-VolumeQuotasAdminTestJSON-547456736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee53938a-63fa-48bd-9851-afe28c819994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:20:12 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-a662000d-1423-4517-836f-9783715ffa4a tempest-VolumeQuotasAdminTestJSON-547456736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee53938a-63fa-48bd-9851-afe28c819994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-25750785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce5311f3-d310-45c8-8d8d-736f8fc306d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dee0e78882414da7a12fc05c21a9af4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:20:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:20:12Z,use_quota=True,user_id='2f9dec021f7945b5a6d68ad481375283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:20:12 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-a662000d-1423-4517-836f-9783715ffa4a tempest-VolumeQuotasAdminTestJSON-547456736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb52d05b-f4ed-431a-9d78-4d1a5cb602b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:20:12 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-a662000d-1423-4517-836f-9783715ffa4a tempest-VolumeQuotasAdminTestJSON-547456736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb52d05b-f4ed-431a-9d78-4d1a5cb602b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:20:12 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-a662000d-1423-4517-836f-9783715ffa4a tempest-VolumeQuotasAdminTestJSON-547456736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5c7c986-b1e9-4888-84cc-3a2864907f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:20:12 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-a662000d-1423-4517-836f-9783715ffa4a tempest-VolumeQuotasAdminTestJSON-547456736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5c7c986-b1e9-4888-84cc-3a2864907f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce5311f3-d310-45c8-8d8d-736f8fc306d9', 'volume_name': 'volume-ce5311f3-d310-45c8-8d8d-736f8fc306d9', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:20:12 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-a662000d-1423-4517-836f-9783715ffa4a tempest-VolumeQuotasAdminTestJSON-547456736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a35c6e0-db93-42fc-bf3e-7e4c73bf96c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:20:12 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-a662000d-1423-4517-836f-9783715ffa4a tempest-VolumeQuotasAdminTestJSON-547456736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a35c6e0-db93-42fc-bf3e-7e4c73bf96c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:20:12 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-a662000d-1423-4517-836f-9783715ffa4a tempest-VolumeQuotasAdminTestJSON-547456736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04e8c735-7922-4e33-b0cf-e0ff5a8aafff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:20:12 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-a662000d-1423-4517-836f-9783715ffa4a tempest-VolumeQuotasAdminTestJSON-547456736 None] Volume ce5311f3-d310-45c8-8d8d-736f8fc306d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce5311f3-d310-45c8-8d8d-736f8fc306d9', 'volume_size': 1} Sep 10 21:20:12 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a662000d-1423-4517-836f-9783715ffa4a tempest-VolumeQuotasAdminTestJSON-547456736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:20:12 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a662000d-1423-4517-836f-9783715ffa4a tempest-VolumeQuotasAdminTestJSON-547456736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:20:12 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a662000d-1423-4517-836f-9783715ffa4a tempest-VolumeQuotasAdminTestJSON-547456736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-25750785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce5311f3-d310-45c8-8d8d-736f8fc306d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dee0e78882414da7a12fc05c21a9af4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:20:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:20:12Z,use_quota=True,user_id='2f9dec021f7945b5a6d68ad481375283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:20:12 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-a662000d-1423-4517-836f-9783715ffa4a tempest-VolumeQuotasAdminTestJSON-547456736 None] Creating volume ce5311f3-d310-45c8-8d8d-736f8fc306d9 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:20:12 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a662000d-1423-4517-836f-9783715ffa4a tempest-VolumeQuotasAdminTestJSON-547456736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:20:12 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a662000d-1423-4517-836f-9783715ffa4a tempest-VolumeQuotasAdminTestJSON-547456736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:20:12 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a662000d-1423-4517-836f-9783715ffa4a tempest-VolumeQuotasAdminTestJSON-547456736 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:20:12 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a662000d-1423-4517-836f-9783715ffa4a tempest-VolumeQuotasAdminTestJSON-547456736 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:20:12 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a662000d-1423-4517-836f-9783715ffa4a tempest-VolumeQuotasAdminTestJSON-547456736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:20:12 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a662000d-1423-4517-836f-9783715ffa4a tempest-VolumeQuotasAdminTestJSON-547456736 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:20:12 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-a662000d-1423-4517-836f-9783715ffa4a tempest-VolumeQuotasAdminTestJSON-547456736 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:20:12 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a662000d-1423-4517-836f-9783715ffa4a tempest-VolumeQuotasAdminTestJSON-547456736 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ce5311f3-d310-45c8-8d8d-736f8fc306d9 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:20:12 devstack quobyte-client[82807]: System call of process 92705 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:20:12 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=40, name=volume-ce5311f3-d310-45c8-8d8d-736f8fc306d9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:20:13 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a662000d-1423-4517-836f-9783715ffa4a tempest-VolumeQuotasAdminTestJSON-547456736 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ce5311f3-d310-45c8-8d8d-736f8fc306d9 1073741824" returned: 0 in 0.365s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:20:13 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a662000d-1423-4517-836f-9783715ffa4a tempest-VolumeQuotasAdminTestJSON-547456736 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ce5311f3-d310-45c8-8d8d-736f8fc306d9 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:20:13 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a662000d-1423-4517-836f-9783715ffa4a tempest-VolumeQuotasAdminTestJSON-547456736 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ce5311f3-d310-45c8-8d8d-736f8fc306d9" returned: 0 in 0.088s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:20:13 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a662000d-1423-4517-836f-9783715ffa4a tempest-VolumeQuotasAdminTestJSON-547456736 None] <== create_volume: return (545ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:20:13 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a662000d-1423-4517-836f-9783715ffa4a tempest-VolumeQuotasAdminTestJSON-547456736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.557s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:20:13 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-a662000d-1423-4517-836f-9783715ffa4a tempest-VolumeQuotasAdminTestJSON-547456736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04e8c735-7922-4e33-b0cf-e0ff5a8aafff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce5311f3-d310-45c8-8d8d-736f8fc306d9', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:20:13 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-a662000d-1423-4517-836f-9783715ffa4a tempest-VolumeQuotasAdminTestJSON-547456736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (163adc3d-e8ba-47d8-98a2-67c83970b17f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:20:13 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-a662000d-1423-4517-836f-9783715ffa4a tempest-VolumeQuotasAdminTestJSON-547456736 None] Volume volume-ce5311f3-d310-45c8-8d8d-736f8fc306d9 (ce5311f3-d310-45c8-8d8d-736f8fc306d9): created successfully Sep 10 21:20:13 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-a662000d-1423-4517-836f-9783715ffa4a tempest-VolumeQuotasAdminTestJSON-547456736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (163adc3d-e8ba-47d8-98a2-67c83970b17f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:20:13 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-a662000d-1423-4517-836f-9783715ffa4a tempest-VolumeQuotasAdminTestJSON-547456736 None] Flow 'volume_create_manager' (937e59cd-1af6-49aa-bb06-00fc502a77f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:20:13 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-a662000d-1423-4517-836f-9783715ffa4a tempest-VolumeQuotasAdminTestJSON-547456736 None] Created volume successfully. Sep 10 21:20:15 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-489ee8d2-7a9d-4c41-8aa2-3a047c67b511 tempest-VolumeQuotasAdminTestJSON-1933337580 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:20:15 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-489ee8d2-7a9d-4c41-8aa2-3a047c67b511 tempest-VolumeQuotasAdminTestJSON-1933337580 None] Transfer volume completed successfully. Sep 10 21:20:16 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-f31c3bd0-eedc-4548-b902-5ac7f92c1b64 tempest-VolumeQuotasAdminTestJSON-1567029428 None] Acquiring lock "cinder-ce5311f3-d310-45c8-8d8d-736f8fc306d9-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:20:17 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-f31c3bd0-eedc-4548-b902-5ac7f92c1b64 tempest-VolumeQuotasAdminTestJSON-1567029428 None] Lock "cinder-ce5311f3-d310-45c8-8d8d-736f8fc306d9-delete_volume" acquired by "delete_volume" :: waited 0.099s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:20:17 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-f31c3bd0-eedc-4548-b902-5ac7f92c1b64 tempest-VolumeQuotasAdminTestJSON-1567029428 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:20:17 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-f31c3bd0-eedc-4548-b902-5ac7f92c1b64 tempest-VolumeQuotasAdminTestJSON-1567029428 None] Acquiring lock "cinder-quobyte-ce5311f3-d310-45c8-8d8d-736f8fc306d9" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:20:17 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-f31c3bd0-eedc-4548-b902-5ac7f92c1b64 tempest-VolumeQuotasAdminTestJSON-1567029428 None] Lock "cinder-quobyte-ce5311f3-d310-45c8-8d8d-736f8fc306d9" acquired by "delete_volume" :: waited 0.028s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:20:17 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7deb2bd-bb45-4e5a-aa0a-b929a0814d18]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:20:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f31c3bd0-eedc-4548-b902-5ac7f92c1b64 tempest-VolumeQuotasAdminTestJSON-1567029428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ce5311f3-d310-45c8-8d8d-736f8fc306d9 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:20:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f31c3bd0-eedc-4548-b902-5ac7f92c1b64 tempest-VolumeQuotasAdminTestJSON-1567029428 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ce5311f3-d310-45c8-8d8d-736f8fc306d9" returned: 0 in 0.531s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:20:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f31c3bd0-eedc-4548-b902-5ac7f92c1b64 tempest-VolumeQuotasAdminTestJSON-1567029428 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ce5311f3-d310-45c8-8d8d-736f8fc306d9 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:20:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f31c3bd0-eedc-4548-b902-5ac7f92c1b64 tempest-VolumeQuotasAdminTestJSON-1567029428 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ce5311f3-d310-45c8-8d8d-736f8fc306d9" returned: 0 in 0.130s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:20:18 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-f31c3bd0-eedc-4548-b902-5ac7f92c1b64 tempest-VolumeQuotasAdminTestJSON-1567029428 None] Lock "cinder-quobyte-ce5311f3-d310-45c8-8d8d-736f8fc306d9" released by "delete_volume" :: held 0.869s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:20:18 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-f31c3bd0-eedc-4548-b902-5ac7f92c1b64 tempest-VolumeQuotasAdminTestJSON-1567029428 None] Created reservations ['4ae1fb2d-7b73-4a0d-a4e0-0e11f843790d', 'c2585006-cc22-4c41-a1e3-984700a95a1f', 'a2abed8a-e49b-4eb8-ab75-bf4926d1af5b', 'af3d78b2-6d48-4401-9d12-b5a8ebadf281'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:20:18 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-f31c3bd0-eedc-4548-b902-5ac7f92c1b64 tempest-VolumeQuotasAdminTestJSON-1567029428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:20:18 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-f31c3bd0-eedc-4548-b902-5ac7f92c1b64 tempest-VolumeQuotasAdminTestJSON-1567029428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:20:18 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-f31c3bd0-eedc-4548-b902-5ac7f92c1b64 tempest-VolumeQuotasAdminTestJSON-1567029428 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:20:18 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-f31c3bd0-eedc-4548-b902-5ac7f92c1b64 tempest-VolumeQuotasAdminTestJSON-1567029428 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:20:18 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-f31c3bd0-eedc-4548-b902-5ac7f92c1b64 tempest-VolumeQuotasAdminTestJSON-1567029428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:20:18 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f31c3bd0-eedc-4548-b902-5ac7f92c1b64 tempest-VolumeQuotasAdminTestJSON-1567029428 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:20:18 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f31c3bd0-eedc-4548-b902-5ac7f92c1b64 tempest-VolumeQuotasAdminTestJSON-1567029428 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.123s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:20:18 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-f31c3bd0-eedc-4548-b902-5ac7f92c1b64 tempest-VolumeQuotasAdminTestJSON-1567029428 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:20:18 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-f31c3bd0-eedc-4548-b902-5ac7f92c1b64 tempest-VolumeQuotasAdminTestJSON-1567029428 None] Deleted volume successfully. Sep 10 21:20:19 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-f31c3bd0-eedc-4548-b902-5ac7f92c1b64 tempest-VolumeQuotasAdminTestJSON-1567029428 None] Lock "cinder-ce5311f3-d310-45c8-8d8d-736f8fc306d9-delete_volume" released by "delete_volume" :: held 2.043s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:20:28 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:UPDATE=25,cinder:SELECT=15,cinder:INSERT=2,cinder:DELETE=2 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:20:29 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=10,cinder:UPDATE=15,cinder:DELETE=2,cinder:INSERT=6 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:20:34 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-1abacb18-3171-4718-9532-46546926b7e3 tempest-VolumeQuotasNegativeTestJSON-670942213 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:20:34 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-1abacb18-3171-4718-9532-46546926b7e3 tempest-VolumeQuotasNegativeTestJSON-670942213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:20:34 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1abacb18-3171-4718-9532-46546926b7e3 tempest-VolumeQuotasNegativeTestJSON-670942213 None] Flow 'volume_create_manager' (ea465dd6-e269-4dac-9928-aea42a9e27f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:20:34 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1abacb18-3171-4718-9532-46546926b7e3 tempest-VolumeQuotasNegativeTestJSON-670942213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d185b158-343d-4bfe-ac51-acd43fd4a176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:20:34 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1abacb18-3171-4718-9532-46546926b7e3 tempest-VolumeQuotasNegativeTestJSON-670942213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d185b158-343d-4bfe-ac51-acd43fd4a176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1705793570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84251bd5-1044-466f-99bb-99cd1f1a3ec7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4202f899be4e4b87ac19a610985d480e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:20:34Z,use_quota=True,user_id='1369bc48a0984adda8283a38ad90fbb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:20:34 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1abacb18-3171-4718-9532-46546926b7e3 tempest-VolumeQuotasNegativeTestJSON-670942213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18e327c1-fbf2-4cf4-bf2b-673b65df39d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:20:34 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1abacb18-3171-4718-9532-46546926b7e3 tempest-VolumeQuotasNegativeTestJSON-670942213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18e327c1-fbf2-4cf4-bf2b-673b65df39d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:20:34 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1abacb18-3171-4718-9532-46546926b7e3 tempest-VolumeQuotasNegativeTestJSON-670942213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f548b6d-8bf7-46b9-8154-0a599b7fd809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:20:34 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1abacb18-3171-4718-9532-46546926b7e3 tempest-VolumeQuotasNegativeTestJSON-670942213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f548b6d-8bf7-46b9-8154-0a599b7fd809) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84251bd5-1044-466f-99bb-99cd1f1a3ec7', 'volume_name': 'volume-84251bd5-1044-466f-99bb-99cd1f1a3ec7', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:20:34 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1abacb18-3171-4718-9532-46546926b7e3 tempest-VolumeQuotasNegativeTestJSON-670942213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c24c23fd-b4a1-4fa0-a47c-d65dc02539c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:20:34 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1abacb18-3171-4718-9532-46546926b7e3 tempest-VolumeQuotasNegativeTestJSON-670942213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c24c23fd-b4a1-4fa0-a47c-d65dc02539c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:20:34 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1abacb18-3171-4718-9532-46546926b7e3 tempest-VolumeQuotasNegativeTestJSON-670942213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (276fdbe8-1413-4634-9512-8c644c9dca05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:20:34 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-1abacb18-3171-4718-9532-46546926b7e3 tempest-VolumeQuotasNegativeTestJSON-670942213 None] Volume 84251bd5-1044-466f-99bb-99cd1f1a3ec7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84251bd5-1044-466f-99bb-99cd1f1a3ec7', 'volume_size': 1} Sep 10 21:20:34 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-1abacb18-3171-4718-9532-46546926b7e3 tempest-VolumeQuotasNegativeTestJSON-670942213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:20:34 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-1abacb18-3171-4718-9532-46546926b7e3 tempest-VolumeQuotasNegativeTestJSON-670942213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:20:34 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-1abacb18-3171-4718-9532-46546926b7e3 tempest-VolumeQuotasNegativeTestJSON-670942213 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1705793570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84251bd5-1044-466f-99bb-99cd1f1a3ec7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4202f899be4e4b87ac19a610985d480e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:20:34Z,use_quota=True,user_id='1369bc48a0984adda8283a38ad90fbb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:20:34 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-1abacb18-3171-4718-9532-46546926b7e3 tempest-VolumeQuotasNegativeTestJSON-670942213 None] Creating volume 84251bd5-1044-466f-99bb-99cd1f1a3ec7 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:20:34 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-1abacb18-3171-4718-9532-46546926b7e3 tempest-VolumeQuotasNegativeTestJSON-670942213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:20:34 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-1abacb18-3171-4718-9532-46546926b7e3 tempest-VolumeQuotasNegativeTestJSON-670942213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:20:34 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-1abacb18-3171-4718-9532-46546926b7e3 tempest-VolumeQuotasNegativeTestJSON-670942213 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:20:34 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-1abacb18-3171-4718-9532-46546926b7e3 tempest-VolumeQuotasNegativeTestJSON-670942213 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:20:34 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-1abacb18-3171-4718-9532-46546926b7e3 tempest-VolumeQuotasNegativeTestJSON-670942213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:20:34 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-1abacb18-3171-4718-9532-46546926b7e3 tempest-VolumeQuotasNegativeTestJSON-670942213 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:20:34 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-1abacb18-3171-4718-9532-46546926b7e3 tempest-VolumeQuotasNegativeTestJSON-670942213 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:20:34 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1abacb18-3171-4718-9532-46546926b7e3 tempest-VolumeQuotasNegativeTestJSON-670942213 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-84251bd5-1044-466f-99bb-99cd1f1a3ec7 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:20:34 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=41, name=volume-84251bd5-1044-466f-99bb-99cd1f1a3ec7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:20:35 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1abacb18-3171-4718-9532-46546926b7e3 tempest-VolumeQuotasNegativeTestJSON-670942213 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-84251bd5-1044-466f-99bb-99cd1f1a3ec7 1073741824" returned: 0 in 0.668s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:20:35 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1abacb18-3171-4718-9532-46546926b7e3 tempest-VolumeQuotasNegativeTestJSON-670942213 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-84251bd5-1044-466f-99bb-99cd1f1a3ec7 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:20:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1abacb18-3171-4718-9532-46546926b7e3 tempest-VolumeQuotasNegativeTestJSON-670942213 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-84251bd5-1044-466f-99bb-99cd1f1a3ec7" returned: 0 in 0.602s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:20:36 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-1abacb18-3171-4718-9532-46546926b7e3 tempest-VolumeQuotasNegativeTestJSON-670942213 None] <== create_volume: return (1570ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:20:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-1abacb18-3171-4718-9532-46546926b7e3 tempest-VolumeQuotasNegativeTestJSON-670942213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.604s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:20:36 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1abacb18-3171-4718-9532-46546926b7e3 tempest-VolumeQuotasNegativeTestJSON-670942213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (276fdbe8-1413-4634-9512-8c644c9dca05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84251bd5-1044-466f-99bb-99cd1f1a3ec7', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:20:36 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1abacb18-3171-4718-9532-46546926b7e3 tempest-VolumeQuotasNegativeTestJSON-670942213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6247a7f-e395-42ee-99b1-1f7e64df095a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:20:36 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-1abacb18-3171-4718-9532-46546926b7e3 tempest-VolumeQuotasNegativeTestJSON-670942213 None] Volume volume-84251bd5-1044-466f-99bb-99cd1f1a3ec7 (84251bd5-1044-466f-99bb-99cd1f1a3ec7): created successfully Sep 10 21:20:36 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1abacb18-3171-4718-9532-46546926b7e3 tempest-VolumeQuotasNegativeTestJSON-670942213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6247a7f-e395-42ee-99b1-1f7e64df095a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:20:36 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1abacb18-3171-4718-9532-46546926b7e3 tempest-VolumeQuotasNegativeTestJSON-670942213 None] Flow 'volume_create_manager' (ea465dd6-e269-4dac-9928-aea42a9e27f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:20:37 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-1abacb18-3171-4718-9532-46546926b7e3 tempest-VolumeQuotasNegativeTestJSON-670942213 None] Created volume successfully. Sep 10 21:20:40 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-9373d225-cfef-4640-bb30-96c1c44108e7 tempest-VolumeQuotasNegativeTestJSON-670942213 None] Acquiring lock "cinder-84251bd5-1044-466f-99bb-99cd1f1a3ec7-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:20:40 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-9373d225-cfef-4640-bb30-96c1c44108e7 tempest-VolumeQuotasNegativeTestJSON-670942213 None] Lock "cinder-84251bd5-1044-466f-99bb-99cd1f1a3ec7-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:20:41 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-9373d225-cfef-4640-bb30-96c1c44108e7 tempest-VolumeQuotasNegativeTestJSON-670942213 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:20:41 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-9373d225-cfef-4640-bb30-96c1c44108e7 tempest-VolumeQuotasNegativeTestJSON-670942213 None] Acquiring lock "cinder-quobyte-84251bd5-1044-466f-99bb-99cd1f1a3ec7" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:20:41 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-9373d225-cfef-4640-bb30-96c1c44108e7 tempest-VolumeQuotasNegativeTestJSON-670942213 None] Lock "cinder-quobyte-84251bd5-1044-466f-99bb-99cd1f1a3ec7" acquired by "delete_volume" :: waited 0.023s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:20:41 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[84bf71e1-4e0a-4758-84a6-45210f1a1625]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:20:41 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9373d225-cfef-4640-bb30-96c1c44108e7 tempest-VolumeQuotasNegativeTestJSON-670942213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-84251bd5-1044-466f-99bb-99cd1f1a3ec7 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:20:41 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9373d225-cfef-4640-bb30-96c1c44108e7 tempest-VolumeQuotasNegativeTestJSON-670942213 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-84251bd5-1044-466f-99bb-99cd1f1a3ec7" returned: 0 in 0.604s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:20:41 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9373d225-cfef-4640-bb30-96c1c44108e7 tempest-VolumeQuotasNegativeTestJSON-670942213 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-84251bd5-1044-466f-99bb-99cd1f1a3ec7 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:20:42 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9373d225-cfef-4640-bb30-96c1c44108e7 tempest-VolumeQuotasNegativeTestJSON-670942213 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-84251bd5-1044-466f-99bb-99cd1f1a3ec7" returned: 0 in 0.280s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:20:42 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-9373d225-cfef-4640-bb30-96c1c44108e7 tempest-VolumeQuotasNegativeTestJSON-670942213 None] Lock "cinder-quobyte-84251bd5-1044-466f-99bb-99cd1f1a3ec7" released by "delete_volume" :: held 1.109s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:20:42 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-9373d225-cfef-4640-bb30-96c1c44108e7 tempest-VolumeQuotasNegativeTestJSON-670942213 None] Created reservations ['1ee06b0f-d00e-4769-b5e2-c9547c35c5f2', 'ddd9b2a0-ee2c-44fd-bd73-3d12feac0772', '12e9e7c0-4122-42ea-a265-679a1164dad4', '4de29098-9db1-45cb-95f8-1a814c124811'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:20:43 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-9373d225-cfef-4640-bb30-96c1c44108e7 tempest-VolumeQuotasNegativeTestJSON-670942213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:20:43 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-9373d225-cfef-4640-bb30-96c1c44108e7 tempest-VolumeQuotasNegativeTestJSON-670942213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:20:43 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-9373d225-cfef-4640-bb30-96c1c44108e7 tempest-VolumeQuotasNegativeTestJSON-670942213 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:20:43 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-9373d225-cfef-4640-bb30-96c1c44108e7 tempest-VolumeQuotasNegativeTestJSON-670942213 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:20:43 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-9373d225-cfef-4640-bb30-96c1c44108e7 tempest-VolumeQuotasNegativeTestJSON-670942213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:20:43 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9373d225-cfef-4640-bb30-96c1c44108e7 tempest-VolumeQuotasNegativeTestJSON-670942213 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:20:43 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9373d225-cfef-4640-bb30-96c1c44108e7 tempest-VolumeQuotasNegativeTestJSON-670942213 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.191s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:20:43 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-9373d225-cfef-4640-bb30-96c1c44108e7 tempest-VolumeQuotasNegativeTestJSON-670942213 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:20:43 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-9373d225-cfef-4640-bb30-96c1c44108e7 tempest-VolumeQuotasNegativeTestJSON-670942213 None] Deleted volume successfully. Sep 10 21:20:43 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-9373d225-cfef-4640-bb30-96c1c44108e7 tempest-VolumeQuotasNegativeTestJSON-670942213 None] Lock "cinder-84251bd5-1044-466f-99bb-99cd1f1a3ec7-delete_volume" released by "delete_volume" :: held 3.044s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:20:53 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:UPDATE=17,cinder:DELETE=1,cinder:SELECT=6,cinder:INSERT=2 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:20:53 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3,cinder:INSERT=2,cinder:DELETE=1 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:20:56 devstack cinder-volume[82780]: DEBUG oslo_service.periodic_task [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82780) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 21:20:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:20:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:20:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:20:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:20:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:20:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:20:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.275s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:20:57 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:20:58 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-64245ae3-98fc-4884-ae2d-36c75a12faf6 tempest-VolumesServicesTestJSON-1482467710 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:20:58 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-64245ae3-98fc-4884-ae2d-36c75a12faf6 tempest-VolumesServicesTestJSON-1482467710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:20:58 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-64245ae3-98fc-4884-ae2d-36c75a12faf6 tempest-VolumesServicesTestJSON-1482467710 None] Flow 'volume_create_manager' (d0b3cb24-5f93-4de1-83cf-8739f065d710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:20:58 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-64245ae3-98fc-4884-ae2d-36c75a12faf6 tempest-VolumesServicesTestJSON-1482467710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aa9d5dd-83e2-4367-919c-4d4a2e0c4f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:20:58 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-64245ae3-98fc-4884-ae2d-36c75a12faf6 tempest-VolumesServicesTestJSON-1482467710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aa9d5dd-83e2-4367-919c-4d4a2e0c4f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:20:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1823006471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f68af7a-f423-4fdc-a461-b22c2a799627,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='863774f74d194f2b80fa75966aecf4cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:20:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:20:58Z,use_quota=True,user_id='60ee9ae851354f32af36c2dd728bb94f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:20:58 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-64245ae3-98fc-4884-ae2d-36c75a12faf6 tempest-VolumesServicesTestJSON-1482467710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b1f0435-cee0-4dca-a411-d69383ef36ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:20:58 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-64245ae3-98fc-4884-ae2d-36c75a12faf6 tempest-VolumesServicesTestJSON-1482467710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b1f0435-cee0-4dca-a411-d69383ef36ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:20:58 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-64245ae3-98fc-4884-ae2d-36c75a12faf6 tempest-VolumesServicesTestJSON-1482467710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec799844-ae65-4306-995f-cd8ed4a96e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:20:58 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-64245ae3-98fc-4884-ae2d-36c75a12faf6 tempest-VolumesServicesTestJSON-1482467710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec799844-ae65-4306-995f-cd8ed4a96e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f68af7a-f423-4fdc-a461-b22c2a799627', 'volume_name': 'volume-9f68af7a-f423-4fdc-a461-b22c2a799627', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:20:58 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-64245ae3-98fc-4884-ae2d-36c75a12faf6 tempest-VolumesServicesTestJSON-1482467710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daf88bac-6f25-4f4a-a3d8-8837212e4201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:20:58 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-64245ae3-98fc-4884-ae2d-36c75a12faf6 tempest-VolumesServicesTestJSON-1482467710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daf88bac-6f25-4f4a-a3d8-8837212e4201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:20:58 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-64245ae3-98fc-4884-ae2d-36c75a12faf6 tempest-VolumesServicesTestJSON-1482467710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93187179-1b69-43cb-ae1e-d30c27c61da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:20:58 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-64245ae3-98fc-4884-ae2d-36c75a12faf6 tempest-VolumesServicesTestJSON-1482467710 None] Volume 9f68af7a-f423-4fdc-a461-b22c2a799627: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f68af7a-f423-4fdc-a461-b22c2a799627', 'volume_size': 1} Sep 10 21:20:58 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-64245ae3-98fc-4884-ae2d-36c75a12faf6 tempest-VolumesServicesTestJSON-1482467710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:20:58 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-64245ae3-98fc-4884-ae2d-36c75a12faf6 tempest-VolumesServicesTestJSON-1482467710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:20:58 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-64245ae3-98fc-4884-ae2d-36c75a12faf6 tempest-VolumesServicesTestJSON-1482467710 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:20:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1823006471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f68af7a-f423-4fdc-a461-b22c2a799627,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='863774f74d194f2b80fa75966aecf4cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:20:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:20:58Z,use_quota=True,user_id='60ee9ae851354f32af36c2dd728bb94f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:20:58 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-64245ae3-98fc-4884-ae2d-36c75a12faf6 tempest-VolumesServicesTestJSON-1482467710 None] Creating volume 9f68af7a-f423-4fdc-a461-b22c2a799627 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:20:58 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-64245ae3-98fc-4884-ae2d-36c75a12faf6 tempest-VolumesServicesTestJSON-1482467710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:20:58 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-64245ae3-98fc-4884-ae2d-36c75a12faf6 tempest-VolumesServicesTestJSON-1482467710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:20:58 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-64245ae3-98fc-4884-ae2d-36c75a12faf6 tempest-VolumesServicesTestJSON-1482467710 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:20:58 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-64245ae3-98fc-4884-ae2d-36c75a12faf6 tempest-VolumesServicesTestJSON-1482467710 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:20:58 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-64245ae3-98fc-4884-ae2d-36c75a12faf6 tempest-VolumesServicesTestJSON-1482467710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:20:58 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-64245ae3-98fc-4884-ae2d-36c75a12faf6 tempest-VolumesServicesTestJSON-1482467710 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:20:58 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-64245ae3-98fc-4884-ae2d-36c75a12faf6 tempest-VolumesServicesTestJSON-1482467710 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:20:58 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-64245ae3-98fc-4884-ae2d-36c75a12faf6 tempest-VolumesServicesTestJSON-1482467710 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-9f68af7a-f423-4fdc-a461-b22c2a799627 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:20:58 devstack quobyte-client[82807]: System call of process 92991 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:20:58 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=42, name=volume-9f68af7a-f423-4fdc-a461-b22c2a799627, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:20:58 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-64245ae3-98fc-4884-ae2d-36c75a12faf6 tempest-VolumesServicesTestJSON-1482467710 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-9f68af7a-f423-4fdc-a461-b22c2a799627 1073741824" returned: 0 in 0.498s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:20:58 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-64245ae3-98fc-4884-ae2d-36c75a12faf6 tempest-VolumesServicesTestJSON-1482467710 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-9f68af7a-f423-4fdc-a461-b22c2a799627 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:20:58 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-64245ae3-98fc-4884-ae2d-36c75a12faf6 tempest-VolumesServicesTestJSON-1482467710 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-9f68af7a-f423-4fdc-a461-b22c2a799627" returned: 0 in 0.125s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:20:59 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-64245ae3-98fc-4884-ae2d-36c75a12faf6 tempest-VolumesServicesTestJSON-1482467710 None] <== create_volume: return (764ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:20:59 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-64245ae3-98fc-4884-ae2d-36c75a12faf6 tempest-VolumesServicesTestJSON-1482467710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:20:59 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-64245ae3-98fc-4884-ae2d-36c75a12faf6 tempest-VolumesServicesTestJSON-1482467710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93187179-1b69-43cb-ae1e-d30c27c61da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f68af7a-f423-4fdc-a461-b22c2a799627', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:20:59 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-64245ae3-98fc-4884-ae2d-36c75a12faf6 tempest-VolumesServicesTestJSON-1482467710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (209ce939-d1c2-465b-be3b-79593dd79eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:20:59 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-64245ae3-98fc-4884-ae2d-36c75a12faf6 tempest-VolumesServicesTestJSON-1482467710 None] Volume volume-9f68af7a-f423-4fdc-a461-b22c2a799627 (9f68af7a-f423-4fdc-a461-b22c2a799627): created successfully Sep 10 21:20:59 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-64245ae3-98fc-4884-ae2d-36c75a12faf6 tempest-VolumesServicesTestJSON-1482467710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (209ce939-d1c2-465b-be3b-79593dd79eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:20:59 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-64245ae3-98fc-4884-ae2d-36c75a12faf6 tempest-VolumesServicesTestJSON-1482467710 None] Flow 'volume_create_manager' (d0b3cb24-5f93-4de1-83cf-8739f065d710) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:20:59 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-64245ae3-98fc-4884-ae2d-36c75a12faf6 tempest-VolumesServicesTestJSON-1482467710 None] Created volume successfully. Sep 10 21:21:00 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-cd37d5cd-78c1-4692-a6d9-261dc759064b tempest-VolumesServicesTestJSON-1482467710 None] Acquiring lock "cinder-9f68af7a-f423-4fdc-a461-b22c2a799627-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:21:00 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-cd37d5cd-78c1-4692-a6d9-261dc759064b tempest-VolumesServicesTestJSON-1482467710 None] Lock "cinder-9f68af7a-f423-4fdc-a461-b22c2a799627-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:21:00 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-cd37d5cd-78c1-4692-a6d9-261dc759064b tempest-VolumesServicesTestJSON-1482467710 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:21:00 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-cd37d5cd-78c1-4692-a6d9-261dc759064b tempest-VolumesServicesTestJSON-1482467710 None] Acquiring lock "cinder-quobyte-9f68af7a-f423-4fdc-a461-b22c2a799627" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:21:00 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-cd37d5cd-78c1-4692-a6d9-261dc759064b tempest-VolumesServicesTestJSON-1482467710 None] Lock "cinder-quobyte-9f68af7a-f423-4fdc-a461-b22c2a799627" acquired by "delete_volume" :: waited 0.022s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:21:00 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b61a92-433e-4ad3-8e2c-1d6d7bf4c990]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:21:00 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-cd37d5cd-78c1-4692-a6d9-261dc759064b tempest-VolumesServicesTestJSON-1482467710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-9f68af7a-f423-4fdc-a461-b22c2a799627 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:21:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-cd37d5cd-78c1-4692-a6d9-261dc759064b tempest-VolumesServicesTestJSON-1482467710 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-9f68af7a-f423-4fdc-a461-b22c2a799627" returned: 0 in 0.459s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:21:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-cd37d5cd-78c1-4692-a6d9-261dc759064b tempest-VolumesServicesTestJSON-1482467710 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-9f68af7a-f423-4fdc-a461-b22c2a799627 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:21:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-cd37d5cd-78c1-4692-a6d9-261dc759064b tempest-VolumesServicesTestJSON-1482467710 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-9f68af7a-f423-4fdc-a461-b22c2a799627" returned: 0 in 0.166s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:21:01 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-cd37d5cd-78c1-4692-a6d9-261dc759064b tempest-VolumesServicesTestJSON-1482467710 None] Lock "cinder-quobyte-9f68af7a-f423-4fdc-a461-b22c2a799627" released by "delete_volume" :: held 0.794s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:21:01 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-cd37d5cd-78c1-4692-a6d9-261dc759064b tempest-VolumesServicesTestJSON-1482467710 None] Created reservations ['b1e6d554-10fa-45e3-8335-ade3f15d4784', 'ebc9f158-c4bc-4444-a4f4-9d627f6b1422', '1b05f707-0f58-423f-a0b6-21b0959aa3bf', '19d14dd1-ee45-401b-a0d0-8b1e948dc865'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:21:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-cd37d5cd-78c1-4692-a6d9-261dc759064b tempest-VolumesServicesTestJSON-1482467710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:21:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-cd37d5cd-78c1-4692-a6d9-261dc759064b tempest-VolumesServicesTestJSON-1482467710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:21:01 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-cd37d5cd-78c1-4692-a6d9-261dc759064b tempest-VolumesServicesTestJSON-1482467710 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:21:01 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-cd37d5cd-78c1-4692-a6d9-261dc759064b tempest-VolumesServicesTestJSON-1482467710 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:21:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-cd37d5cd-78c1-4692-a6d9-261dc759064b tempest-VolumesServicesTestJSON-1482467710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:21:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-cd37d5cd-78c1-4692-a6d9-261dc759064b tempest-VolumesServicesTestJSON-1482467710 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:21:02 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-cd37d5cd-78c1-4692-a6d9-261dc759064b tempest-VolumesServicesTestJSON-1482467710 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.090s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:21:02 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-cd37d5cd-78c1-4692-a6d9-261dc759064b tempest-VolumesServicesTestJSON-1482467710 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:21:02 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-cd37d5cd-78c1-4692-a6d9-261dc759064b tempest-VolumesServicesTestJSON-1482467710 None] Deleted volume successfully. Sep 10 21:21:02 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-cd37d5cd-78c1-4692-a6d9-261dc759064b tempest-VolumesServicesTestJSON-1482467710 None] Lock "cinder-9f68af7a-f423-4fdc-a461-b22c2a799627-delete_volume" released by "delete_volume" :: held 2.194s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:21:11 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=5,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:21:12 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=7,cinder:UPDATE=12,cinder:INSERT=4,cinder:DELETE=1 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:21:14 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-3e252c4f-2478-4e56-966c-6a7f515d3c02 tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:21:14 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e252c4f-2478-4e56-966c-6a7f515d3c02 tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:21:14 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-3e252c4f-2478-4e56-966c-6a7f515d3c02 tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Flow 'volume_create_manager' (2d3998b3-3cde-42f2-a03b-d54c582f9ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:21:14 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-3e252c4f-2478-4e56-966c-6a7f515d3c02 tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5607b489-2474-4e1c-998b-a8a032a1c5cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:21:14 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-3e252c4f-2478-4e56-966c-6a7f515d3c02 tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5607b489-2474-4e1c-998b-a8a032a1c5cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:21:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-32755145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b0dc6e6-9ef0-45df-ac84-ef9009f81224,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a982229e6d343eba699b09f23028303',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:21:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:21:14Z,use_quota=True,user_id='83ded41ce8e64ad7b2ea3cb21a5ca1db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:21:14 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-3e252c4f-2478-4e56-966c-6a7f515d3c02 tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29c01e45-3cb7-4dc6-a988-64e14f019047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:21:14 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-3e252c4f-2478-4e56-966c-6a7f515d3c02 tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29c01e45-3cb7-4dc6-a988-64e14f019047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:21:14 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-3e252c4f-2478-4e56-966c-6a7f515d3c02 tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc513e0b-098a-41dd-9304-5c5bbc73eeb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:21:14 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-3e252c4f-2478-4e56-966c-6a7f515d3c02 tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc513e0b-098a-41dd-9304-5c5bbc73eeb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b0dc6e6-9ef0-45df-ac84-ef9009f81224', 'volume_name': 'volume-1b0dc6e6-9ef0-45df-ac84-ef9009f81224', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:21:14 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-3e252c4f-2478-4e56-966c-6a7f515d3c02 tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b239dcc-c4e2-40a4-8fc8-e4a86c33c968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:21:14 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-3e252c4f-2478-4e56-966c-6a7f515d3c02 tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b239dcc-c4e2-40a4-8fc8-e4a86c33c968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:21:14 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-3e252c4f-2478-4e56-966c-6a7f515d3c02 tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83c8c3ec-447d-49b7-be48-05dec2ff9e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:21:14 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-3e252c4f-2478-4e56-966c-6a7f515d3c02 tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Volume 1b0dc6e6-9ef0-45df-ac84-ef9009f81224: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b0dc6e6-9ef0-45df-ac84-ef9009f81224', 'volume_size': 1} Sep 10 21:21:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-3e252c4f-2478-4e56-966c-6a7f515d3c02 tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:21:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-3e252c4f-2478-4e56-966c-6a7f515d3c02 tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:21:14 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-3e252c4f-2478-4e56-966c-6a7f515d3c02 tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:21:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-32755145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b0dc6e6-9ef0-45df-ac84-ef9009f81224,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a982229e6d343eba699b09f23028303',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:21:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:21:14Z,use_quota=True,user_id='83ded41ce8e64ad7b2ea3cb21a5ca1db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:21:14 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-3e252c4f-2478-4e56-966c-6a7f515d3c02 tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Creating volume 1b0dc6e6-9ef0-45df-ac84-ef9009f81224 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:21:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-3e252c4f-2478-4e56-966c-6a7f515d3c02 tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:21:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-3e252c4f-2478-4e56-966c-6a7f515d3c02 tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:21:14 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-3e252c4f-2478-4e56-966c-6a7f515d3c02 tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:21:14 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-3e252c4f-2478-4e56-966c-6a7f515d3c02 tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:21:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-3e252c4f-2478-4e56-966c-6a7f515d3c02 tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:21:14 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-3e252c4f-2478-4e56-966c-6a7f515d3c02 tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:21:14 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-3e252c4f-2478-4e56-966c-6a7f515d3c02 tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:21:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-3e252c4f-2478-4e56-966c-6a7f515d3c02 tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1b0dc6e6-9ef0-45df-ac84-ef9009f81224 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:21:14 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=43, name=volume-1b0dc6e6-9ef0-45df-ac84-ef9009f81224, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:21:15 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-3e252c4f-2478-4e56-966c-6a7f515d3c02 tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1b0dc6e6-9ef0-45df-ac84-ef9009f81224 1073741824" returned: 0 in 0.464s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:21:15 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-3e252c4f-2478-4e56-966c-6a7f515d3c02 tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1b0dc6e6-9ef0-45df-ac84-ef9009f81224 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:21:15 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-3e252c4f-2478-4e56-966c-6a7f515d3c02 tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1b0dc6e6-9ef0-45df-ac84-ef9009f81224" returned: 0 in 0.136s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:21:15 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-3e252c4f-2478-4e56-966c-6a7f515d3c02 tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] <== create_volume: return (684ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:21:15 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-3e252c4f-2478-4e56-966c-6a7f515d3c02 tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:21:15 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-3e252c4f-2478-4e56-966c-6a7f515d3c02 tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83c8c3ec-447d-49b7-be48-05dec2ff9e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b0dc6e6-9ef0-45df-ac84-ef9009f81224', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:21:15 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-3e252c4f-2478-4e56-966c-6a7f515d3c02 tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdd5f5e1-86fb-4d88-8a30-946db851d13b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:21:15 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-3e252c4f-2478-4e56-966c-6a7f515d3c02 tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Volume volume-1b0dc6e6-9ef0-45df-ac84-ef9009f81224 (1b0dc6e6-9ef0-45df-ac84-ef9009f81224): created successfully Sep 10 21:21:15 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-3e252c4f-2478-4e56-966c-6a7f515d3c02 tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdd5f5e1-86fb-4d88-8a30-946db851d13b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:21:15 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-3e252c4f-2478-4e56-966c-6a7f515d3c02 tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Flow 'volume_create_manager' (2d3998b3-3cde-42f2-a03b-d54c582f9ddd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:21:15 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-3e252c4f-2478-4e56-966c-6a7f515d3c02 tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Created volume successfully. Sep 10 21:21:16 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-31db38fa-45a4-4345-bf0f-50023f7f5cec tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:21:16 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-31db38fa-45a4-4345-bf0f-50023f7f5cec tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:21:16 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-31db38fa-45a4-4345-bf0f-50023f7f5cec tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:21:17 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-31db38fa-45a4-4345-bf0f-50023f7f5cec tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Creating offline snapshot 82cd4399-af49-4905-ae4a-17c604b1e5e4 of volume 1b0dc6e6-9ef0-45df-ac84-ef9009f81224 {{(pid=82780) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 21:21:17 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[00eb6193-02f3-4af9-9c22-d406f394628e]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:21:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-31db38fa-45a4-4345-bf0f-50023f7f5cec tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1b0dc6e6-9ef0-45df-ac84-ef9009f81224 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:21:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-31db38fa-45a4-4345-bf0f-50023f7f5cec tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1b0dc6e6-9ef0-45df-ac84-ef9009f81224" returned: 0 in 0.878s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:21:18 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-31db38fa-45a4-4345-bf0f-50023f7f5cec tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1b0dc6e6-9ef0-45df-ac84-ef9009f81224,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1b0dc6e6-9ef0-45df-ac84-ef9009f81224.82cd4399-af49-4905-ae4a-17c604b1e5e4 1G {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:21:18 devstack quobyte-client[82807]: System call of process 93044 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:21:18 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=44, name=volume-1b0dc6e6-9ef0-45df-ac84-ef9009f81224.82cd4399-af49-4905-ae4a-17c604b1e5e4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:21:18 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-31db38fa-45a4-4345-bf0f-50023f7f5cec tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1b0dc6e6-9ef0-45df-ac84-ef9009f81224,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1b0dc6e6-9ef0-45df-ac84-ef9009f81224.82cd4399-af49-4905-ae4a-17c604b1e5e4 1G" returned: 0 in 0.329s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:21:18 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-31db38fa-45a4-4345-bf0f-50023f7f5cec tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Running cmd (subprocess): qemu-img rebase -u -b volume-1b0dc6e6-9ef0-45df-ac84-ef9009f81224 -F qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1b0dc6e6-9ef0-45df-ac84-ef9009f81224.82cd4399-af49-4905-ae4a-17c604b1e5e4 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:21:19 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-31db38fa-45a4-4345-bf0f-50023f7f5cec tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] CMD "qemu-img rebase -u -b volume-1b0dc6e6-9ef0-45df-ac84-ef9009f81224 -F qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1b0dc6e6-9ef0-45df-ac84-ef9009f81224.82cd4399-af49-4905-ae4a-17c604b1e5e4" returned: 0 in 0.860s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:21:19 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-31db38fa-45a4-4345-bf0f-50023f7f5cec tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] File path /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1b0dc6e6-9ef0-45df-ac84-ef9009f81224.82cd4399-af49-4905-ae4a-17c604b1e5e4 is being set with permissions: 660 {{(pid=82780) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 21:21:19 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-31db38fa-45a4-4345-bf0f-50023f7f5cec tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1b0dc6e6-9ef0-45df-ac84-ef9009f81224.82cd4399-af49-4905-ae4a-17c604b1e5e4 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:21:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-31db38fa-45a4-4345-bf0f-50023f7f5cec tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1b0dc6e6-9ef0-45df-ac84-ef9009f81224.82cd4399-af49-4905-ae4a-17c604b1e5e4" returned: 0 in 0.464s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:21:20 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-31db38fa-45a4-4345-bf0f-50023f7f5cec tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Setting permissions: /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1b0dc6e6-9ef0-45df-ac84-ef9009f81224 -> 1000:1000 {{(pid=82780) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 21:21:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-31db38fa-45a4-4345-bf0f-50023f7f5cec tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1b0dc6e6-9ef0-45df-ac84-ef9009f81224 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1b0dc6e6-9ef0-45df-ac84-ef9009f81224.82cd4399-af49-4905-ae4a-17c604b1e5e4 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:21:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-31db38fa-45a4-4345-bf0f-50023f7f5cec tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1b0dc6e6-9ef0-45df-ac84-ef9009f81224 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1b0dc6e6-9ef0-45df-ac84-ef9009f81224.82cd4399-af49-4905-ae4a-17c604b1e5e4" returned: 0 in 0.437s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:21:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-31db38fa-45a4-4345-bf0f-50023f7f5cec tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1b0dc6e6-9ef0-45df-ac84-ef9009f81224.info {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:21:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-31db38fa-45a4-4345-bf0f-50023f7f5cec tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1b0dc6e6-9ef0-45df-ac84-ef9009f81224.info" returned: 0 in 0.955s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:21:21 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-31db38fa-45a4-4345-bf0f-50023f7f5cec tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] File path /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1b0dc6e6-9ef0-45df-ac84-ef9009f81224.info is being set with permissions: 660 {{(pid=82780) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 21:21:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-31db38fa-45a4-4345-bf0f-50023f7f5cec tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1b0dc6e6-9ef0-45df-ac84-ef9009f81224.info {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:21:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-31db38fa-45a4-4345-bf0f-50023f7f5cec tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1b0dc6e6-9ef0-45df-ac84-ef9009f81224.info" returned: 0 in 0.237s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:21:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-31db38fa-45a4-4345-bf0f-50023f7f5cec tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.408s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:21:23 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-31db38fa-45a4-4345-bf0f-50023f7f5cec tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Create snapshot completed successfully Sep 10 21:21:25 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-eda0e5b3-f2bc-4913-b7fa-73dbdb50b44b tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Acquiring lock "cinder-82cd4399-af49-4905-ae4a-17c604b1e5e4-delete_snapshot" by "delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:21:25 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-eda0e5b3-f2bc-4913-b7fa-73dbdb50b44b tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Lock "cinder-82cd4399-af49-4905-ae4a-17c604b1e5e4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:21:25 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-eda0e5b3-f2bc-4913-b7fa-73dbdb50b44b tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:21:25 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-eda0e5b3-f2bc-4913-b7fa-73dbdb50b44b tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Acquiring lock "cinder-quobyte-1b0dc6e6-9ef0-45df-ac84-ef9009f81224" by "delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:21:25 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-eda0e5b3-f2bc-4913-b7fa-73dbdb50b44b tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Lock "cinder-quobyte-1b0dc6e6-9ef0-45df-ac84-ef9009f81224" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:21:25 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-eda0e5b3-f2bc-4913-b7fa-73dbdb50b44b tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Acquiring lock "cinder-quobyte-82cd4399-af49-4905-ae4a-17c604b1e5e4" by "_delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:21:25 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-eda0e5b3-f2bc-4913-b7fa-73dbdb50b44b tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Lock "cinder-quobyte-82cd4399-af49-4905-ae4a-17c604b1e5e4" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:21:25 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-eda0e5b3-f2bc-4913-b7fa-73dbdb50b44b tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Deleting offline snapshot 82cd4399-af49-4905-ae4a-17c604b1e5e4 of volume 1b0dc6e6-9ef0-45df-ac84-ef9009f81224 {{(pid=82780) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 21:21:25 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-eda0e5b3-f2bc-4913-b7fa-73dbdb50b44b tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] snapshot_file for this snap is: volume-1b0dc6e6-9ef0-45df-ac84-ef9009f81224.82cd4399-af49-4905-ae4a-17c604b1e5e4 {{(pid=82780) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 21:21:25 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[743e0c01-bd20-45dd-98b6-d5ab71a89fd7]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:21:25 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-eda0e5b3-f2bc-4913-b7fa-73dbdb50b44b tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1b0dc6e6-9ef0-45df-ac84-ef9009f81224.82cd4399-af49-4905-ae4a-17c604b1e5e4 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:21:26 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-eda0e5b3-f2bc-4913-b7fa-73dbdb50b44b tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1b0dc6e6-9ef0-45df-ac84-ef9009f81224.82cd4399-af49-4905-ae4a-17c604b1e5e4" returned: 0 in 1.081s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:21:26 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-eda0e5b3-f2bc-4913-b7fa-73dbdb50b44b tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b0dc6e6-9ef0-45df-ac84-ef9009f81224(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82780) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 21:21:26 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[9762cdd4-5937-409f-b7c6-e9595b874b2a]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:21:26 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-eda0e5b3-f2bc-4913-b7fa-73dbdb50b44b tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1b0dc6e6-9ef0-45df-ac84-ef9009f81224 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:21:26 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-eda0e5b3-f2bc-4913-b7fa-73dbdb50b44b tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1b0dc6e6-9ef0-45df-ac84-ef9009f81224" returned: 0 in 0.524s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:21:26 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-eda0e5b3-f2bc-4913-b7fa-73dbdb50b44b tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1b0dc6e6-9ef0-45df-ac84-ef9009f81224.82cd4399-af49-4905-ae4a-17c604b1e5e4 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:21:27 devstack quobyte-client[82807]: System call of process 93132 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:21:27 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-eda0e5b3-f2bc-4913-b7fa-73dbdb50b44b tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1b0dc6e6-9ef0-45df-ac84-ef9009f81224.82cd4399-af49-4905-ae4a-17c604b1e5e4" returned: 0 in 0.529s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:21:27 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-eda0e5b3-f2bc-4913-b7fa-73dbdb50b44b tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1b0dc6e6-9ef0-45df-ac84-ef9009f81224.82cd4399-af49-4905-ae4a-17c604b1e5e4 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:21:27 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-eda0e5b3-f2bc-4913-b7fa-73dbdb50b44b tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1b0dc6e6-9ef0-45df-ac84-ef9009f81224.82cd4399-af49-4905-ae4a-17c604b1e5e4" returned: 0 in 0.127s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:21:27 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-eda0e5b3-f2bc-4913-b7fa-73dbdb50b44b tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Lock "cinder-quobyte-82cd4399-af49-4905-ae4a-17c604b1e5e4" released by "_delete_snapshot" :: held 2.719s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:21:27 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-eda0e5b3-f2bc-4913-b7fa-73dbdb50b44b tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Lock "cinder-quobyte-1b0dc6e6-9ef0-45df-ac84-ef9009f81224" released by "delete_snapshot" :: held 2.788s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:21:28 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-eda0e5b3-f2bc-4913-b7fa-73dbdb50b44b tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Created reservations ['8e1975f3-7077-464a-91c4-de0b10e2a9f5', '84ff2f4f-682b-4be4-b087-a0e62c38216c', '442d474e-a97a-4e7c-b32e-c02ddcb974e2', '3c7ba15d-63d8-45fd-b4bc-725649482bf7'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:21:28 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-eda0e5b3-f2bc-4913-b7fa-73dbdb50b44b tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Delete snapshot completed successfully. Sep 10 21:21:28 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-eda0e5b3-f2bc-4913-b7fa-73dbdb50b44b tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Lock "cinder-82cd4399-af49-4905-ae4a-17c604b1e5e4-delete_snapshot" released by "delete_snapshot" :: held 3.485s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:21:29 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-176bad49-03d0-456b-8cc6-39ee7436acfa tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Acquiring lock "cinder-1b0dc6e6-9ef0-45df-ac84-ef9009f81224-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:21:30 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-176bad49-03d0-456b-8cc6-39ee7436acfa tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Lock "cinder-1b0dc6e6-9ef0-45df-ac84-ef9009f81224-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:21:30 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-176bad49-03d0-456b-8cc6-39ee7436acfa tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:21:30 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-176bad49-03d0-456b-8cc6-39ee7436acfa tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Acquiring lock "cinder-quobyte-1b0dc6e6-9ef0-45df-ac84-ef9009f81224" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:21:30 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-176bad49-03d0-456b-8cc6-39ee7436acfa tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Lock "cinder-quobyte-1b0dc6e6-9ef0-45df-ac84-ef9009f81224" acquired by "delete_volume" :: waited 0.020s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:21:30 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[3680f5db-76c5-4b04-bb19-f919f5f4eb93]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:21:30 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-176bad49-03d0-456b-8cc6-39ee7436acfa tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1b0dc6e6-9ef0-45df-ac84-ef9009f81224 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:21:31 devstack quobyte-client[82807]: System call of process 93136 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:21:32 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-176bad49-03d0-456b-8cc6-39ee7436acfa tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1b0dc6e6-9ef0-45df-ac84-ef9009f81224" returned: 0 in 1.654s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:21:32 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-176bad49-03d0-456b-8cc6-39ee7436acfa tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1b0dc6e6-9ef0-45df-ac84-ef9009f81224 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:21:32 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-176bad49-03d0-456b-8cc6-39ee7436acfa tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1b0dc6e6-9ef0-45df-ac84-ef9009f81224" returned: 0 in 0.710s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:21:33 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-176bad49-03d0-456b-8cc6-39ee7436acfa tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Lock "cinder-quobyte-1b0dc6e6-9ef0-45df-ac84-ef9009f81224" released by "delete_volume" :: held 2.906s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:21:33 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-176bad49-03d0-456b-8cc6-39ee7436acfa tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Created reservations ['ce5cf38f-6399-4b4d-94f6-0c2dc1c51e32', '04a0f15a-49c4-40d7-9d3e-f763f92eff51', 'b46197eb-2388-4c2f-ab6c-145314649039', '7c04edf6-1253-4875-8ead-0f387c5e6d54'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:21:34 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-176bad49-03d0-456b-8cc6-39ee7436acfa tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:21:34 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-176bad49-03d0-456b-8cc6-39ee7436acfa tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:21:34 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-176bad49-03d0-456b-8cc6-39ee7436acfa tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:21:34 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-176bad49-03d0-456b-8cc6-39ee7436acfa tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:21:34 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-176bad49-03d0-456b-8cc6-39ee7436acfa tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:21:34 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-176bad49-03d0-456b-8cc6-39ee7436acfa tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:21:34 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-176bad49-03d0-456b-8cc6-39ee7436acfa tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.201s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:21:34 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-176bad49-03d0-456b-8cc6-39ee7436acfa tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:21:34 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-176bad49-03d0-456b-8cc6-39ee7436acfa tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Deleted volume successfully. Sep 10 21:21:34 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-176bad49-03d0-456b-8cc6-39ee7436acfa tempest-VolumeSnapshotQuotasNegativeTestJSON-872485472 None] Lock "cinder-1b0dc6e6-9ef0-45df-ac84-ef9009f81224-delete_volume" released by "delete_volume" :: held 4.785s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:21:44 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:UPDATE=23,cinder:DELETE=1,cinder:SELECT=12 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:21:44 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=12,cinder:UPDATE=10,cinder:DELETE=2,cinder:INSERT=8 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:21:56 devstack cinder-volume[82780]: DEBUG oslo_service.periodic_task [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82780) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 21:21:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:21:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:21:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:21:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:21:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:21:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:21:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.225s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:21:57 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:21:59 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:22:02 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-c34937a5-1d4e-40ca-a9e9-e58b2e64a084 tempest-SnapshotMetadataTestJSON-1159447402 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:22:02 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-c34937a5-1d4e-40ca-a9e9-e58b2e64a084 tempest-SnapshotMetadataTestJSON-1159447402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:22:02 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c34937a5-1d4e-40ca-a9e9-e58b2e64a084 tempest-SnapshotMetadataTestJSON-1159447402 None] Flow 'volume_create_manager' (0a8c9d10-c5a4-4b7d-ace1-19684677b292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:22:02 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c34937a5-1d4e-40ca-a9e9-e58b2e64a084 tempest-SnapshotMetadataTestJSON-1159447402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4be9658d-851e-4980-8ce1-6d01f18c4936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:22:02 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c34937a5-1d4e-40ca-a9e9-e58b2e64a084 tempest-SnapshotMetadataTestJSON-1159447402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4be9658d-851e-4980-8ce1-6d01f18c4936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:22:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1175966213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87f3bf43-dc40-4094-9641-43b763e793b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3ff459d0b794041822ae8c039a1b4aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:22:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:22:02Z,use_quota=True,user_id='bcea39cd1ea64b70b74a732e44decb94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:22:02 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c34937a5-1d4e-40ca-a9e9-e58b2e64a084 tempest-SnapshotMetadataTestJSON-1159447402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74dad007-e5c0-40c0-ba73-cc2da39d15b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:22:02 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c34937a5-1d4e-40ca-a9e9-e58b2e64a084 tempest-SnapshotMetadataTestJSON-1159447402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74dad007-e5c0-40c0-ba73-cc2da39d15b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:22:02 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c34937a5-1d4e-40ca-a9e9-e58b2e64a084 tempest-SnapshotMetadataTestJSON-1159447402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0084afa-c291-487e-b57f-849e8f9a18ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:22:02 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c34937a5-1d4e-40ca-a9e9-e58b2e64a084 tempest-SnapshotMetadataTestJSON-1159447402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0084afa-c291-487e-b57f-849e8f9a18ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87f3bf43-dc40-4094-9641-43b763e793b7', 'volume_name': 'volume-87f3bf43-dc40-4094-9641-43b763e793b7', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:22:02 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c34937a5-1d4e-40ca-a9e9-e58b2e64a084 tempest-SnapshotMetadataTestJSON-1159447402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60af49af-906a-4f05-b0d3-eeaa9a478c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:22:02 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c34937a5-1d4e-40ca-a9e9-e58b2e64a084 tempest-SnapshotMetadataTestJSON-1159447402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60af49af-906a-4f05-b0d3-eeaa9a478c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:22:02 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c34937a5-1d4e-40ca-a9e9-e58b2e64a084 tempest-SnapshotMetadataTestJSON-1159447402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d4e6de4-e1f7-498d-9d98-69fe65def175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:22:02 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-c34937a5-1d4e-40ca-a9e9-e58b2e64a084 tempest-SnapshotMetadataTestJSON-1159447402 None] Volume 87f3bf43-dc40-4094-9641-43b763e793b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87f3bf43-dc40-4094-9641-43b763e793b7', 'volume_size': 1} Sep 10 21:22:02 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-c34937a5-1d4e-40ca-a9e9-e58b2e64a084 tempest-SnapshotMetadataTestJSON-1159447402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:22:02 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-c34937a5-1d4e-40ca-a9e9-e58b2e64a084 tempest-SnapshotMetadataTestJSON-1159447402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:22:02 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-c34937a5-1d4e-40ca-a9e9-e58b2e64a084 tempest-SnapshotMetadataTestJSON-1159447402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:22:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1175966213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87f3bf43-dc40-4094-9641-43b763e793b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3ff459d0b794041822ae8c039a1b4aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:22:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:22:02Z,use_quota=True,user_id='bcea39cd1ea64b70b74a732e44decb94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:22:02 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-c34937a5-1d4e-40ca-a9e9-e58b2e64a084 tempest-SnapshotMetadataTestJSON-1159447402 None] Creating volume 87f3bf43-dc40-4094-9641-43b763e793b7 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:22:02 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-c34937a5-1d4e-40ca-a9e9-e58b2e64a084 tempest-SnapshotMetadataTestJSON-1159447402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:22:02 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-c34937a5-1d4e-40ca-a9e9-e58b2e64a084 tempest-SnapshotMetadataTestJSON-1159447402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:22:02 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-c34937a5-1d4e-40ca-a9e9-e58b2e64a084 tempest-SnapshotMetadataTestJSON-1159447402 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:22:02 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-c34937a5-1d4e-40ca-a9e9-e58b2e64a084 tempest-SnapshotMetadataTestJSON-1159447402 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:22:02 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-c34937a5-1d4e-40ca-a9e9-e58b2e64a084 tempest-SnapshotMetadataTestJSON-1159447402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:22:02 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-c34937a5-1d4e-40ca-a9e9-e58b2e64a084 tempest-SnapshotMetadataTestJSON-1159447402 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:22:02 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-c34937a5-1d4e-40ca-a9e9-e58b2e64a084 tempest-SnapshotMetadataTestJSON-1159447402 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:22:02 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c34937a5-1d4e-40ca-a9e9-e58b2e64a084 tempest-SnapshotMetadataTestJSON-1159447402 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-87f3bf43-dc40-4094-9641-43b763e793b7 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:22:02 devstack quobyte-client[82807]: System call of process 93266 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:22:02 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=46, name=volume-87f3bf43-dc40-4094-9641-43b763e793b7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:22:03 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c34937a5-1d4e-40ca-a9e9-e58b2e64a084 tempest-SnapshotMetadataTestJSON-1159447402 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-87f3bf43-dc40-4094-9641-43b763e793b7 1073741824" returned: 0 in 0.928s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:22:03 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c34937a5-1d4e-40ca-a9e9-e58b2e64a084 tempest-SnapshotMetadataTestJSON-1159447402 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-87f3bf43-dc40-4094-9641-43b763e793b7 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:22:03 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c34937a5-1d4e-40ca-a9e9-e58b2e64a084 tempest-SnapshotMetadataTestJSON-1159447402 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-87f3bf43-dc40-4094-9641-43b763e793b7" returned: 0 in 0.224s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:22:03 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-c34937a5-1d4e-40ca-a9e9-e58b2e64a084 tempest-SnapshotMetadataTestJSON-1159447402 None] <== create_volume: return (1309ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:22:03 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-c34937a5-1d4e-40ca-a9e9-e58b2e64a084 tempest-SnapshotMetadataTestJSON-1159447402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.335s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:22:04 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c34937a5-1d4e-40ca-a9e9-e58b2e64a084 tempest-SnapshotMetadataTestJSON-1159447402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d4e6de4-e1f7-498d-9d98-69fe65def175) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87f3bf43-dc40-4094-9641-43b763e793b7', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:22:04 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c34937a5-1d4e-40ca-a9e9-e58b2e64a084 tempest-SnapshotMetadataTestJSON-1159447402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (413df8bc-46af-4795-a9d8-b8f5157b5240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:22:04 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-c34937a5-1d4e-40ca-a9e9-e58b2e64a084 tempest-SnapshotMetadataTestJSON-1159447402 None] Volume volume-87f3bf43-dc40-4094-9641-43b763e793b7 (87f3bf43-dc40-4094-9641-43b763e793b7): created successfully Sep 10 21:22:04 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c34937a5-1d4e-40ca-a9e9-e58b2e64a084 tempest-SnapshotMetadataTestJSON-1159447402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (413df8bc-46af-4795-a9d8-b8f5157b5240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:22:04 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c34937a5-1d4e-40ca-a9e9-e58b2e64a084 tempest-SnapshotMetadataTestJSON-1159447402 None] Flow 'volume_create_manager' (0a8c9d10-c5a4-4b7d-ace1-19684677b292) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:22:04 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-c34937a5-1d4e-40ca-a9e9-e58b2e64a084 tempest-SnapshotMetadataTestJSON-1159447402 None] Created volume successfully. Sep 10 21:22:06 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-20966fd3-87d3-4e64-a4f2-25373a7ff3d3 tempest-SnapshotMetadataTestJSON-1159447402 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:22:06 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-20966fd3-87d3-4e64-a4f2-25373a7ff3d3 tempest-SnapshotMetadataTestJSON-1159447402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:22:06 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-20966fd3-87d3-4e64-a4f2-25373a7ff3d3 tempest-SnapshotMetadataTestJSON-1159447402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:22:06 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-20966fd3-87d3-4e64-a4f2-25373a7ff3d3 tempest-SnapshotMetadataTestJSON-1159447402 None] Creating offline snapshot fb952460-352b-4f83-abdb-35cfc9380681 of volume 87f3bf43-dc40-4094-9641-43b763e793b7 {{(pid=82780) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 21:22:06 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7163c8c-d556-4acf-8340-0236ffbbfdc8]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:22:06 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-20966fd3-87d3-4e64-a4f2-25373a7ff3d3 tempest-SnapshotMetadataTestJSON-1159447402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-87f3bf43-dc40-4094-9641-43b763e793b7 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:22:07 devstack quobyte-client[82807]: System call of process 93272 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:22:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-20966fd3-87d3-4e64-a4f2-25373a7ff3d3 tempest-SnapshotMetadataTestJSON-1159447402 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-87f3bf43-dc40-4094-9641-43b763e793b7" returned: 0 in 0.981s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:22:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-20966fd3-87d3-4e64-a4f2-25373a7ff3d3 tempest-SnapshotMetadataTestJSON-1159447402 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-87f3bf43-dc40-4094-9641-43b763e793b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-87f3bf43-dc40-4094-9641-43b763e793b7.fb952460-352b-4f83-abdb-35cfc9380681 1G {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:22:07 devstack quobyte-client[82807]: System call of process 93276 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:22:07 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=47, name=volume-87f3bf43-dc40-4094-9641-43b763e793b7.fb952460-352b-4f83-abdb-35cfc9380681, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:22:08 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-20966fd3-87d3-4e64-a4f2-25373a7ff3d3 tempest-SnapshotMetadataTestJSON-1159447402 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-87f3bf43-dc40-4094-9641-43b763e793b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-87f3bf43-dc40-4094-9641-43b763e793b7.fb952460-352b-4f83-abdb-35cfc9380681 1G" returned: 0 in 0.733s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:22:08 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-20966fd3-87d3-4e64-a4f2-25373a7ff3d3 tempest-SnapshotMetadataTestJSON-1159447402 None] Running cmd (subprocess): qemu-img rebase -u -b volume-87f3bf43-dc40-4094-9641-43b763e793b7 -F qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-87f3bf43-dc40-4094-9641-43b763e793b7.fb952460-352b-4f83-abdb-35cfc9380681 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:22:08 devstack quobyte-client[82807]: System call of process 93280 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:22:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-20966fd3-87d3-4e64-a4f2-25373a7ff3d3 tempest-SnapshotMetadataTestJSON-1159447402 None] CMD "qemu-img rebase -u -b volume-87f3bf43-dc40-4094-9641-43b763e793b7 -F qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-87f3bf43-dc40-4094-9641-43b763e793b7.fb952460-352b-4f83-abdb-35cfc9380681" returned: 0 in 0.415s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:22:09 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-20966fd3-87d3-4e64-a4f2-25373a7ff3d3 tempest-SnapshotMetadataTestJSON-1159447402 None] File path /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-87f3bf43-dc40-4094-9641-43b763e793b7.fb952460-352b-4f83-abdb-35cfc9380681 is being set with permissions: 660 {{(pid=82780) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 21:22:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-20966fd3-87d3-4e64-a4f2-25373a7ff3d3 tempest-SnapshotMetadataTestJSON-1159447402 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-87f3bf43-dc40-4094-9641-43b763e793b7.fb952460-352b-4f83-abdb-35cfc9380681 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:22:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-20966fd3-87d3-4e64-a4f2-25373a7ff3d3 tempest-SnapshotMetadataTestJSON-1159447402 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-87f3bf43-dc40-4094-9641-43b763e793b7.fb952460-352b-4f83-abdb-35cfc9380681" returned: 0 in 0.815s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:22:09 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-20966fd3-87d3-4e64-a4f2-25373a7ff3d3 tempest-SnapshotMetadataTestJSON-1159447402 None] Setting permissions: /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-87f3bf43-dc40-4094-9641-43b763e793b7 -> 1000:1000 {{(pid=82780) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 21:22:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-20966fd3-87d3-4e64-a4f2-25373a7ff3d3 tempest-SnapshotMetadataTestJSON-1159447402 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-87f3bf43-dc40-4094-9641-43b763e793b7 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-87f3bf43-dc40-4094-9641-43b763e793b7.fb952460-352b-4f83-abdb-35cfc9380681 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:22:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-20966fd3-87d3-4e64-a4f2-25373a7ff3d3 tempest-SnapshotMetadataTestJSON-1159447402 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-87f3bf43-dc40-4094-9641-43b763e793b7 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-87f3bf43-dc40-4094-9641-43b763e793b7.fb952460-352b-4f83-abdb-35cfc9380681" returned: 0 in 0.278s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:22:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-20966fd3-87d3-4e64-a4f2-25373a7ff3d3 tempest-SnapshotMetadataTestJSON-1159447402 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-87f3bf43-dc40-4094-9641-43b763e793b7.info {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:22:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-20966fd3-87d3-4e64-a4f2-25373a7ff3d3 tempest-SnapshotMetadataTestJSON-1159447402 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-87f3bf43-dc40-4094-9641-43b763e793b7.info" returned: 0 in 0.152s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:22:10 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-20966fd3-87d3-4e64-a4f2-25373a7ff3d3 tempest-SnapshotMetadataTestJSON-1159447402 None] File path /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-87f3bf43-dc40-4094-9641-43b763e793b7.info is being set with permissions: 660 {{(pid=82780) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 21:22:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-20966fd3-87d3-4e64-a4f2-25373a7ff3d3 tempest-SnapshotMetadataTestJSON-1159447402 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-87f3bf43-dc40-4094-9641-43b763e793b7.info {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:22:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-20966fd3-87d3-4e64-a4f2-25373a7ff3d3 tempest-SnapshotMetadataTestJSON-1159447402 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-87f3bf43-dc40-4094-9641-43b763e793b7.info" returned: 0 in 0.173s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:22:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-20966fd3-87d3-4e64-a4f2-25373a7ff3d3 tempest-SnapshotMetadataTestJSON-1159447402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.410s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:22:11 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-20966fd3-87d3-4e64-a4f2-25373a7ff3d3 tempest-SnapshotMetadataTestJSON-1159447402 None] Create snapshot completed successfully Sep 10 21:22:13 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-ef8e07be-dc54-40e2-9432-d2b9f04e2e25 tempest-SnapshotMetadataTestJSON-1159447402 None] Acquiring lock "cinder-fb952460-352b-4f83-abdb-35cfc9380681-delete_snapshot" by "delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:22:13 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-ef8e07be-dc54-40e2-9432-d2b9f04e2e25 tempest-SnapshotMetadataTestJSON-1159447402 None] Lock "cinder-fb952460-352b-4f83-abdb-35cfc9380681-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:22:13 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-ef8e07be-dc54-40e2-9432-d2b9f04e2e25 tempest-SnapshotMetadataTestJSON-1159447402 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:22:13 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-ef8e07be-dc54-40e2-9432-d2b9f04e2e25 tempest-SnapshotMetadataTestJSON-1159447402 None] Acquiring lock "cinder-quobyte-87f3bf43-dc40-4094-9641-43b763e793b7" by "delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:22:13 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-ef8e07be-dc54-40e2-9432-d2b9f04e2e25 tempest-SnapshotMetadataTestJSON-1159447402 None] Lock "cinder-quobyte-87f3bf43-dc40-4094-9641-43b763e793b7" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:22:13 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-ef8e07be-dc54-40e2-9432-d2b9f04e2e25 tempest-SnapshotMetadataTestJSON-1159447402 None] Acquiring lock "cinder-quobyte-fb952460-352b-4f83-abdb-35cfc9380681" by "_delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:22:13 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-ef8e07be-dc54-40e2-9432-d2b9f04e2e25 tempest-SnapshotMetadataTestJSON-1159447402 None] Lock "cinder-quobyte-fb952460-352b-4f83-abdb-35cfc9380681" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:22:13 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-ef8e07be-dc54-40e2-9432-d2b9f04e2e25 tempest-SnapshotMetadataTestJSON-1159447402 None] Deleting offline snapshot fb952460-352b-4f83-abdb-35cfc9380681 of volume 87f3bf43-dc40-4094-9641-43b763e793b7 {{(pid=82780) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 21:22:13 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-ef8e07be-dc54-40e2-9432-d2b9f04e2e25 tempest-SnapshotMetadataTestJSON-1159447402 None] snapshot_file for this snap is: volume-87f3bf43-dc40-4094-9641-43b763e793b7.fb952460-352b-4f83-abdb-35cfc9380681 {{(pid=82780) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 21:22:13 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb2b655-72d2-4107-92a7-e5b71a9e5714]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:22:13 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ef8e07be-dc54-40e2-9432-d2b9f04e2e25 tempest-SnapshotMetadataTestJSON-1159447402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-87f3bf43-dc40-4094-9641-43b763e793b7.fb952460-352b-4f83-abdb-35cfc9380681 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:22:13 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ef8e07be-dc54-40e2-9432-d2b9f04e2e25 tempest-SnapshotMetadataTestJSON-1159447402 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-87f3bf43-dc40-4094-9641-43b763e793b7.fb952460-352b-4f83-abdb-35cfc9380681" returned: 0 in 0.442s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:22:13 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-ef8e07be-dc54-40e2-9432-d2b9f04e2e25 tempest-SnapshotMetadataTestJSON-1159447402 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87f3bf43-dc40-4094-9641-43b763e793b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82780) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 21:22:13 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[22934a15-a2cd-41f3-86fb-98bf09340522]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:22:13 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ef8e07be-dc54-40e2-9432-d2b9f04e2e25 tempest-SnapshotMetadataTestJSON-1159447402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-87f3bf43-dc40-4094-9641-43b763e793b7 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:22:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ef8e07be-dc54-40e2-9432-d2b9f04e2e25 tempest-SnapshotMetadataTestJSON-1159447402 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-87f3bf43-dc40-4094-9641-43b763e793b7" returned: 0 in 0.404s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:22:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ef8e07be-dc54-40e2-9432-d2b9f04e2e25 tempest-SnapshotMetadataTestJSON-1159447402 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-87f3bf43-dc40-4094-9641-43b763e793b7.fb952460-352b-4f83-abdb-35cfc9380681 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:22:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ef8e07be-dc54-40e2-9432-d2b9f04e2e25 tempest-SnapshotMetadataTestJSON-1159447402 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-87f3bf43-dc40-4094-9641-43b763e793b7.fb952460-352b-4f83-abdb-35cfc9380681" returned: 0 in 0.207s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:22:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ef8e07be-dc54-40e2-9432-d2b9f04e2e25 tempest-SnapshotMetadataTestJSON-1159447402 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-87f3bf43-dc40-4094-9641-43b763e793b7.fb952460-352b-4f83-abdb-35cfc9380681 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:22:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ef8e07be-dc54-40e2-9432-d2b9f04e2e25 tempest-SnapshotMetadataTestJSON-1159447402 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-87f3bf43-dc40-4094-9641-43b763e793b7.fb952460-352b-4f83-abdb-35cfc9380681" returned: 0 in 0.083s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:22:14 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-ef8e07be-dc54-40e2-9432-d2b9f04e2e25 tempest-SnapshotMetadataTestJSON-1159447402 None] Lock "cinder-quobyte-fb952460-352b-4f83-abdb-35cfc9380681" released by "_delete_snapshot" :: held 1.415s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:22:14 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-ef8e07be-dc54-40e2-9432-d2b9f04e2e25 tempest-SnapshotMetadataTestJSON-1159447402 None] Lock "cinder-quobyte-87f3bf43-dc40-4094-9641-43b763e793b7" released by "delete_snapshot" :: held 1.442s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:22:14 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-ef8e07be-dc54-40e2-9432-d2b9f04e2e25 tempest-SnapshotMetadataTestJSON-1159447402 None] Created reservations ['2c6a7732-7291-41c4-9a64-b026c5444192', 'a8a94e71-4b17-49b2-9509-2fff028aa813', '9e295fa7-73e4-458f-9226-c428a87f8087', 'cb8c269e-cf33-4dbf-8fb3-b812d8e44fe7'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:22:15 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-ef8e07be-dc54-40e2-9432-d2b9f04e2e25 tempest-SnapshotMetadataTestJSON-1159447402 None] Delete snapshot completed successfully. Sep 10 21:22:15 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-ef8e07be-dc54-40e2-9432-d2b9f04e2e25 tempest-SnapshotMetadataTestJSON-1159447402 None] Lock "cinder-fb952460-352b-4f83-abdb-35cfc9380681-delete_snapshot" released by "delete_snapshot" :: held 1.899s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:22:15 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-ec7fa1ba-a9d2-4043-a04b-9a80dd5876e6 tempest-SnapshotMetadataTestJSON-1159447402 None] Acquiring lock "cinder-87f3bf43-dc40-4094-9641-43b763e793b7-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:22:15 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-ec7fa1ba-a9d2-4043-a04b-9a80dd5876e6 tempest-SnapshotMetadataTestJSON-1159447402 None] Lock "cinder-87f3bf43-dc40-4094-9641-43b763e793b7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:22:15 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-ec7fa1ba-a9d2-4043-a04b-9a80dd5876e6 tempest-SnapshotMetadataTestJSON-1159447402 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:22:15 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-ec7fa1ba-a9d2-4043-a04b-9a80dd5876e6 tempest-SnapshotMetadataTestJSON-1159447402 None] Acquiring lock "cinder-quobyte-87f3bf43-dc40-4094-9641-43b763e793b7" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:22:15 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-ec7fa1ba-a9d2-4043-a04b-9a80dd5876e6 tempest-SnapshotMetadataTestJSON-1159447402 None] Lock "cinder-quobyte-87f3bf43-dc40-4094-9641-43b763e793b7" acquired by "delete_volume" :: waited 0.014s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:22:15 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e96f0c-ea72-4d50-b5f6-5c8499436fdb]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:22:15 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ec7fa1ba-a9d2-4043-a04b-9a80dd5876e6 tempest-SnapshotMetadataTestJSON-1159447402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-87f3bf43-dc40-4094-9641-43b763e793b7 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:22:16 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ec7fa1ba-a9d2-4043-a04b-9a80dd5876e6 tempest-SnapshotMetadataTestJSON-1159447402 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-87f3bf43-dc40-4094-9641-43b763e793b7" returned: 0 in 0.458s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:22:16 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ec7fa1ba-a9d2-4043-a04b-9a80dd5876e6 tempest-SnapshotMetadataTestJSON-1159447402 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-87f3bf43-dc40-4094-9641-43b763e793b7 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:22:16 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ec7fa1ba-a9d2-4043-a04b-9a80dd5876e6 tempest-SnapshotMetadataTestJSON-1159447402 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-87f3bf43-dc40-4094-9641-43b763e793b7" returned: 0 in 0.112s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:22:16 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-ec7fa1ba-a9d2-4043-a04b-9a80dd5876e6 tempest-SnapshotMetadataTestJSON-1159447402 None] Lock "cinder-quobyte-87f3bf43-dc40-4094-9641-43b763e793b7" released by "delete_volume" :: held 0.748s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:22:16 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-ec7fa1ba-a9d2-4043-a04b-9a80dd5876e6 tempest-SnapshotMetadataTestJSON-1159447402 None] Created reservations ['079e7a39-2a1f-49a8-ba48-f7356e14debd', '2567ec73-ce56-4c23-a329-8340443e778d', '7f3f1ebf-5129-40a0-9fdc-e446c5dfdcba', '84c0291c-de07-4956-9d3d-11896e23ff2a'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:22:16 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-ec7fa1ba-a9d2-4043-a04b-9a80dd5876e6 tempest-SnapshotMetadataTestJSON-1159447402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:22:16 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-ec7fa1ba-a9d2-4043-a04b-9a80dd5876e6 tempest-SnapshotMetadataTestJSON-1159447402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:22:16 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-ec7fa1ba-a9d2-4043-a04b-9a80dd5876e6 tempest-SnapshotMetadataTestJSON-1159447402 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:22:16 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-ec7fa1ba-a9d2-4043-a04b-9a80dd5876e6 tempest-SnapshotMetadataTestJSON-1159447402 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:22:16 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-ec7fa1ba-a9d2-4043-a04b-9a80dd5876e6 tempest-SnapshotMetadataTestJSON-1159447402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:22:16 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ec7fa1ba-a9d2-4043-a04b-9a80dd5876e6 tempest-SnapshotMetadataTestJSON-1159447402 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:22:16 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ec7fa1ba-a9d2-4043-a04b-9a80dd5876e6 tempest-SnapshotMetadataTestJSON-1159447402 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.087s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:22:16 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-ec7fa1ba-a9d2-4043-a04b-9a80dd5876e6 tempest-SnapshotMetadataTestJSON-1159447402 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:22:16 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-ec7fa1ba-a9d2-4043-a04b-9a80dd5876e6 tempest-SnapshotMetadataTestJSON-1159447402 None] Deleted volume successfully. Sep 10 21:22:17 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-ec7fa1ba-a9d2-4043-a04b-9a80dd5876e6 tempest-SnapshotMetadataTestJSON-1159447402 None] Lock "cinder-87f3bf43-dc40-4094-9641-43b763e793b7-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:22:22 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-45c54cfc-1cd5-48cf-973d-7b59aa109f9e tempest-VolumesDeleteCascade-1494138053 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:22:22 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-45c54cfc-1cd5-48cf-973d-7b59aa109f9e tempest-VolumesDeleteCascade-1494138053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:22:23 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-45c54cfc-1cd5-48cf-973d-7b59aa109f9e tempest-VolumesDeleteCascade-1494138053 None] Flow 'volume_create_manager' (aebbb1a4-c2f4-42a1-a35a-a14ef4dd1816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:22:23 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-45c54cfc-1cd5-48cf-973d-7b59aa109f9e tempest-VolumesDeleteCascade-1494138053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef1a503d-6453-4fc0-bdef-9d8794a7b13e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:22:23 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-45c54cfc-1cd5-48cf-973d-7b59aa109f9e tempest-VolumesDeleteCascade-1494138053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef1a503d-6453-4fc0-bdef-9d8794a7b13e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:22:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-316380037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68e17afc-a1ee-4167-91da-4382fa1bf0a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='083a5092296b4e6a9429bbe18accf37f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:22:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:22:23Z,use_quota=True,user_id='16d5db5db8304b799ba29fa3d7ae5f68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:22:23 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-45c54cfc-1cd5-48cf-973d-7b59aa109f9e tempest-VolumesDeleteCascade-1494138053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (685a8564-8a60-458c-be72-d05daf24defa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:22:23 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-45c54cfc-1cd5-48cf-973d-7b59aa109f9e tempest-VolumesDeleteCascade-1494138053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (685a8564-8a60-458c-be72-d05daf24defa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:22:23 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-45c54cfc-1cd5-48cf-973d-7b59aa109f9e tempest-VolumesDeleteCascade-1494138053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c8a0559-a4d2-46e6-8c27-2dacfc415401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:22:23 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-45c54cfc-1cd5-48cf-973d-7b59aa109f9e tempest-VolumesDeleteCascade-1494138053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c8a0559-a4d2-46e6-8c27-2dacfc415401) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68e17afc-a1ee-4167-91da-4382fa1bf0a0', 'volume_name': 'volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:22:23 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-45c54cfc-1cd5-48cf-973d-7b59aa109f9e tempest-VolumesDeleteCascade-1494138053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (539ed873-344a-4e27-8fdd-8684325fbac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:22:23 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-45c54cfc-1cd5-48cf-973d-7b59aa109f9e tempest-VolumesDeleteCascade-1494138053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (539ed873-344a-4e27-8fdd-8684325fbac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:22:23 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-45c54cfc-1cd5-48cf-973d-7b59aa109f9e tempest-VolumesDeleteCascade-1494138053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2d12c15-8ff2-4c49-aa31-2055979ecd40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:22:23 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-45c54cfc-1cd5-48cf-973d-7b59aa109f9e tempest-VolumesDeleteCascade-1494138053 None] Volume 68e17afc-a1ee-4167-91da-4382fa1bf0a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0', 'volume_size': 1} Sep 10 21:22:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-45c54cfc-1cd5-48cf-973d-7b59aa109f9e tempest-VolumesDeleteCascade-1494138053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:22:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-45c54cfc-1cd5-48cf-973d-7b59aa109f9e tempest-VolumesDeleteCascade-1494138053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:22:23 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-45c54cfc-1cd5-48cf-973d-7b59aa109f9e tempest-VolumesDeleteCascade-1494138053 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:22:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-316380037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68e17afc-a1ee-4167-91da-4382fa1bf0a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='083a5092296b4e6a9429bbe18accf37f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:22:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:22:23Z,use_quota=True,user_id='16d5db5db8304b799ba29fa3d7ae5f68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:22:23 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-45c54cfc-1cd5-48cf-973d-7b59aa109f9e tempest-VolumesDeleteCascade-1494138053 None] Creating volume 68e17afc-a1ee-4167-91da-4382fa1bf0a0 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:22:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-45c54cfc-1cd5-48cf-973d-7b59aa109f9e tempest-VolumesDeleteCascade-1494138053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:22:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-45c54cfc-1cd5-48cf-973d-7b59aa109f9e tempest-VolumesDeleteCascade-1494138053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:22:23 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-45c54cfc-1cd5-48cf-973d-7b59aa109f9e tempest-VolumesDeleteCascade-1494138053 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:22:23 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-45c54cfc-1cd5-48cf-973d-7b59aa109f9e tempest-VolumesDeleteCascade-1494138053 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:22:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-45c54cfc-1cd5-48cf-973d-7b59aa109f9e tempest-VolumesDeleteCascade-1494138053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:22:23 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-45c54cfc-1cd5-48cf-973d-7b59aa109f9e tempest-VolumesDeleteCascade-1494138053 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:22:23 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-45c54cfc-1cd5-48cf-973d-7b59aa109f9e tempest-VolumesDeleteCascade-1494138053 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:22:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-45c54cfc-1cd5-48cf-973d-7b59aa109f9e tempest-VolumesDeleteCascade-1494138053 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:22:23 devstack quobyte-client[82807]: System call of process 93316 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:22:23 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=49, name=volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:22:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-45c54cfc-1cd5-48cf-973d-7b59aa109f9e tempest-VolumesDeleteCascade-1494138053 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0 1073741824" returned: 0 in 0.407s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:22:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-45c54cfc-1cd5-48cf-973d-7b59aa109f9e tempest-VolumesDeleteCascade-1494138053 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:22:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-45c54cfc-1cd5-48cf-973d-7b59aa109f9e tempest-VolumesDeleteCascade-1494138053 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0" returned: 0 in 0.120s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:22:23 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-45c54cfc-1cd5-48cf-973d-7b59aa109f9e tempest-VolumesDeleteCascade-1494138053 None] <== create_volume: return (595ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:22:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-45c54cfc-1cd5-48cf-973d-7b59aa109f9e tempest-VolumesDeleteCascade-1494138053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.608s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:22:23 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-45c54cfc-1cd5-48cf-973d-7b59aa109f9e tempest-VolumesDeleteCascade-1494138053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2d12c15-8ff2-4c49-aa31-2055979ecd40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:22:24 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-45c54cfc-1cd5-48cf-973d-7b59aa109f9e tempest-VolumesDeleteCascade-1494138053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2800aa44-353c-41a3-bc5a-777f124f5819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:22:24 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-45c54cfc-1cd5-48cf-973d-7b59aa109f9e tempest-VolumesDeleteCascade-1494138053 None] Volume volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0 (68e17afc-a1ee-4167-91da-4382fa1bf0a0): created successfully Sep 10 21:22:24 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-45c54cfc-1cd5-48cf-973d-7b59aa109f9e tempest-VolumesDeleteCascade-1494138053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2800aa44-353c-41a3-bc5a-777f124f5819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:22:24 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-45c54cfc-1cd5-48cf-973d-7b59aa109f9e tempest-VolumesDeleteCascade-1494138053 None] Flow 'volume_create_manager' (aebbb1a4-c2f4-42a1-a35a-a14ef4dd1816) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:22:24 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-45c54cfc-1cd5-48cf-973d-7b59aa109f9e tempest-VolumesDeleteCascade-1494138053 None] Created volume successfully. Sep 10 21:22:25 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-63b95122-bead-4d29-8e25-98f7da37f625 tempest-VolumesDeleteCascade-1494138053 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:22:25 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-63b95122-bead-4d29-8e25-98f7da37f625 tempest-VolumesDeleteCascade-1494138053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:22:25 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-63b95122-bead-4d29-8e25-98f7da37f625 tempest-VolumesDeleteCascade-1494138053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:22:25 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-63b95122-bead-4d29-8e25-98f7da37f625 tempest-VolumesDeleteCascade-1494138053 None] Creating offline snapshot bd4510c3-93ce-4e78-985b-579e8cb26d4c of volume 68e17afc-a1ee-4167-91da-4382fa1bf0a0 {{(pid=82780) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 21:22:25 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed77650-853d-4cf8-aac0-b9b2d3434cbf]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:22:25 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-63b95122-bead-4d29-8e25-98f7da37f625 tempest-VolumesDeleteCascade-1494138053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:22:26 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-63b95122-bead-4d29-8e25-98f7da37f625 tempest-VolumesDeleteCascade-1494138053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0" returned: 0 in 0.569s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:22:26 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-63b95122-bead-4d29-8e25-98f7da37f625 tempest-VolumesDeleteCascade-1494138053 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0.bd4510c3-93ce-4e78-985b-579e8cb26d4c 1G {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:22:26 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=50, name=volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0.bd4510c3-93ce-4e78-985b-579e8cb26d4c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:22:26 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-63b95122-bead-4d29-8e25-98f7da37f625 tempest-VolumesDeleteCascade-1494138053 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0.bd4510c3-93ce-4e78-985b-579e8cb26d4c 1G" returned: 0 in 0.391s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:22:26 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-63b95122-bead-4d29-8e25-98f7da37f625 tempest-VolumesDeleteCascade-1494138053 None] Running cmd (subprocess): qemu-img rebase -u -b volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0 -F qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0.bd4510c3-93ce-4e78-985b-579e8cb26d4c {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:22:26 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-63b95122-bead-4d29-8e25-98f7da37f625 tempest-VolumesDeleteCascade-1494138053 None] CMD "qemu-img rebase -u -b volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0 -F qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0.bd4510c3-93ce-4e78-985b-579e8cb26d4c" returned: 0 in 0.181s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:22:26 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-63b95122-bead-4d29-8e25-98f7da37f625 tempest-VolumesDeleteCascade-1494138053 None] File path /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0.bd4510c3-93ce-4e78-985b-579e8cb26d4c is being set with permissions: 660 {{(pid=82780) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 21:22:26 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-63b95122-bead-4d29-8e25-98f7da37f625 tempest-VolumesDeleteCascade-1494138053 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0.bd4510c3-93ce-4e78-985b-579e8cb26d4c {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:22:26 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-63b95122-bead-4d29-8e25-98f7da37f625 tempest-VolumesDeleteCascade-1494138053 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0.bd4510c3-93ce-4e78-985b-579e8cb26d4c" returned: 0 in 0.103s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:22:26 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-63b95122-bead-4d29-8e25-98f7da37f625 tempest-VolumesDeleteCascade-1494138053 None] Setting permissions: /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0 -> 1000:1000 {{(pid=82780) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 21:22:26 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-63b95122-bead-4d29-8e25-98f7da37f625 tempest-VolumesDeleteCascade-1494138053 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0.bd4510c3-93ce-4e78-985b-579e8cb26d4c {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:22:27 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-63b95122-bead-4d29-8e25-98f7da37f625 tempest-VolumesDeleteCascade-1494138053 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0.bd4510c3-93ce-4e78-985b-579e8cb26d4c" returned: 0 in 0.125s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:22:27 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-63b95122-bead-4d29-8e25-98f7da37f625 tempest-VolumesDeleteCascade-1494138053 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0.info {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:22:27 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-63b95122-bead-4d29-8e25-98f7da37f625 tempest-VolumesDeleteCascade-1494138053 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0.info" returned: 0 in 0.100s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:22:27 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-63b95122-bead-4d29-8e25-98f7da37f625 tempest-VolumesDeleteCascade-1494138053 None] File path /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0.info is being set with permissions: 660 {{(pid=82780) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 21:22:27 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-63b95122-bead-4d29-8e25-98f7da37f625 tempest-VolumesDeleteCascade-1494138053 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0.info {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:22:27 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-63b95122-bead-4d29-8e25-98f7da37f625 tempest-VolumesDeleteCascade-1494138053 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0.info" returned: 0 in 0.099s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:22:27 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-63b95122-bead-4d29-8e25-98f7da37f625 tempest-VolumesDeleteCascade-1494138053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.974s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:22:27 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-63b95122-bead-4d29-8e25-98f7da37f625 tempest-VolumesDeleteCascade-1494138053 None] Create snapshot completed successfully Sep 10 21:22:29 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-86887384-549f-468b-94b7-1a23cb0728cf tempest-VolumesDeleteCascade-1494138053 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:22:29 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-86887384-549f-468b-94b7-1a23cb0728cf tempest-VolumesDeleteCascade-1494138053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:22:29 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-86887384-549f-468b-94b7-1a23cb0728cf tempest-VolumesDeleteCascade-1494138053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:22:29 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-86887384-549f-468b-94b7-1a23cb0728cf tempest-VolumesDeleteCascade-1494138053 None] Creating offline snapshot 74dc6c23-0cdf-4bf3-9a8f-54f3ca204856 of volume 68e17afc-a1ee-4167-91da-4382fa1bf0a0 {{(pid=82780) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 21:22:29 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f56678-8e4f-4424-8e6e-c7fdaa8a165f]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:22:29 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-86887384-549f-468b-94b7-1a23cb0728cf tempest-VolumesDeleteCascade-1494138053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0.bd4510c3-93ce-4e78-985b-579e8cb26d4c {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:22:29 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-86887384-549f-468b-94b7-1a23cb0728cf tempest-VolumesDeleteCascade-1494138053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0.bd4510c3-93ce-4e78-985b-579e8cb26d4c" returned: 0 in 0.529s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:22:29 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-86887384-549f-468b-94b7-1a23cb0728cf tempest-VolumesDeleteCascade-1494138053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82780) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 21:22:29 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-86887384-549f-468b-94b7-1a23cb0728cf tempest-VolumesDeleteCascade-1494138053 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0.bd4510c3-93ce-4e78-985b-579e8cb26d4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0.74dc6c23-0cdf-4bf3-9a8f-54f3ca204856 1G {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:22:30 devstack quobyte-client[82807]: System call of process 93347 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:22:30 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=52, name=volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0.74dc6c23-0cdf-4bf3-9a8f-54f3ca204856, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:22:30 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-86887384-549f-468b-94b7-1a23cb0728cf tempest-VolumesDeleteCascade-1494138053 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0.bd4510c3-93ce-4e78-985b-579e8cb26d4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0.74dc6c23-0cdf-4bf3-9a8f-54f3ca204856 1G" returned: 0 in 0.504s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:22:30 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-86887384-549f-468b-94b7-1a23cb0728cf tempest-VolumesDeleteCascade-1494138053 None] Running cmd (subprocess): qemu-img rebase -u -b volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0.bd4510c3-93ce-4e78-985b-579e8cb26d4c -F qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0.74dc6c23-0cdf-4bf3-9a8f-54f3ca204856 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:22:30 devstack quobyte-client[82807]: System call of process 93350 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:22:30 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-86887384-549f-468b-94b7-1a23cb0728cf tempest-VolumesDeleteCascade-1494138053 None] CMD "qemu-img rebase -u -b volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0.bd4510c3-93ce-4e78-985b-579e8cb26d4c -F qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0.74dc6c23-0cdf-4bf3-9a8f-54f3ca204856" returned: 0 in 0.371s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:22:30 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-86887384-549f-468b-94b7-1a23cb0728cf tempest-VolumesDeleteCascade-1494138053 None] File path /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0.74dc6c23-0cdf-4bf3-9a8f-54f3ca204856 is being set with permissions: 660 {{(pid=82780) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 21:22:30 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-86887384-549f-468b-94b7-1a23cb0728cf tempest-VolumesDeleteCascade-1494138053 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0.74dc6c23-0cdf-4bf3-9a8f-54f3ca204856 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:22:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-86887384-549f-468b-94b7-1a23cb0728cf tempest-VolumesDeleteCascade-1494138053 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0.74dc6c23-0cdf-4bf3-9a8f-54f3ca204856" returned: 0 in 0.174s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:22:31 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-86887384-549f-468b-94b7-1a23cb0728cf tempest-VolumesDeleteCascade-1494138053 None] Setting permissions: /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0.bd4510c3-93ce-4e78-985b-579e8cb26d4c -> 1000:1000 {{(pid=82780) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 21:22:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-86887384-549f-468b-94b7-1a23cb0728cf tempest-VolumesDeleteCascade-1494138053 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0.bd4510c3-93ce-4e78-985b-579e8cb26d4c /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0.74dc6c23-0cdf-4bf3-9a8f-54f3ca204856 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:22:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-86887384-549f-468b-94b7-1a23cb0728cf tempest-VolumesDeleteCascade-1494138053 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0.bd4510c3-93ce-4e78-985b-579e8cb26d4c /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0.74dc6c23-0cdf-4bf3-9a8f-54f3ca204856" returned: 0 in 0.190s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:22:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-86887384-549f-468b-94b7-1a23cb0728cf tempest-VolumesDeleteCascade-1494138053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.282s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:22:31 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-86887384-549f-468b-94b7-1a23cb0728cf tempest-VolumesDeleteCascade-1494138053 None] Create snapshot completed successfully Sep 10 21:22:32 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-79bb4d12-afac-42e0-a166-810a7674a5a9 req-85eae24f-0519-431b-8534-505c7d93a5fd tempest-TestMinimumBasicScenario-1822304413 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:22:32 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-79bb4d12-afac-42e0-a166-810a7674a5a9 req-85eae24f-0519-431b-8534-505c7d93a5fd tempest-TestMinimumBasicScenario-1822304413 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:22:32 devstack cinder-volume[82780]: INFO cinder.volume.manager [req-79bb4d12-afac-42e0-a166-810a7674a5a9 req-85eae24f-0519-431b-8534-505c7d93a5fd tempest-TestMinimumBasicScenario-1822304413 None] Terminate volume connection completed successfully. Sep 10 21:22:32 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-79bb4d12-afac-42e0-a166-810a7674a5a9 req-85eae24f-0519-431b-8534-505c7d93a5fd tempest-TestMinimumBasicScenario-1822304413 None] Deleting attachment 28828e42-5553-405a-a584-8c482fa1cd3e. {{(pid=82780) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 21:22:32 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-0d941bb1-ecf3-4948-aa9f-d32056d5bddd tempest-VolumesDeleteCascade-1494138053 None] Acquiring lock "cinder-68e17afc-a1ee-4167-91da-4382fa1bf0a0-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:22:32 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-0d941bb1-ecf3-4948-aa9f-d32056d5bddd tempest-VolumesDeleteCascade-1494138053 None] Lock "cinder-68e17afc-a1ee-4167-91da-4382fa1bf0a0-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:22:32 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-0d941bb1-ecf3-4948-aa9f-d32056d5bddd tempest-VolumesDeleteCascade-1494138053 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:22:32 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0d941bb1-ecf3-4948-aa9f-d32056d5bddd tempest-VolumesDeleteCascade-1494138053 None] Performing cascade delete. {{(pid=82780) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 10 21:22:32 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-0d941bb1-ecf3-4948-aa9f-d32056d5bddd tempest-VolumesDeleteCascade-1494138053 None] Acquiring lock "cinder-74dc6c23-0cdf-4bf3-9a8f-54f3ca204856-delete_snapshot" by "delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:22:32 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-0d941bb1-ecf3-4948-aa9f-d32056d5bddd tempest-VolumesDeleteCascade-1494138053 None] Lock "cinder-74dc6c23-0cdf-4bf3-9a8f-54f3ca204856-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:22:32 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-0d941bb1-ecf3-4948-aa9f-d32056d5bddd tempest-VolumesDeleteCascade-1494138053 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:22:32 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-0d941bb1-ecf3-4948-aa9f-d32056d5bddd tempest-VolumesDeleteCascade-1494138053 None] Acquiring lock "cinder-quobyte-68e17afc-a1ee-4167-91da-4382fa1bf0a0" by "delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:22:32 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-0d941bb1-ecf3-4948-aa9f-d32056d5bddd tempest-VolumesDeleteCascade-1494138053 None] Lock "cinder-quobyte-68e17afc-a1ee-4167-91da-4382fa1bf0a0" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:22:32 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-0d941bb1-ecf3-4948-aa9f-d32056d5bddd tempest-VolumesDeleteCascade-1494138053 None] Acquiring lock "cinder-quobyte-74dc6c23-0cdf-4bf3-9a8f-54f3ca204856" by "_delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:22:32 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-0d941bb1-ecf3-4948-aa9f-d32056d5bddd tempest-VolumesDeleteCascade-1494138053 None] Lock "cinder-quobyte-74dc6c23-0cdf-4bf3-9a8f-54f3ca204856" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:22:32 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-0d941bb1-ecf3-4948-aa9f-d32056d5bddd tempest-VolumesDeleteCascade-1494138053 None] Deleting offline snapshot 74dc6c23-0cdf-4bf3-9a8f-54f3ca204856 of volume 68e17afc-a1ee-4167-91da-4382fa1bf0a0 {{(pid=82780) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 21:22:32 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-0d941bb1-ecf3-4948-aa9f-d32056d5bddd tempest-VolumesDeleteCascade-1494138053 None] snapshot_file for this snap is: volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0.74dc6c23-0cdf-4bf3-9a8f-54f3ca204856 {{(pid=82780) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 21:22:32 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[c49386d5-358f-4919-9ca7-595bb692736c]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:22:32 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0d941bb1-ecf3-4948-aa9f-d32056d5bddd tempest-VolumesDeleteCascade-1494138053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0.74dc6c23-0cdf-4bf3-9a8f-54f3ca204856 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:22:33 devstack quobyte-client[82807]: System call of process 93358 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:22:33 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0d941bb1-ecf3-4948-aa9f-d32056d5bddd tempest-VolumesDeleteCascade-1494138053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0.74dc6c23-0cdf-4bf3-9a8f-54f3ca204856" returned: 0 in 0.505s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:22:33 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-0d941bb1-ecf3-4948-aa9f-d32056d5bddd tempest-VolumesDeleteCascade-1494138053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82780) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 21:22:33 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b44cfb9e-f4ee-43bb-9e91-06e2de87291a]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:22:33 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0d941bb1-ecf3-4948-aa9f-d32056d5bddd tempest-VolumesDeleteCascade-1494138053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0.bd4510c3-93ce-4e78-985b-579e8cb26d4c {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:22:34 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0d941bb1-ecf3-4948-aa9f-d32056d5bddd tempest-VolumesDeleteCascade-1494138053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0.bd4510c3-93ce-4e78-985b-579e8cb26d4c" returned: 0 in 0.695s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:22:34 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-0d941bb1-ecf3-4948-aa9f-d32056d5bddd tempest-VolumesDeleteCascade-1494138053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82780) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 21:22:34 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0d941bb1-ecf3-4948-aa9f-d32056d5bddd tempest-VolumesDeleteCascade-1494138053 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0.74dc6c23-0cdf-4bf3-9a8f-54f3ca204856 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:22:35 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-3997a474-a976-4a9b-852e-310d03718e05 tempest-TestMinimumBasicScenario-1822304413 None] Acquiring lock "cinder-ab5b6fa0-4676-4559-a049-c8ada1626ddf-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:22:35 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-3997a474-a976-4a9b-852e-310d03718e05 tempest-TestMinimumBasicScenario-1822304413 None] Lock "cinder-ab5b6fa0-4676-4559-a049-c8ada1626ddf-delete_volume" acquired by "delete_volume" :: waited 0.341s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:22:35 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0d941bb1-ecf3-4948-aa9f-d32056d5bddd tempest-VolumesDeleteCascade-1494138053 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0.74dc6c23-0cdf-4bf3-9a8f-54f3ca204856" returned: 0 in 1.304s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:22:35 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0d941bb1-ecf3-4948-aa9f-d32056d5bddd tempest-VolumesDeleteCascade-1494138053 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0.74dc6c23-0cdf-4bf3-9a8f-54f3ca204856 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:22:36 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-3997a474-a976-4a9b-852e-310d03718e05 tempest-TestMinimumBasicScenario-1822304413 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:22:36 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-3997a474-a976-4a9b-852e-310d03718e05 tempest-TestMinimumBasicScenario-1822304413 None] Acquiring lock "cinder-quobyte-ab5b6fa0-4676-4559-a049-c8ada1626ddf" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:22:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0d941bb1-ecf3-4948-aa9f-d32056d5bddd tempest-VolumesDeleteCascade-1494138053 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0.74dc6c23-0cdf-4bf3-9a8f-54f3ca204856" returned: 0 in 0.630s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:22:36 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-0d941bb1-ecf3-4948-aa9f-d32056d5bddd tempest-VolumesDeleteCascade-1494138053 None] Lock "cinder-quobyte-74dc6c23-0cdf-4bf3-9a8f-54f3ca204856" released by "_delete_snapshot" :: held 3.456s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:22:36 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-3997a474-a976-4a9b-852e-310d03718e05 tempest-TestMinimumBasicScenario-1822304413 None] Lock "cinder-quobyte-ab5b6fa0-4676-4559-a049-c8ada1626ddf" acquired by "delete_volume" :: waited 0.147s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:22:36 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ae2918-fc81-4499-b749-bb2acbaeea37]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:22:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-3997a474-a976-4a9b-852e-310d03718e05 tempest-TestMinimumBasicScenario-1822304413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ab5b6fa0-4676-4559-a049-c8ada1626ddf {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:22:36 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-0d941bb1-ecf3-4948-aa9f-d32056d5bddd tempest-VolumesDeleteCascade-1494138053 None] Lock "cinder-quobyte-68e17afc-a1ee-4167-91da-4382fa1bf0a0" released by "delete_snapshot" :: held 3.658s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:22:36 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-fe2031fc-8652-4c18-b1a6-28b236ceed38 tempest-AttachVolumeTestJSON-828295401 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:22:36 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe2031fc-8652-4c18-b1a6-28b236ceed38 tempest-AttachVolumeTestJSON-828295401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:22:36 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fe2031fc-8652-4c18-b1a6-28b236ceed38 tempest-AttachVolumeTestJSON-828295401 None] Flow 'volume_create_manager' (2b91d5d8-08f1-4a3f-b565-01e4f2d4af5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:22:36 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fe2031fc-8652-4c18-b1a6-28b236ceed38 tempest-AttachVolumeTestJSON-828295401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d538aea5-c779-40ba-b9f1-aa52cc6baef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:22:37 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fe2031fc-8652-4c18-b1a6-28b236ceed38 tempest-AttachVolumeTestJSON-828295401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d538aea5-c779-40ba-b9f1-aa52cc6baef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:22:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-669033913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ebd7362-cfa2-4f6b-b11f-726ee8859067,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca9244a504ae49c69b10542efaeba576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:22:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:22:36Z,use_quota=True,user_id='bc73940cbe674db99581f2d99ba44839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:22:37 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fe2031fc-8652-4c18-b1a6-28b236ceed38 tempest-AttachVolumeTestJSON-828295401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5134eff5-9b59-45e3-9df3-0a35bf00e2f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:22:37 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fe2031fc-8652-4c18-b1a6-28b236ceed38 tempest-AttachVolumeTestJSON-828295401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5134eff5-9b59-45e3-9df3-0a35bf00e2f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:22:37 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fe2031fc-8652-4c18-b1a6-28b236ceed38 tempest-AttachVolumeTestJSON-828295401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff56eb38-4ded-4a75-b985-3b149b2b77b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:22:37 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fe2031fc-8652-4c18-b1a6-28b236ceed38 tempest-AttachVolumeTestJSON-828295401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff56eb38-4ded-4a75-b985-3b149b2b77b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ebd7362-cfa2-4f6b-b11f-726ee8859067', 'volume_name': 'volume-6ebd7362-cfa2-4f6b-b11f-726ee8859067', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:22:37 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fe2031fc-8652-4c18-b1a6-28b236ceed38 tempest-AttachVolumeTestJSON-828295401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e5fa066-72c6-4b29-b50f-64163a99ba73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:22:37 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fe2031fc-8652-4c18-b1a6-28b236ceed38 tempest-AttachVolumeTestJSON-828295401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e5fa066-72c6-4b29-b50f-64163a99ba73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:22:37 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fe2031fc-8652-4c18-b1a6-28b236ceed38 tempest-AttachVolumeTestJSON-828295401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce05cb20-c1e7-4385-b17e-4222999e3b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:22:37 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-fe2031fc-8652-4c18-b1a6-28b236ceed38 tempest-AttachVolumeTestJSON-828295401 None] Volume 6ebd7362-cfa2-4f6b-b11f-726ee8859067: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ebd7362-cfa2-4f6b-b11f-726ee8859067', 'volume_size': 1} Sep 10 21:22:37 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-fe2031fc-8652-4c18-b1a6-28b236ceed38 tempest-AttachVolumeTestJSON-828295401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:22:37 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-fe2031fc-8652-4c18-b1a6-28b236ceed38 tempest-AttachVolumeTestJSON-828295401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:22:37 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-fe2031fc-8652-4c18-b1a6-28b236ceed38 tempest-AttachVolumeTestJSON-828295401 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:22:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-669033913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ebd7362-cfa2-4f6b-b11f-726ee8859067,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca9244a504ae49c69b10542efaeba576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:22:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:22:36Z,use_quota=True,user_id='bc73940cbe674db99581f2d99ba44839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:22:37 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-fe2031fc-8652-4c18-b1a6-28b236ceed38 tempest-AttachVolumeTestJSON-828295401 None] Creating volume 6ebd7362-cfa2-4f6b-b11f-726ee8859067 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:22:37 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-fe2031fc-8652-4c18-b1a6-28b236ceed38 tempest-AttachVolumeTestJSON-828295401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:22:37 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-fe2031fc-8652-4c18-b1a6-28b236ceed38 tempest-AttachVolumeTestJSON-828295401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:22:37 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-fe2031fc-8652-4c18-b1a6-28b236ceed38 tempest-AttachVolumeTestJSON-828295401 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:22:37 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-fe2031fc-8652-4c18-b1a6-28b236ceed38 tempest-AttachVolumeTestJSON-828295401 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:22:37 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-fe2031fc-8652-4c18-b1a6-28b236ceed38 tempest-AttachVolumeTestJSON-828295401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:22:37 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-fe2031fc-8652-4c18-b1a6-28b236ceed38 tempest-AttachVolumeTestJSON-828295401 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:22:37 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-fe2031fc-8652-4c18-b1a6-28b236ceed38 tempest-AttachVolumeTestJSON-828295401 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:22:37 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-fe2031fc-8652-4c18-b1a6-28b236ceed38 tempest-AttachVolumeTestJSON-828295401 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-6ebd7362-cfa2-4f6b-b11f-726ee8859067 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:22:37 devstack quobyte-client[82807]: System call of process 93411 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:22:37 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=53, name=volume-6ebd7362-cfa2-4f6b-b11f-726ee8859067, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:22:37 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-3997a474-a976-4a9b-852e-310d03718e05 tempest-TestMinimumBasicScenario-1822304413 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ab5b6fa0-4676-4559-a049-c8ada1626ddf" returned: 0 in 1.212s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:22:37 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-3997a474-a976-4a9b-852e-310d03718e05 tempest-TestMinimumBasicScenario-1822304413 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ab5b6fa0-4676-4559-a049-c8ada1626ddf {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:22:37 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-fe2031fc-8652-4c18-b1a6-28b236ceed38 tempest-AttachVolumeTestJSON-828295401 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-6ebd7362-cfa2-4f6b-b11f-726ee8859067 1073741824" returned: 0 in 0.809s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:22:37 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-fe2031fc-8652-4c18-b1a6-28b236ceed38 tempest-AttachVolumeTestJSON-828295401 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-6ebd7362-cfa2-4f6b-b11f-726ee8859067 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:22:38 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-3997a474-a976-4a9b-852e-310d03718e05 tempest-TestMinimumBasicScenario-1822304413 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ab5b6fa0-4676-4559-a049-c8ada1626ddf" returned: 0 in 0.460s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:22:38 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-0d941bb1-ecf3-4948-aa9f-d32056d5bddd tempest-VolumesDeleteCascade-1494138053 None] Created reservations ['9222483b-ff16-4f9e-9663-9a529f0cae04', 'c188aa3c-8e46-4d58-8efb-c70b62353978', '882f4b03-d3fd-4a3c-b587-7b9a53916180', 'e9b9b9cf-1025-4c11-9740-eb3b7e68ae69'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:22:38 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-fe2031fc-8652-4c18-b1a6-28b236ceed38 tempest-AttachVolumeTestJSON-828295401 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-6ebd7362-cfa2-4f6b-b11f-726ee8859067" returned: 0 in 0.414s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:22:38 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-fe2031fc-8652-4c18-b1a6-28b236ceed38 tempest-AttachVolumeTestJSON-828295401 None] <== create_volume: return (1273ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:22:38 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-fe2031fc-8652-4c18-b1a6-28b236ceed38 tempest-AttachVolumeTestJSON-828295401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.283s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:22:38 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-3997a474-a976-4a9b-852e-310d03718e05 tempest-TestMinimumBasicScenario-1822304413 None] Lock "cinder-quobyte-ab5b6fa0-4676-4559-a049-c8ada1626ddf" released by "delete_volume" :: held 2.063s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:22:38 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fe2031fc-8652-4c18-b1a6-28b236ceed38 tempest-AttachVolumeTestJSON-828295401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce05cb20-c1e7-4385-b17e-4222999e3b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ebd7362-cfa2-4f6b-b11f-726ee8859067', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:22:38 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fe2031fc-8652-4c18-b1a6-28b236ceed38 tempest-AttachVolumeTestJSON-828295401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17a1bf0d-781a-4693-ab77-3f02c44fccda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:22:38 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-fe2031fc-8652-4c18-b1a6-28b236ceed38 tempest-AttachVolumeTestJSON-828295401 None] Volume volume-6ebd7362-cfa2-4f6b-b11f-726ee8859067 (6ebd7362-cfa2-4f6b-b11f-726ee8859067): created successfully Sep 10 21:22:38 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fe2031fc-8652-4c18-b1a6-28b236ceed38 tempest-AttachVolumeTestJSON-828295401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17a1bf0d-781a-4693-ab77-3f02c44fccda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:22:38 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fe2031fc-8652-4c18-b1a6-28b236ceed38 tempest-AttachVolumeTestJSON-828295401 None] Flow 'volume_create_manager' (2b91d5d8-08f1-4a3f-b565-01e4f2d4af5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:22:38 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-3997a474-a976-4a9b-852e-310d03718e05 tempest-TestMinimumBasicScenario-1822304413 None] Created reservations ['b816b4ac-f37e-4a0d-8122-03ff068f0331', '09afba3a-130c-4b3c-9d5d-129c47dae350', 'f0ea82e2-93f6-4e0f-8855-fedae47ce34e', 'a3a36d04-b149-4974-aaa3-30680275d8bd'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:22:38 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-fe2031fc-8652-4c18-b1a6-28b236ceed38 tempest-AttachVolumeTestJSON-828295401 None] Created volume successfully. Sep 10 21:22:38 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-0d941bb1-ecf3-4948-aa9f-d32056d5bddd tempest-VolumesDeleteCascade-1494138053 None] Delete snapshot completed successfully. Sep 10 21:22:38 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-0d941bb1-ecf3-4948-aa9f-d32056d5bddd tempest-VolumesDeleteCascade-1494138053 None] Lock "cinder-74dc6c23-0cdf-4bf3-9a8f-54f3ca204856-delete_snapshot" released by "delete_snapshot" :: held 5.969s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:22:38 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-0d941bb1-ecf3-4948-aa9f-d32056d5bddd tempest-VolumesDeleteCascade-1494138053 None] Acquiring lock "cinder-bd4510c3-93ce-4e78-985b-579e8cb26d4c-delete_snapshot" by "delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:22:38 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-0d941bb1-ecf3-4948-aa9f-d32056d5bddd tempest-VolumesDeleteCascade-1494138053 None] Lock "cinder-bd4510c3-93ce-4e78-985b-579e8cb26d4c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:22:38 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-0d941bb1-ecf3-4948-aa9f-d32056d5bddd tempest-VolumesDeleteCascade-1494138053 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:22:38 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-0d941bb1-ecf3-4948-aa9f-d32056d5bddd tempest-VolumesDeleteCascade-1494138053 None] Acquiring lock "cinder-quobyte-68e17afc-a1ee-4167-91da-4382fa1bf0a0" by "delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:22:38 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-0d941bb1-ecf3-4948-aa9f-d32056d5bddd tempest-VolumesDeleteCascade-1494138053 None] Lock "cinder-quobyte-68e17afc-a1ee-4167-91da-4382fa1bf0a0" acquired by "delete_snapshot" :: waited 0.021s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:22:38 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-0d941bb1-ecf3-4948-aa9f-d32056d5bddd tempest-VolumesDeleteCascade-1494138053 None] Acquiring lock "cinder-quobyte-bd4510c3-93ce-4e78-985b-579e8cb26d4c" by "_delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:22:38 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-3997a474-a976-4a9b-852e-310d03718e05 tempest-TestMinimumBasicScenario-1822304413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:22:38 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-3997a474-a976-4a9b-852e-310d03718e05 tempest-TestMinimumBasicScenario-1822304413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:22:38 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-3997a474-a976-4a9b-852e-310d03718e05 tempest-TestMinimumBasicScenario-1822304413 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:22:38 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-3997a474-a976-4a9b-852e-310d03718e05 tempest-TestMinimumBasicScenario-1822304413 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:22:38 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-3997a474-a976-4a9b-852e-310d03718e05 tempest-TestMinimumBasicScenario-1822304413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:22:38 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-3997a474-a976-4a9b-852e-310d03718e05 tempest-TestMinimumBasicScenario-1822304413 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:22:39 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-0d941bb1-ecf3-4948-aa9f-d32056d5bddd tempest-VolumesDeleteCascade-1494138053 None] Lock "cinder-quobyte-bd4510c3-93ce-4e78-985b-579e8cb26d4c" acquired by "_delete_snapshot" :: waited 0.153s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:22:39 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-0d941bb1-ecf3-4948-aa9f-d32056d5bddd tempest-VolumesDeleteCascade-1494138053 None] Deleting offline snapshot bd4510c3-93ce-4e78-985b-579e8cb26d4c of volume 68e17afc-a1ee-4167-91da-4382fa1bf0a0 {{(pid=82780) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 21:22:39 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-0d941bb1-ecf3-4948-aa9f-d32056d5bddd tempest-VolumesDeleteCascade-1494138053 None] snapshot_file for this snap is: volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0.bd4510c3-93ce-4e78-985b-579e8cb26d4c {{(pid=82780) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 21:22:39 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5b7d13-6607-446b-8dd6-cbc56ed2644d]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:22:39 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0d941bb1-ecf3-4948-aa9f-d32056d5bddd tempest-VolumesDeleteCascade-1494138053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0.bd4510c3-93ce-4e78-985b-579e8cb26d4c {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:22:39 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-3997a474-a976-4a9b-852e-310d03718e05 tempest-TestMinimumBasicScenario-1822304413 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.308s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:22:39 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-3997a474-a976-4a9b-852e-310d03718e05 tempest-TestMinimumBasicScenario-1822304413 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:22:39 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-3997a474-a976-4a9b-852e-310d03718e05 tempest-TestMinimumBasicScenario-1822304413 None] Deleted volume successfully. Sep 10 21:22:39 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-3997a474-a976-4a9b-852e-310d03718e05 tempest-TestMinimumBasicScenario-1822304413 None] Lock "cinder-ab5b6fa0-4676-4559-a049-c8ada1626ddf-delete_volume" released by "delete_volume" :: held 4.342s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:22:39 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0d941bb1-ecf3-4948-aa9f-d32056d5bddd tempest-VolumesDeleteCascade-1494138053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0.bd4510c3-93ce-4e78-985b-579e8cb26d4c" returned: 0 in 0.720s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:22:39 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-0d941bb1-ecf3-4948-aa9f-d32056d5bddd tempest-VolumesDeleteCascade-1494138053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82780) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 21:22:39 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ba4b8e-80f8-4f38-96f2-1aa423258580]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:22:39 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0d941bb1-ecf3-4948-aa9f-d32056d5bddd tempest-VolumesDeleteCascade-1494138053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:22:40 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0d941bb1-ecf3-4948-aa9f-d32056d5bddd tempest-VolumesDeleteCascade-1494138053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0" returned: 0 in 0.548s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:22:40 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0d941bb1-ecf3-4948-aa9f-d32056d5bddd tempest-VolumesDeleteCascade-1494138053 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0.bd4510c3-93ce-4e78-985b-579e8cb26d4c {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:22:40 devstack quobyte-client[82807]: System call of process 93434 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:22:40 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0d941bb1-ecf3-4948-aa9f-d32056d5bddd tempest-VolumesDeleteCascade-1494138053 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0.bd4510c3-93ce-4e78-985b-579e8cb26d4c" returned: 0 in 0.394s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:22:40 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0d941bb1-ecf3-4948-aa9f-d32056d5bddd tempest-VolumesDeleteCascade-1494138053 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0.bd4510c3-93ce-4e78-985b-579e8cb26d4c {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:22:41 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0d941bb1-ecf3-4948-aa9f-d32056d5bddd tempest-VolumesDeleteCascade-1494138053 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0.bd4510c3-93ce-4e78-985b-579e8cb26d4c" returned: 0 in 0.159s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:22:41 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-0d941bb1-ecf3-4948-aa9f-d32056d5bddd tempest-VolumesDeleteCascade-1494138053 None] Lock "cinder-quobyte-bd4510c3-93ce-4e78-985b-579e8cb26d4c" released by "_delete_snapshot" :: held 2.251s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:22:41 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-0d941bb1-ecf3-4948-aa9f-d32056d5bddd tempest-VolumesDeleteCascade-1494138053 None] Lock "cinder-quobyte-68e17afc-a1ee-4167-91da-4382fa1bf0a0" released by "delete_snapshot" :: held 2.421s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:22:41 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-0d941bb1-ecf3-4948-aa9f-d32056d5bddd tempest-VolumesDeleteCascade-1494138053 None] Created reservations ['93e1b7a4-71f2-49fc-8e75-71efc5010d53', '2ef7c2cd-0765-4efa-80db-5548f49bca64', '711898c1-e7a3-4a53-a277-4d335302f322', '42e6669f-e26c-4c09-bee2-0a89cf79f33d'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:22:42 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-0d941bb1-ecf3-4948-aa9f-d32056d5bddd tempest-VolumesDeleteCascade-1494138053 None] Delete snapshot completed successfully. Sep 10 21:22:42 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-0d941bb1-ecf3-4948-aa9f-d32056d5bddd tempest-VolumesDeleteCascade-1494138053 None] Lock "cinder-bd4510c3-93ce-4e78-985b-579e8cb26d4c-delete_snapshot" released by "delete_snapshot" :: held 3.841s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:22:42 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0d941bb1-ecf3-4948-aa9f-d32056d5bddd tempest-VolumesDeleteCascade-1494138053 None] Snapshots deleted, issuing volume delete {{(pid=82780) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 10 21:22:42 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-0d941bb1-ecf3-4948-aa9f-d32056d5bddd tempest-VolumesDeleteCascade-1494138053 None] Acquiring lock "cinder-quobyte-68e17afc-a1ee-4167-91da-4382fa1bf0a0" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:22:43 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-0d941bb1-ecf3-4948-aa9f-d32056d5bddd tempest-VolumesDeleteCascade-1494138053 None] Lock "cinder-quobyte-68e17afc-a1ee-4167-91da-4382fa1bf0a0" acquired by "delete_volume" :: waited 0.284s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:22:43 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9058de-97d6-4158-8c3f-bf05432d9e3d]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:22:43 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0d941bb1-ecf3-4948-aa9f-d32056d5bddd tempest-VolumesDeleteCascade-1494138053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:22:44 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0d941bb1-ecf3-4948-aa9f-d32056d5bddd tempest-VolumesDeleteCascade-1494138053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0" returned: 0 in 1.226s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:22:44 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0d941bb1-ecf3-4948-aa9f-d32056d5bddd tempest-VolumesDeleteCascade-1494138053 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:22:44 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0d941bb1-ecf3-4948-aa9f-d32056d5bddd tempest-VolumesDeleteCascade-1494138053 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-68e17afc-a1ee-4167-91da-4382fa1bf0a0" returned: 0 in 0.171s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:22:44 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-0d941bb1-ecf3-4948-aa9f-d32056d5bddd tempest-VolumesDeleteCascade-1494138053 None] Lock "cinder-quobyte-68e17afc-a1ee-4167-91da-4382fa1bf0a0" released by "delete_volume" :: held 1.870s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:22:45 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-0d941bb1-ecf3-4948-aa9f-d32056d5bddd tempest-VolumesDeleteCascade-1494138053 None] Created reservations ['124e785e-cd33-4aa2-a3d4-c12be1a9ce46', '864d3f88-c2c8-4cb8-bb13-77a32e3f6399', '81916f9f-ebb8-4d34-8567-6a30690a4bd4', '6902df35-b29c-40f7-8e65-0425fa1f4baa'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:22:45 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-0d941bb1-ecf3-4948-aa9f-d32056d5bddd tempest-VolumesDeleteCascade-1494138053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:22:45 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-0d941bb1-ecf3-4948-aa9f-d32056d5bddd tempest-VolumesDeleteCascade-1494138053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:22:45 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-0d941bb1-ecf3-4948-aa9f-d32056d5bddd tempest-VolumesDeleteCascade-1494138053 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:22:45 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-0d941bb1-ecf3-4948-aa9f-d32056d5bddd tempest-VolumesDeleteCascade-1494138053 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:22:45 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-0d941bb1-ecf3-4948-aa9f-d32056d5bddd tempest-VolumesDeleteCascade-1494138053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:22:45 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0d941bb1-ecf3-4948-aa9f-d32056d5bddd tempest-VolumesDeleteCascade-1494138053 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:22:46 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0d941bb1-ecf3-4948-aa9f-d32056d5bddd tempest-VolumesDeleteCascade-1494138053 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.270s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:22:46 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-0d941bb1-ecf3-4948-aa9f-d32056d5bddd tempest-VolumesDeleteCascade-1494138053 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:22:46 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-0d941bb1-ecf3-4948-aa9f-d32056d5bddd tempest-VolumesDeleteCascade-1494138053 None] Deleted volume successfully. Sep 10 21:22:46 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-0d941bb1-ecf3-4948-aa9f-d32056d5bddd tempest-VolumesDeleteCascade-1494138053 None] Lock "cinder-68e17afc-a1ee-4167-91da-4382fa1bf0a0-delete_volume" released by "delete_volume" :: held 14.055s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:22:47 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-15ef77d0-2aa7-409f-a7ef-ff42524ef8e5 tempest-VolumesDeleteCascade-1494138053 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:22:47 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-15ef77d0-2aa7-409f-a7ef-ff42524ef8e5 tempest-VolumesDeleteCascade-1494138053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:22:48 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-15ef77d0-2aa7-409f-a7ef-ff42524ef8e5 tempest-VolumesDeleteCascade-1494138053 None] Flow 'volume_create_manager' (6874f4b8-6cbf-4b5a-91ae-b6317162e897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:22:48 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-15ef77d0-2aa7-409f-a7ef-ff42524ef8e5 tempest-VolumesDeleteCascade-1494138053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3df22497-10e5-4196-9576-a68b35616263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:22:48 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-15ef77d0-2aa7-409f-a7ef-ff42524ef8e5 tempest-VolumesDeleteCascade-1494138053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3df22497-10e5-4196-9576-a68b35616263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:22:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1824853980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='083a5092296b4e6a9429bbe18accf37f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:22:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:22:48Z,use_quota=True,user_id='16d5db5db8304b799ba29fa3d7ae5f68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:22:48 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-15ef77d0-2aa7-409f-a7ef-ff42524ef8e5 tempest-VolumesDeleteCascade-1494138053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1335c1d6-3d7d-4a48-8fe0-d31449658b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:22:48 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-15ef77d0-2aa7-409f-a7ef-ff42524ef8e5 tempest-VolumesDeleteCascade-1494138053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1335c1d6-3d7d-4a48-8fe0-d31449658b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:22:48 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-15ef77d0-2aa7-409f-a7ef-ff42524ef8e5 tempest-VolumesDeleteCascade-1494138053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5229a1d0-5699-4a6a-aae7-36045178569e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:22:48 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-15ef77d0-2aa7-409f-a7ef-ff42524ef8e5 tempest-VolumesDeleteCascade-1494138053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5229a1d0-5699-4a6a-aae7-36045178569e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8', 'volume_name': 'volume-a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:22:48 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-15ef77d0-2aa7-409f-a7ef-ff42524ef8e5 tempest-VolumesDeleteCascade-1494138053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56d7ec9c-dcd6-4968-a9f2-fe1e13e45b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:22:48 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-15ef77d0-2aa7-409f-a7ef-ff42524ef8e5 tempest-VolumesDeleteCascade-1494138053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56d7ec9c-dcd6-4968-a9f2-fe1e13e45b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:22:48 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-15ef77d0-2aa7-409f-a7ef-ff42524ef8e5 tempest-VolumesDeleteCascade-1494138053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b80cde18-149a-4a8c-bf41-9e754bb8a984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:22:48 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-15ef77d0-2aa7-409f-a7ef-ff42524ef8e5 tempest-VolumesDeleteCascade-1494138053 None] Volume a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8', 'volume_size': 1} Sep 10 21:22:48 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-15ef77d0-2aa7-409f-a7ef-ff42524ef8e5 tempest-VolumesDeleteCascade-1494138053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:22:48 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-15ef77d0-2aa7-409f-a7ef-ff42524ef8e5 tempest-VolumesDeleteCascade-1494138053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:22:48 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-15ef77d0-2aa7-409f-a7ef-ff42524ef8e5 tempest-VolumesDeleteCascade-1494138053 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:22:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1824853980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='083a5092296b4e6a9429bbe18accf37f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:22:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:22:48Z,use_quota=True,user_id='16d5db5db8304b799ba29fa3d7ae5f68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:22:48 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-15ef77d0-2aa7-409f-a7ef-ff42524ef8e5 tempest-VolumesDeleteCascade-1494138053 None] Creating volume a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:22:48 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-15ef77d0-2aa7-409f-a7ef-ff42524ef8e5 tempest-VolumesDeleteCascade-1494138053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:22:48 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-15ef77d0-2aa7-409f-a7ef-ff42524ef8e5 tempest-VolumesDeleteCascade-1494138053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:22:48 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-15ef77d0-2aa7-409f-a7ef-ff42524ef8e5 tempest-VolumesDeleteCascade-1494138053 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:22:48 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-15ef77d0-2aa7-409f-a7ef-ff42524ef8e5 tempest-VolumesDeleteCascade-1494138053 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:22:48 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-15ef77d0-2aa7-409f-a7ef-ff42524ef8e5 tempest-VolumesDeleteCascade-1494138053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:22:48 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-15ef77d0-2aa7-409f-a7ef-ff42524ef8e5 tempest-VolumesDeleteCascade-1494138053 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:22:48 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-15ef77d0-2aa7-409f-a7ef-ff42524ef8e5 tempest-VolumesDeleteCascade-1494138053 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:22:48 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-15ef77d0-2aa7-409f-a7ef-ff42524ef8e5 tempest-VolumesDeleteCascade-1494138053 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:22:48 devstack quobyte-client[82807]: System call of process 93502 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:22:48 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=54, name=volume-a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:22:49 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-0bc73c6d-4a28-42a1-b4da-857a8015a9f7 req-5dd2ec9a-676c-4daf-9299-e41c4ed5b992 tempest-AttachVolumeTestJSON-828295401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:22:49 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-15ef77d0-2aa7-409f-a7ef-ff42524ef8e5 tempest-VolumesDeleteCascade-1494138053 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8 1073741824" returned: 0 in 0.869s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:22:49 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-15ef77d0-2aa7-409f-a7ef-ff42524ef8e5 tempest-VolumesDeleteCascade-1494138053 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:22:49 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-15ef77d0-2aa7-409f-a7ef-ff42524ef8e5 tempest-VolumesDeleteCascade-1494138053 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8" returned: 0 in 0.145s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:22:49 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-15ef77d0-2aa7-409f-a7ef-ff42524ef8e5 tempest-VolumesDeleteCascade-1494138053 None] <== create_volume: return (1073ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:22:49 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-15ef77d0-2aa7-409f-a7ef-ff42524ef8e5 tempest-VolumesDeleteCascade-1494138053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:22:49 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-0bc73c6d-4a28-42a1-b4da-857a8015a9f7 req-5dd2ec9a-676c-4daf-9299-e41c4ed5b992 tempest-AttachVolumeTestJSON-828295401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.413s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:22:49 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aca557b-0a5a-4804-83a2-ed9acd0f0854]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:22:49 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-0bc73c6d-4a28-42a1-b4da-857a8015a9f7 req-5dd2ec9a-676c-4daf-9299-e41c4ed5b992 tempest-AttachVolumeTestJSON-828295401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-6ebd7362-cfa2-4f6b-b11f-726ee8859067 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:22:49 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-15ef77d0-2aa7-409f-a7ef-ff42524ef8e5 tempest-VolumesDeleteCascade-1494138053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b80cde18-149a-4a8c-bf41-9e754bb8a984) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:22:50 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-15ef77d0-2aa7-409f-a7ef-ff42524ef8e5 tempest-VolumesDeleteCascade-1494138053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81a4ccb1-b503-4d71-9c2a-682af41b3d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:22:50 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-15ef77d0-2aa7-409f-a7ef-ff42524ef8e5 tempest-VolumesDeleteCascade-1494138053 None] Volume volume-a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8 (a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8): created successfully Sep 10 21:22:50 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-15ef77d0-2aa7-409f-a7ef-ff42524ef8e5 tempest-VolumesDeleteCascade-1494138053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81a4ccb1-b503-4d71-9c2a-682af41b3d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:22:50 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-15ef77d0-2aa7-409f-a7ef-ff42524ef8e5 tempest-VolumesDeleteCascade-1494138053 None] Flow 'volume_create_manager' (6874f4b8-6cbf-4b5a-91ae-b6317162e897) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:22:50 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-15ef77d0-2aa7-409f-a7ef-ff42524ef8e5 tempest-VolumesDeleteCascade-1494138053 None] Created volume successfully. Sep 10 21:22:50 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-0bc73c6d-4a28-42a1-b4da-857a8015a9f7 req-5dd2ec9a-676c-4daf-9299-e41c4ed5b992 tempest-AttachVolumeTestJSON-828295401 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-6ebd7362-cfa2-4f6b-b11f-726ee8859067" returned: 0 in 0.769s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:22:50 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-0bc73c6d-4a28-42a1-b4da-857a8015a9f7 req-5dd2ec9a-676c-4daf-9299-e41c4ed5b992 tempest-AttachVolumeTestJSON-828295401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.842s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:22:50 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-0bc73c6d-4a28-42a1-b4da-857a8015a9f7 req-5dd2ec9a-676c-4daf-9299-e41c4ed5b992 tempest-AttachVolumeTestJSON-828295401 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b', 'name': 'volume-6ebd7362-cfa2-4f6b-b11f-726ee8859067', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2a1db3eb-f92a-44b4-b3a3-f7ae3bd1a135', 'enforce_multipath': True} {{(pid=82780) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 21:22:50 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-0bc73c6d-4a28-42a1-b4da-857a8015a9f7 req-5dd2ec9a-676c-4daf-9299-e41c4ed5b992 tempest-AttachVolumeTestJSON-828295401 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:22:50 devstack cinder-volume[82780]: INFO cinder.volume.manager [req-0bc73c6d-4a28-42a1-b4da-857a8015a9f7 req-5dd2ec9a-676c-4daf-9299-e41c4ed5b992 tempest-AttachVolumeTestJSON-828295401 None] attachment_update completed successfully. Sep 10 21:22:51 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-eb9acc41-b926-4ba7-98ce-1b08d440e067 tempest-VolumesDeleteCascade-1494138053 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:22:51 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-eb9acc41-b926-4ba7-98ce-1b08d440e067 tempest-VolumesDeleteCascade-1494138053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:22:51 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-eb9acc41-b926-4ba7-98ce-1b08d440e067 tempest-VolumesDeleteCascade-1494138053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:22:51 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-eb9acc41-b926-4ba7-98ce-1b08d440e067 tempest-VolumesDeleteCascade-1494138053 None] Creating offline snapshot cd729f5f-f2f1-49e6-96fa-7166869ce963 of volume a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8 {{(pid=82780) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 21:22:51 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a408075-310a-49b6-b8ea-58c3f6ea6c8a]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:22:51 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-eb9acc41-b926-4ba7-98ce-1b08d440e067 tempest-VolumesDeleteCascade-1494138053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:22:52 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-eb9acc41-b926-4ba7-98ce-1b08d440e067 tempest-VolumesDeleteCascade-1494138053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8" returned: 0 in 0.557s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:22:52 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-eb9acc41-b926-4ba7-98ce-1b08d440e067 tempest-VolumesDeleteCascade-1494138053 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8.cd729f5f-f2f1-49e6-96fa-7166869ce963 1G {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:22:52 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=55, name=volume-a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8.cd729f5f-f2f1-49e6-96fa-7166869ce963, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:22:52 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-eb9acc41-b926-4ba7-98ce-1b08d440e067 tempest-VolumesDeleteCascade-1494138053 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8.cd729f5f-f2f1-49e6-96fa-7166869ce963 1G" returned: 0 in 0.277s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:22:52 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-eb9acc41-b926-4ba7-98ce-1b08d440e067 tempest-VolumesDeleteCascade-1494138053 None] Running cmd (subprocess): qemu-img rebase -u -b volume-a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8 -F qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8.cd729f5f-f2f1-49e6-96fa-7166869ce963 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:22:52 devstack quobyte-client[82807]: System call of process 93585 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:22:53 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-eb9acc41-b926-4ba7-98ce-1b08d440e067 tempest-VolumesDeleteCascade-1494138053 None] CMD "qemu-img rebase -u -b volume-a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8 -F qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8.cd729f5f-f2f1-49e6-96fa-7166869ce963" returned: 0 in 0.334s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:22:53 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-eb9acc41-b926-4ba7-98ce-1b08d440e067 tempest-VolumesDeleteCascade-1494138053 None] File path /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8.cd729f5f-f2f1-49e6-96fa-7166869ce963 is being set with permissions: 660 {{(pid=82780) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 21:22:53 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-eb9acc41-b926-4ba7-98ce-1b08d440e067 tempest-VolumesDeleteCascade-1494138053 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8.cd729f5f-f2f1-49e6-96fa-7166869ce963 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:22:53 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-eb9acc41-b926-4ba7-98ce-1b08d440e067 tempest-VolumesDeleteCascade-1494138053 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8.cd729f5f-f2f1-49e6-96fa-7166869ce963" returned: 0 in 0.134s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:22:53 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-eb9acc41-b926-4ba7-98ce-1b08d440e067 tempest-VolumesDeleteCascade-1494138053 None] Setting permissions: /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8 -> 1000:1000 {{(pid=82780) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 21:22:53 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-eb9acc41-b926-4ba7-98ce-1b08d440e067 tempest-VolumesDeleteCascade-1494138053 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8.cd729f5f-f2f1-49e6-96fa-7166869ce963 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:22:53 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-eb9acc41-b926-4ba7-98ce-1b08d440e067 tempest-VolumesDeleteCascade-1494138053 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8.cd729f5f-f2f1-49e6-96fa-7166869ce963" returned: 0 in 0.131s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:22:53 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-eb9acc41-b926-4ba7-98ce-1b08d440e067 tempest-VolumesDeleteCascade-1494138053 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8.info {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:22:53 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-eb9acc41-b926-4ba7-98ce-1b08d440e067 tempest-VolumesDeleteCascade-1494138053 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8.info" returned: 0 in 0.111s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:22:53 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-eb9acc41-b926-4ba7-98ce-1b08d440e067 tempest-VolumesDeleteCascade-1494138053 None] File path /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8.info is being set with permissions: 660 {{(pid=82780) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 21:22:53 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-eb9acc41-b926-4ba7-98ce-1b08d440e067 tempest-VolumesDeleteCascade-1494138053 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8.info {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:22:53 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-eb9acc41-b926-4ba7-98ce-1b08d440e067 tempest-VolumesDeleteCascade-1494138053 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8.info" returned: 0 in 0.123s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:22:53 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-eb9acc41-b926-4ba7-98ce-1b08d440e067 tempest-VolumesDeleteCascade-1494138053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.098s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:22:54 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-eb9acc41-b926-4ba7-98ce-1b08d440e067 tempest-VolumesDeleteCascade-1494138053 None] Create snapshot completed successfully Sep 10 21:22:55 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:UPDATE=44,cinder:DELETE=6,cinder:SELECT=39,cinder:INSERT=12 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:22:55 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-1b2152b8-92fb-48e8-810b-7001ed8aa267 tempest-VolumesDeleteCascade-1494138053 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:22:55 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b2152b8-92fb-48e8-810b-7001ed8aa267 tempest-VolumesDeleteCascade-1494138053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:22:55 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1b2152b8-92fb-48e8-810b-7001ed8aa267 tempest-VolumesDeleteCascade-1494138053 None] Flow 'volume_create_manager' (89e5ed90-441a-4bfd-b98c-120b65ae9524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:22:55 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1b2152b8-92fb-48e8-810b-7001ed8aa267 tempest-VolumesDeleteCascade-1494138053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7486d2e0-2e5e-479d-87b7-b4f8a0371d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:22:55 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1b2152b8-92fb-48e8-810b-7001ed8aa267 tempest-VolumesDeleteCascade-1494138053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7486d2e0-2e5e-479d-87b7-b4f8a0371d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:22:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-101293183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a334f97-4dc5-4706-a14e-a88e9e043fd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='083a5092296b4e6a9429bbe18accf37f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:22:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cd729f5f-f2f1-49e6-96fa-7166869ce963,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:22:55Z,use_quota=True,user_id='16d5db5db8304b799ba29fa3d7ae5f68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:22:55 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1b2152b8-92fb-48e8-810b-7001ed8aa267 tempest-VolumesDeleteCascade-1494138053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59fddedf-182d-4008-932b-45dc653534a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:22:55 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1b2152b8-92fb-48e8-810b-7001ed8aa267 tempest-VolumesDeleteCascade-1494138053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59fddedf-182d-4008-932b-45dc653534a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:22:55 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1b2152b8-92fb-48e8-810b-7001ed8aa267 tempest-VolumesDeleteCascade-1494138053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6a094bf-0674-408e-9566-a0b8ccc5e6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:22:55 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1b2152b8-92fb-48e8-810b-7001ed8aa267 tempest-VolumesDeleteCascade-1494138053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6a094bf-0674-408e-9566-a0b8ccc5e6fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9a334f97-4dc5-4706-a14e-a88e9e043fd8', 'volume_name': 'volume-9a334f97-4dc5-4706-a14e-a88e9e043fd8', 'volume_size': 1, 'snapshot_id': 'cd729f5f-f2f1-49e6-96fa-7166869ce963'}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:22:55 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1b2152b8-92fb-48e8-810b-7001ed8aa267 tempest-VolumesDeleteCascade-1494138053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b60adf43-f4aa-40ca-b9a1-d63ed21ec376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:22:55 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1b2152b8-92fb-48e8-810b-7001ed8aa267 tempest-VolumesDeleteCascade-1494138053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b60adf43-f4aa-40ca-b9a1-d63ed21ec376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:22:55 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1b2152b8-92fb-48e8-810b-7001ed8aa267 tempest-VolumesDeleteCascade-1494138053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f25b35d3-0522-4be4-bb1d-811a2c400bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:22:55 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-1b2152b8-92fb-48e8-810b-7001ed8aa267 tempest-VolumesDeleteCascade-1494138053 None] Volume 9a334f97-4dc5-4706-a14e-a88e9e043fd8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9a334f97-4dc5-4706-a14e-a88e9e043fd8', 'volume_size': 1, 'snapshot_id': 'cd729f5f-f2f1-49e6-96fa-7166869ce963'} Sep 10 21:22:55 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-1b2152b8-92fb-48e8-810b-7001ed8aa267 tempest-VolumesDeleteCascade-1494138053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:22:55 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-1b2152b8-92fb-48e8-810b-7001ed8aa267 tempest-VolumesDeleteCascade-1494138053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:22:55 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-1b2152b8-92fb-48e8-810b-7001ed8aa267 tempest-VolumesDeleteCascade-1494138053 None] Acquiring lock "cinder-quobyte-cd729f5f-f2f1-49e6-96fa-7166869ce963-9a334f97-4dc5-4706-a14e-a88e9e043fd8" by "_create_volume_from_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:22:55 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-1b2152b8-92fb-48e8-810b-7001ed8aa267 tempest-VolumesDeleteCascade-1494138053 None] Lock "cinder-quobyte-cd729f5f-f2f1-49e6-96fa-7166869ce963-9a334f97-4dc5-4706-a14e-a88e9e043fd8" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:22:55 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-1b2152b8-92fb-48e8-810b-7001ed8aa267 tempest-VolumesDeleteCascade-1494138053 None] Creating volume 9a334f97-4dc5-4706-a14e-a88e9e043fd8 from snapshot cd729f5f-f2f1-49e6-96fa-7166869ce963 {{(pid=82780) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 10 21:22:55 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-1b2152b8-92fb-48e8-810b-7001ed8aa267 tempest-VolumesDeleteCascade-1494138053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:22:55 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-1b2152b8-92fb-48e8-810b-7001ed8aa267 tempest-VolumesDeleteCascade-1494138053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:22:55 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-1b2152b8-92fb-48e8-810b-7001ed8aa267 tempest-VolumesDeleteCascade-1494138053 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:22:55 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-1b2152b8-92fb-48e8-810b-7001ed8aa267 tempest-VolumesDeleteCascade-1494138053 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:22:55 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-1b2152b8-92fb-48e8-810b-7001ed8aa267 tempest-VolumesDeleteCascade-1494138053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:22:55 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-1b2152b8-92fb-48e8-810b-7001ed8aa267 tempest-VolumesDeleteCascade-1494138053 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:22:55 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-1b2152b8-92fb-48e8-810b-7001ed8aa267 tempest-VolumesDeleteCascade-1494138053 None] Acquiring lock "cinder-quobyte-9a334f97-4dc5-4706-a14e-a88e9e043fd8" by "_copy_volume_from_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:22:55 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-1b2152b8-92fb-48e8-810b-7001ed8aa267 tempest-VolumesDeleteCascade-1494138053 None] Lock "cinder-quobyte-9a334f97-4dc5-4706-a14e-a88e9e043fd8" acquired by "_copy_volume_from_snapshot" :: waited 0.042s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:22:55 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-1b2152b8-92fb-48e8-810b-7001ed8aa267 tempest-VolumesDeleteCascade-1494138053 None] snapshot: cd729f5f-f2f1-49e6-96fa-7166869ce963, volume: 9a334f97-4dc5-4706-a14e-a88e9e043fd8, {{(pid=82780) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}} Sep 10 21:22:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-1b2152b8-92fb-48e8-810b-7001ed8aa267 tempest-VolumesDeleteCascade-1494138053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:22:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-1b2152b8-92fb-48e8-810b-7001ed8aa267 tempest-VolumesDeleteCascade-1494138053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:22:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-1b2152b8-92fb-48e8-810b-7001ed8aa267 tempest-VolumesDeleteCascade-1494138053 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:22:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-1b2152b8-92fb-48e8-810b-7001ed8aa267 tempest-VolumesDeleteCascade-1494138053 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:22:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-1b2152b8-92fb-48e8-810b-7001ed8aa267 tempest-VolumesDeleteCascade-1494138053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:22:56 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec36596-024f-4056-8c71-763ca015b03d]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:22:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1b2152b8-92fb-48e8-810b-7001ed8aa267 tempest-VolumesDeleteCascade-1494138053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8.cd729f5f-f2f1-49e6-96fa-7166869ce963 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:22:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1b2152b8-92fb-48e8-810b-7001ed8aa267 tempest-VolumesDeleteCascade-1494138053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8.cd729f5f-f2f1-49e6-96fa-7166869ce963" returned: 0 in 0.540s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:22:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-1b2152b8-92fb-48e8-810b-7001ed8aa267 tempest-VolumesDeleteCascade-1494138053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82780) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 21:22:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-1b2152b8-92fb-48e8-810b-7001ed8aa267 tempest-VolumesDeleteCascade-1494138053 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8 {{(pid=82780) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}} Sep 10 21:22:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-1b2152b8-92fb-48e8-810b-7001ed8aa267 tempest-VolumesDeleteCascade-1494138053 None] Creating direct copy from snapshot {{(pid=82780) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Sep 10 21:22:56 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d33bc4-7ceb-4b90-bb9c-5e80ea0b25cc]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:22:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1b2152b8-92fb-48e8-810b-7001ed8aa267 tempest-VolumesDeleteCascade-1494138053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:22:56 devstack cinder-volume[82780]: DEBUG oslo_service.periodic_task [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82780) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 21:22:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:22:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:22:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:22:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:22:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:22:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:22:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.132s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:22:57 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:22:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1b2152b8-92fb-48e8-810b-7001ed8aa267 tempest-VolumesDeleteCascade-1494138053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8" returned: 0 in 0.777s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:22:57 devstack cinder-volume[82780]: DEBUG cinder.utils [None req-1b2152b8-92fb-48e8-810b-7001ed8aa267 tempest-VolumesDeleteCascade-1494138053 None] Path /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-9a334f97-4dc5-4706-a14e-a88e9e043fd8 not found in is_blk_device check {{(pid=82780) is_blk_device /opt/stack/cinder/cinder/utils.py:591}} Sep 10 21:22:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1b2152b8-92fb-48e8-810b-7001ed8aa267 tempest-VolumesDeleteCascade-1494138053 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-9a334f97-4dc5-4706-a14e-a88e9e043fd8 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:22:57 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=57, name=volume-9a334f97-4dc5-4706-a14e-a88e9e043fd8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:23:00 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=58,cinder:UPDATE=65,cinder:DELETE=5,cinder:INSERT=12 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:23:00 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-0efee4ef-55a9-4f10-a942-8799359b8dcb tempest-AttachVolumeTestJSON-828295401 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:23:00 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-0efee4ef-55a9-4f10-a942-8799359b8dcb tempest-AttachVolumeTestJSON-828295401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:23:00 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0efee4ef-55a9-4f10-a942-8799359b8dcb tempest-AttachVolumeTestJSON-828295401 None] Flow 'volume_create_manager' (44f5e9f3-51f9-4416-bc72-ff2fa831576d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:23:00 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0efee4ef-55a9-4f10-a942-8799359b8dcb tempest-AttachVolumeTestJSON-828295401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5533fa66-c2a1-418a-a444-1c6bad47462d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:23:01 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0efee4ef-55a9-4f10-a942-8799359b8dcb tempest-AttachVolumeTestJSON-828295401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5533fa66-c2a1-418a-a444-1c6bad47462d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:22:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-908989127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26f9eac4-a7a7-444c-8eb9-0e9d16842a73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca9244a504ae49c69b10542efaeba576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:22:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:22:59Z,use_quota=True,user_id='bc73940cbe674db99581f2d99ba44839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:23:01 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0efee4ef-55a9-4f10-a942-8799359b8dcb tempest-AttachVolumeTestJSON-828295401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55d32c5c-ef63-4abc-afda-85f0bcf18679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:23:01 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0efee4ef-55a9-4f10-a942-8799359b8dcb tempest-AttachVolumeTestJSON-828295401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55d32c5c-ef63-4abc-afda-85f0bcf18679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:23:01 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0efee4ef-55a9-4f10-a942-8799359b8dcb tempest-AttachVolumeTestJSON-828295401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96ef3d06-576d-444f-a207-140ae5b32672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:23:01 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0efee4ef-55a9-4f10-a942-8799359b8dcb tempest-AttachVolumeTestJSON-828295401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96ef3d06-576d-444f-a207-140ae5b32672) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26f9eac4-a7a7-444c-8eb9-0e9d16842a73', 'volume_name': 'volume-26f9eac4-a7a7-444c-8eb9-0e9d16842a73', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:23:01 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0efee4ef-55a9-4f10-a942-8799359b8dcb tempest-AttachVolumeTestJSON-828295401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (508e8e35-92d3-46b4-a864-34e248a94214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:23:01 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0efee4ef-55a9-4f10-a942-8799359b8dcb tempest-AttachVolumeTestJSON-828295401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (508e8e35-92d3-46b4-a864-34e248a94214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:23:01 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0efee4ef-55a9-4f10-a942-8799359b8dcb tempest-AttachVolumeTestJSON-828295401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4957d55-e6bf-4b4c-b16b-c23e726c901d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:23:01 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-0efee4ef-55a9-4f10-a942-8799359b8dcb tempest-AttachVolumeTestJSON-828295401 None] Volume 26f9eac4-a7a7-444c-8eb9-0e9d16842a73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26f9eac4-a7a7-444c-8eb9-0e9d16842a73', 'volume_size': 1} Sep 10 21:23:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-0efee4ef-55a9-4f10-a942-8799359b8dcb tempest-AttachVolumeTestJSON-828295401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:23:04 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1b2152b8-92fb-48e8-810b-7001ed8aa267 tempest-VolumesDeleteCascade-1494138053 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-9a334f97-4dc5-4706-a14e-a88e9e043fd8" returned: 0 in 7.392s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:23:04 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbeaebf4-ba55-4650-aba8-455330e7f198]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:23:04 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1b2152b8-92fb-48e8-810b-7001ed8aa267 tempest-VolumesDeleteCascade-1494138053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:23:05 devstack quobyte-client[82807]: System call of process 93936 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:23:05 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1b2152b8-92fb-48e8-810b-7001ed8aa267 tempest-VolumesDeleteCascade-1494138053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8" returned: 0 in 0.863s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:23:05 devstack cinder-volume[82780]: DEBUG cinder.image.image_utils [None req-1b2152b8-92fb-48e8-810b-7001ed8aa267 tempest-VolumesDeleteCascade-1494138053 None] Image conversion details: src /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8, size 1024.00 MB, duration 7.40 sec, destination /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-9a334f97-4dc5-4706-a14e-a88e9e043fd8 {{(pid=82780) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 10 21:23:05 devstack cinder-volume[82780]: INFO cinder.image.image_utils [None req-1b2152b8-92fb-48e8-810b-7001ed8aa267 tempest-VolumesDeleteCascade-1494138053 None] Converted 1024.00 MB image at 138.44 MB/s Sep 10 21:23:05 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-1b2152b8-92fb-48e8-810b-7001ed8aa267 tempest-VolumesDeleteCascade-1494138053 None] File path /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-9a334f97-4dc5-4706-a14e-a88e9e043fd8 is being set with permissions: 660 {{(pid=82780) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 21:23:05 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1b2152b8-92fb-48e8-810b-7001ed8aa267 tempest-VolumesDeleteCascade-1494138053 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-9a334f97-4dc5-4706-a14e-a88e9e043fd8 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:23:05 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1b2152b8-92fb-48e8-810b-7001ed8aa267 tempest-VolumesDeleteCascade-1494138053 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-9a334f97-4dc5-4706-a14e-a88e9e043fd8" returned: 0 in 0.095s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:23:06 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-1b2152b8-92fb-48e8-810b-7001ed8aa267 tempest-VolumesDeleteCascade-1494138053 None] Lock "cinder-quobyte-9a334f97-4dc5-4706-a14e-a88e9e043fd8" released by "_copy_volume_from_snapshot" :: held 10.172s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:23:06 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-1b2152b8-92fb-48e8-810b-7001ed8aa267 tempest-VolumesDeleteCascade-1494138053 None] Lock "cinder-quobyte-cd729f5f-f2f1-49e6-96fa-7166869ce963-9a334f97-4dc5-4706-a14e-a88e9e043fd8" released by "_create_volume_from_snapshot" :: held 10.279s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:23:06 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-1b2152b8-92fb-48e8-810b-7001ed8aa267 tempest-VolumesDeleteCascade-1494138053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.323s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:23:06 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-0efee4ef-55a9-4f10-a942-8799359b8dcb tempest-AttachVolumeTestJSON-828295401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.051s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:23:06 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-0efee4ef-55a9-4f10-a942-8799359b8dcb tempest-AttachVolumeTestJSON-828295401 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:22:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-908989127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26f9eac4-a7a7-444c-8eb9-0e9d16842a73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca9244a504ae49c69b10542efaeba576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:22:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:22:59Z,use_quota=True,user_id='bc73940cbe674db99581f2d99ba44839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:23:06 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-0efee4ef-55a9-4f10-a942-8799359b8dcb tempest-AttachVolumeTestJSON-828295401 None] Creating volume 26f9eac4-a7a7-444c-8eb9-0e9d16842a73 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:23:06 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-0efee4ef-55a9-4f10-a942-8799359b8dcb tempest-AttachVolumeTestJSON-828295401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:23:06 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-0efee4ef-55a9-4f10-a942-8799359b8dcb tempest-AttachVolumeTestJSON-828295401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:23:06 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-0efee4ef-55a9-4f10-a942-8799359b8dcb tempest-AttachVolumeTestJSON-828295401 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:23:06 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-0efee4ef-55a9-4f10-a942-8799359b8dcb tempest-AttachVolumeTestJSON-828295401 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:23:06 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-0efee4ef-55a9-4f10-a942-8799359b8dcb tempest-AttachVolumeTestJSON-828295401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:23:06 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-0efee4ef-55a9-4f10-a942-8799359b8dcb tempest-AttachVolumeTestJSON-828295401 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:23:06 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-0efee4ef-55a9-4f10-a942-8799359b8dcb tempest-AttachVolumeTestJSON-828295401 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:23:06 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0efee4ef-55a9-4f10-a942-8799359b8dcb tempest-AttachVolumeTestJSON-828295401 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-26f9eac4-a7a7-444c-8eb9-0e9d16842a73 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:23:06 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=58, name=volume-26f9eac4-a7a7-444c-8eb9-0e9d16842a73, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:23:06 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0efee4ef-55a9-4f10-a942-8799359b8dcb tempest-AttachVolumeTestJSON-828295401 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-26f9eac4-a7a7-444c-8eb9-0e9d16842a73 1073741824" returned: 0 in 0.742s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:23:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0efee4ef-55a9-4f10-a942-8799359b8dcb tempest-AttachVolumeTestJSON-828295401 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-26f9eac4-a7a7-444c-8eb9-0e9d16842a73 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:23:07 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1b2152b8-92fb-48e8-810b-7001ed8aa267 tempest-VolumesDeleteCascade-1494138053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f25b35d3-0522-4be4-bb1d-811a2c400bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a334f97-4dc5-4706-a14e-a88e9e043fd8', 'volume_size': 1, 'snapshot_id': 'cd729f5f-f2f1-49e6-96fa-7166869ce963'}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:23:07 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1b2152b8-92fb-48e8-810b-7001ed8aa267 tempest-VolumesDeleteCascade-1494138053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (142ccaff-892a-41b3-b543-090878070183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:23:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0efee4ef-55a9-4f10-a942-8799359b8dcb tempest-AttachVolumeTestJSON-828295401 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-26f9eac4-a7a7-444c-8eb9-0e9d16842a73" returned: 0 in 0.406s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:23:07 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-0efee4ef-55a9-4f10-a942-8799359b8dcb tempest-AttachVolumeTestJSON-828295401 None] <== create_volume: return (1205ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:23:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-0efee4ef-55a9-4f10-a942-8799359b8dcb tempest-AttachVolumeTestJSON-828295401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.234s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:23:07 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-1b2152b8-92fb-48e8-810b-7001ed8aa267 tempest-VolumesDeleteCascade-1494138053 None] Volume volume-9a334f97-4dc5-4706-a14e-a88e9e043fd8 (9a334f97-4dc5-4706-a14e-a88e9e043fd8): created successfully Sep 10 21:23:07 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1b2152b8-92fb-48e8-810b-7001ed8aa267 tempest-VolumesDeleteCascade-1494138053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (142ccaff-892a-41b3-b543-090878070183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:23:07 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1b2152b8-92fb-48e8-810b-7001ed8aa267 tempest-VolumesDeleteCascade-1494138053 None] Flow 'volume_create_manager' (89e5ed90-441a-4bfd-b98c-120b65ae9524) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:23:07 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0efee4ef-55a9-4f10-a942-8799359b8dcb tempest-AttachVolumeTestJSON-828295401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4957d55-e6bf-4b4c-b16b-c23e726c901d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26f9eac4-a7a7-444c-8eb9-0e9d16842a73', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:23:07 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0efee4ef-55a9-4f10-a942-8799359b8dcb tempest-AttachVolumeTestJSON-828295401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fa52314-ae47-48c9-87f4-15b370717112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:23:07 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-0efee4ef-55a9-4f10-a942-8799359b8dcb tempest-AttachVolumeTestJSON-828295401 None] Volume volume-26f9eac4-a7a7-444c-8eb9-0e9d16842a73 (26f9eac4-a7a7-444c-8eb9-0e9d16842a73): created successfully Sep 10 21:23:07 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0efee4ef-55a9-4f10-a942-8799359b8dcb tempest-AttachVolumeTestJSON-828295401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fa52314-ae47-48c9-87f4-15b370717112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:23:07 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0efee4ef-55a9-4f10-a942-8799359b8dcb tempest-AttachVolumeTestJSON-828295401 None] Flow 'volume_create_manager' (44f5e9f3-51f9-4416-bc72-ff2fa831576d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:23:07 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-1b2152b8-92fb-48e8-810b-7001ed8aa267 tempest-VolumesDeleteCascade-1494138053 None] Created volume successfully. Sep 10 21:23:07 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-0efee4ef-55a9-4f10-a942-8799359b8dcb tempest-AttachVolumeTestJSON-828295401 None] Created volume successfully. Sep 10 21:23:08 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-b6baf46c-b2ac-476d-8157-7b0093e32daa tempest-VolumesDeleteCascade-1494138053 None] Acquiring lock "cinder-a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:23:08 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-b6baf46c-b2ac-476d-8157-7b0093e32daa tempest-VolumesDeleteCascade-1494138053 None] Lock "cinder-a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:23:08 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-b6baf46c-b2ac-476d-8157-7b0093e32daa tempest-VolumesDeleteCascade-1494138053 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:23:08 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-b6baf46c-b2ac-476d-8157-7b0093e32daa tempest-VolumesDeleteCascade-1494138053 None] Performing cascade delete. {{(pid=82780) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 10 21:23:08 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-b6baf46c-b2ac-476d-8157-7b0093e32daa tempest-VolumesDeleteCascade-1494138053 None] Acquiring lock "cinder-cd729f5f-f2f1-49e6-96fa-7166869ce963-delete_snapshot" by "delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:23:08 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-b6baf46c-b2ac-476d-8157-7b0093e32daa tempest-VolumesDeleteCascade-1494138053 None] Lock "cinder-cd729f5f-f2f1-49e6-96fa-7166869ce963-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:23:08 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-b6baf46c-b2ac-476d-8157-7b0093e32daa tempest-VolumesDeleteCascade-1494138053 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:23:08 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-b6baf46c-b2ac-476d-8157-7b0093e32daa tempest-VolumesDeleteCascade-1494138053 None] Acquiring lock "cinder-quobyte-a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8" by "delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:23:08 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-b6baf46c-b2ac-476d-8157-7b0093e32daa tempest-VolumesDeleteCascade-1494138053 None] Lock "cinder-quobyte-a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8" acquired by "delete_snapshot" :: waited 0.025s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:23:08 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-b6baf46c-b2ac-476d-8157-7b0093e32daa tempest-VolumesDeleteCascade-1494138053 None] Acquiring lock "cinder-quobyte-cd729f5f-f2f1-49e6-96fa-7166869ce963" by "_delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:23:08 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-b6baf46c-b2ac-476d-8157-7b0093e32daa tempest-VolumesDeleteCascade-1494138053 None] Lock "cinder-quobyte-cd729f5f-f2f1-49e6-96fa-7166869ce963" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:23:08 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-b6baf46c-b2ac-476d-8157-7b0093e32daa tempest-VolumesDeleteCascade-1494138053 None] Deleting offline snapshot cd729f5f-f2f1-49e6-96fa-7166869ce963 of volume a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8 {{(pid=82780) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 21:23:08 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-b6baf46c-b2ac-476d-8157-7b0093e32daa tempest-VolumesDeleteCascade-1494138053 None] snapshot_file for this snap is: volume-a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8.cd729f5f-f2f1-49e6-96fa-7166869ce963 {{(pid=82780) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 21:23:08 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f75536-5e3d-4b73-9c2f-23220ad75ba6]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:23:08 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b6baf46c-b2ac-476d-8157-7b0093e32daa tempest-VolumesDeleteCascade-1494138053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8.cd729f5f-f2f1-49e6-96fa-7166869ce963 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:23:09 devstack quobyte-client[82807]: System call of process 93960 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:23:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b6baf46c-b2ac-476d-8157-7b0093e32daa tempest-VolumesDeleteCascade-1494138053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8.cd729f5f-f2f1-49e6-96fa-7166869ce963" returned: 0 in 1.069s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:23:09 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-b6baf46c-b2ac-476d-8157-7b0093e32daa tempest-VolumesDeleteCascade-1494138053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82780) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 21:23:09 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[2607863d-9f5e-4d60-b1c3-49b626cf3ce8]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:23:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b6baf46c-b2ac-476d-8157-7b0093e32daa tempest-VolumesDeleteCascade-1494138053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:23:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b6baf46c-b2ac-476d-8157-7b0093e32daa tempest-VolumesDeleteCascade-1494138053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8" returned: 0 in 0.565s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:23:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b6baf46c-b2ac-476d-8157-7b0093e32daa tempest-VolumesDeleteCascade-1494138053 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8.cd729f5f-f2f1-49e6-96fa-7166869ce963 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:23:10 devstack quobyte-client[82807]: System call of process 93967 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:23:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b6baf46c-b2ac-476d-8157-7b0093e32daa tempest-VolumesDeleteCascade-1494138053 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8.cd729f5f-f2f1-49e6-96fa-7166869ce963" returned: 0 in 0.317s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:23:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b6baf46c-b2ac-476d-8157-7b0093e32daa tempest-VolumesDeleteCascade-1494138053 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8.cd729f5f-f2f1-49e6-96fa-7166869ce963 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:23:11 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b6baf46c-b2ac-476d-8157-7b0093e32daa tempest-VolumesDeleteCascade-1494138053 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8.cd729f5f-f2f1-49e6-96fa-7166869ce963" returned: 0 in 0.132s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:23:11 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-b6baf46c-b2ac-476d-8157-7b0093e32daa tempest-VolumesDeleteCascade-1494138053 None] Lock "cinder-quobyte-cd729f5f-f2f1-49e6-96fa-7166869ce963" released by "_delete_snapshot" :: held 2.450s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:23:11 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-b6baf46c-b2ac-476d-8157-7b0093e32daa tempest-VolumesDeleteCascade-1494138053 None] Lock "cinder-quobyte-a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8" released by "delete_snapshot" :: held 2.494s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:23:11 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-b6baf46c-b2ac-476d-8157-7b0093e32daa tempest-VolumesDeleteCascade-1494138053 None] Created reservations ['460583a3-8066-4782-83c8-ffa6b6c1c99b', '50036fce-fd2b-4b79-843a-b71cbd84cbc3', '595e8b18-5b97-487d-b656-21e7653d673d', '7c70915c-4e67-4999-b738-035daf5030c8'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:23:11 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-b6baf46c-b2ac-476d-8157-7b0093e32daa tempest-VolumesDeleteCascade-1494138053 None] Delete snapshot completed successfully. Sep 10 21:23:11 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-b6baf46c-b2ac-476d-8157-7b0093e32daa tempest-VolumesDeleteCascade-1494138053 None] Lock "cinder-cd729f5f-f2f1-49e6-96fa-7166869ce963-delete_snapshot" released by "delete_snapshot" :: held 3.185s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:23:11 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-b6baf46c-b2ac-476d-8157-7b0093e32daa tempest-VolumesDeleteCascade-1494138053 None] Snapshots deleted, issuing volume delete {{(pid=82780) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 10 21:23:11 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-b6baf46c-b2ac-476d-8157-7b0093e32daa tempest-VolumesDeleteCascade-1494138053 None] Acquiring lock "cinder-quobyte-a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:23:11 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-b6baf46c-b2ac-476d-8157-7b0093e32daa tempest-VolumesDeleteCascade-1494138053 None] Lock "cinder-quobyte-a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8" acquired by "delete_volume" :: waited 0.032s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:23:11 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce0dc86-e176-4875-8f94-9311779afc95]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:23:11 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b6baf46c-b2ac-476d-8157-7b0093e32daa tempest-VolumesDeleteCascade-1494138053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:23:12 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b6baf46c-b2ac-476d-8157-7b0093e32daa tempest-VolumesDeleteCascade-1494138053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8" returned: 0 in 0.539s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:23:12 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b6baf46c-b2ac-476d-8157-7b0093e32daa tempest-VolumesDeleteCascade-1494138053 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:23:12 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b6baf46c-b2ac-476d-8157-7b0093e32daa tempest-VolumesDeleteCascade-1494138053 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8" returned: 0 in 0.168s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:23:13 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-b6baf46c-b2ac-476d-8157-7b0093e32daa tempest-VolumesDeleteCascade-1494138053 None] Lock "cinder-quobyte-a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8" released by "delete_volume" :: held 1.158s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:23:13 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-b6baf46c-b2ac-476d-8157-7b0093e32daa tempest-VolumesDeleteCascade-1494138053 None] Created reservations ['ebd85876-f893-4248-863d-724679dbfa4e', '90c4092c-f410-4409-88b3-21c0aefea58b', 'f06a4d47-1dbd-4000-bb8a-d3b94a7c2808', '82a56865-7ab5-4186-b384-aac237f385d0'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:23:13 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-b6baf46c-b2ac-476d-8157-7b0093e32daa tempest-VolumesDeleteCascade-1494138053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:23:13 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-b6baf46c-b2ac-476d-8157-7b0093e32daa tempest-VolumesDeleteCascade-1494138053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:23:13 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-b6baf46c-b2ac-476d-8157-7b0093e32daa tempest-VolumesDeleteCascade-1494138053 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:23:13 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-b6baf46c-b2ac-476d-8157-7b0093e32daa tempest-VolumesDeleteCascade-1494138053 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:23:13 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-b6baf46c-b2ac-476d-8157-7b0093e32daa tempest-VolumesDeleteCascade-1494138053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:23:13 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b6baf46c-b2ac-476d-8157-7b0093e32daa tempest-VolumesDeleteCascade-1494138053 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:23:13 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b6baf46c-b2ac-476d-8157-7b0093e32daa tempest-VolumesDeleteCascade-1494138053 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.144s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:23:13 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-b6baf46c-b2ac-476d-8157-7b0093e32daa tempest-VolumesDeleteCascade-1494138053 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:23:14 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-b6baf46c-b2ac-476d-8157-7b0093e32daa tempest-VolumesDeleteCascade-1494138053 None] Deleted volume successfully. Sep 10 21:23:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-a81ad379-f457-43a7-a53a-e3ad9fd867cc req-895b1018-6d8a-4eac-a087-e5bff07fbaa9 tempest-AttachVolumeTestJSON-828295401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:23:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-a81ad379-f457-43a7-a53a-e3ad9fd867cc req-895b1018-6d8a-4eac-a087-e5bff07fbaa9 tempest-AttachVolumeTestJSON-828295401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.006s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:23:14 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f39d0c-4144-455f-89d8-49bfc209daec]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:23:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-a81ad379-f457-43a7-a53a-e3ad9fd867cc req-895b1018-6d8a-4eac-a087-e5bff07fbaa9 tempest-AttachVolumeTestJSON-828295401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-26f9eac4-a7a7-444c-8eb9-0e9d16842a73 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:23:14 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-b6baf46c-b2ac-476d-8157-7b0093e32daa tempest-VolumesDeleteCascade-1494138053 None] Lock "cinder-a1b4ce2f-b28a-4d10-90b6-08cda8f6b4f8-delete_volume" released by "delete_volume" :: held 6.254s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:23:14 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-19734ed1-db53-4756-8485-1548ed243a95 tempest-VolumesDeleteCascade-1494138053 None] Acquiring lock "cinder-9a334f97-4dc5-4706-a14e-a88e9e043fd8-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:23:14 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-19734ed1-db53-4756-8485-1548ed243a95 tempest-VolumesDeleteCascade-1494138053 None] Lock "cinder-9a334f97-4dc5-4706-a14e-a88e9e043fd8-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:23:15 devstack quobyte-client[82807]: System call of process 94009 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:23:15 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-a81ad379-f457-43a7-a53a-e3ad9fd867cc req-895b1018-6d8a-4eac-a087-e5bff07fbaa9 tempest-AttachVolumeTestJSON-828295401 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-26f9eac4-a7a7-444c-8eb9-0e9d16842a73" returned: 0 in 0.667s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:23:15 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-a81ad379-f457-43a7-a53a-e3ad9fd867cc req-895b1018-6d8a-4eac-a087-e5bff07fbaa9 tempest-AttachVolumeTestJSON-828295401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.725s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:23:15 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-19734ed1-db53-4756-8485-1548ed243a95 tempest-VolumesDeleteCascade-1494138053 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:23:15 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-19734ed1-db53-4756-8485-1548ed243a95 tempest-VolumesDeleteCascade-1494138053 None] Acquiring lock "cinder-quobyte-9a334f97-4dc5-4706-a14e-a88e9e043fd8" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:23:15 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-19734ed1-db53-4756-8485-1548ed243a95 tempest-VolumesDeleteCascade-1494138053 None] Lock "cinder-quobyte-9a334f97-4dc5-4706-a14e-a88e9e043fd8" acquired by "delete_volume" :: waited 0.035s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:23:15 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-a81ad379-f457-43a7-a53a-e3ad9fd867cc req-895b1018-6d8a-4eac-a087-e5bff07fbaa9 tempest-AttachVolumeTestJSON-828295401 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b', 'name': 'volume-26f9eac4-a7a7-444c-8eb9-0e9d16842a73', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6d566e9d-87cc-4641-bb1c-f8afce22d219', 'enforce_multipath': True} {{(pid=82780) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 21:23:15 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-a81ad379-f457-43a7-a53a-e3ad9fd867cc req-895b1018-6d8a-4eac-a087-e5bff07fbaa9 tempest-AttachVolumeTestJSON-828295401 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:23:15 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14b7cdd-16e3-4226-9d85-4130b705cc3c]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:23:15 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-19734ed1-db53-4756-8485-1548ed243a95 tempest-VolumesDeleteCascade-1494138053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-9a334f97-4dc5-4706-a14e-a88e9e043fd8 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:23:15 devstack cinder-volume[82780]: INFO cinder.volume.manager [req-a81ad379-f457-43a7-a53a-e3ad9fd867cc req-895b1018-6d8a-4eac-a087-e5bff07fbaa9 tempest-AttachVolumeTestJSON-828295401 None] attachment_update completed successfully. Sep 10 21:23:16 devstack quobyte-client[82807]: System call of process 94012 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:23:16 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-19734ed1-db53-4756-8485-1548ed243a95 tempest-VolumesDeleteCascade-1494138053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-9a334f97-4dc5-4706-a14e-a88e9e043fd8" returned: 0 in 0.909s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:23:16 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-19734ed1-db53-4756-8485-1548ed243a95 tempest-VolumesDeleteCascade-1494138053 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-9a334f97-4dc5-4706-a14e-a88e9e043fd8 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:23:16 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-19734ed1-db53-4756-8485-1548ed243a95 tempest-VolumesDeleteCascade-1494138053 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-9a334f97-4dc5-4706-a14e-a88e9e043fd8" returned: 0 in 0.207s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:23:16 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-19734ed1-db53-4756-8485-1548ed243a95 tempest-VolumesDeleteCascade-1494138053 None] Lock "cinder-quobyte-9a334f97-4dc5-4706-a14e-a88e9e043fd8" released by "delete_volume" :: held 1.424s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:23:17 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-19734ed1-db53-4756-8485-1548ed243a95 tempest-VolumesDeleteCascade-1494138053 None] Created reservations ['a25aeb25-e152-4063-af50-5fcb49c8e6fd', '769b6fd2-2d9c-460a-95de-c4d7ce8535fb', 'd827d73c-a3aa-4bcf-9a1a-86400f2243a5', 'cb650169-42ee-417d-87d2-f209a6b5b9f3'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:23:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-19734ed1-db53-4756-8485-1548ed243a95 tempest-VolumesDeleteCascade-1494138053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:23:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-19734ed1-db53-4756-8485-1548ed243a95 tempest-VolumesDeleteCascade-1494138053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:23:17 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-19734ed1-db53-4756-8485-1548ed243a95 tempest-VolumesDeleteCascade-1494138053 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:23:17 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-19734ed1-db53-4756-8485-1548ed243a95 tempest-VolumesDeleteCascade-1494138053 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:23:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-19734ed1-db53-4756-8485-1548ed243a95 tempest-VolumesDeleteCascade-1494138053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:23:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-19734ed1-db53-4756-8485-1548ed243a95 tempest-VolumesDeleteCascade-1494138053 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:23:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-19734ed1-db53-4756-8485-1548ed243a95 tempest-VolumesDeleteCascade-1494138053 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.293s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:23:17 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-19734ed1-db53-4756-8485-1548ed243a95 tempest-VolumesDeleteCascade-1494138053 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:23:17 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-19734ed1-db53-4756-8485-1548ed243a95 tempest-VolumesDeleteCascade-1494138053 None] Deleted volume successfully. Sep 10 21:23:18 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-19734ed1-db53-4756-8485-1548ed243a95 tempest-VolumesDeleteCascade-1494138053 None] Lock "cinder-9a334f97-4dc5-4706-a14e-a88e9e043fd8-delete_volume" released by "delete_volume" :: held 3.347s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:23:24 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-bd89654b-1290-4564-9cd5-cfa33a31fb3a tempest-VolumesMetadataTest-2014251078 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:23:24 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd89654b-1290-4564-9cd5-cfa33a31fb3a tempest-VolumesMetadataTest-2014251078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:23:24 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-bd89654b-1290-4564-9cd5-cfa33a31fb3a tempest-VolumesMetadataTest-2014251078 None] Flow 'volume_create_manager' (6c7fea01-628e-4a75-a208-43497063a92b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:23:24 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-bd89654b-1290-4564-9cd5-cfa33a31fb3a tempest-VolumesMetadataTest-2014251078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99962bf5-aa5a-4fdb-a569-92202372b8c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:23:24 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-bd89654b-1290-4564-9cd5-cfa33a31fb3a tempest-VolumesMetadataTest-2014251078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99962bf5-aa5a-4fdb-a569-92202372b8c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1745126850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1579e5ee-3e9c-411e-ab20-88009124ff09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c7d9e80ab614e96baae292418b7cf11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:23:24Z,use_quota=True,user_id='fa5225b52ce1435a8fbc1cce97d118f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:23:24 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-bd89654b-1290-4564-9cd5-cfa33a31fb3a tempest-VolumesMetadataTest-2014251078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b945e808-2da7-44ed-96cb-af2de75e329d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:23:24 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-bd89654b-1290-4564-9cd5-cfa33a31fb3a tempest-VolumesMetadataTest-2014251078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b945e808-2da7-44ed-96cb-af2de75e329d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:23:24 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-bd89654b-1290-4564-9cd5-cfa33a31fb3a tempest-VolumesMetadataTest-2014251078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e43b578d-415d-4805-8798-5889a819ccb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:23:24 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-bd89654b-1290-4564-9cd5-cfa33a31fb3a tempest-VolumesMetadataTest-2014251078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e43b578d-415d-4805-8798-5889a819ccb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1579e5ee-3e9c-411e-ab20-88009124ff09', 'volume_name': 'volume-1579e5ee-3e9c-411e-ab20-88009124ff09', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:23:24 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-bd89654b-1290-4564-9cd5-cfa33a31fb3a tempest-VolumesMetadataTest-2014251078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (006e67a7-65f8-49be-a51c-35bdbcb55124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:23:24 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-bd89654b-1290-4564-9cd5-cfa33a31fb3a tempest-VolumesMetadataTest-2014251078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (006e67a7-65f8-49be-a51c-35bdbcb55124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:23:24 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-bd89654b-1290-4564-9cd5-cfa33a31fb3a tempest-VolumesMetadataTest-2014251078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e89cb23f-8d02-4049-ac88-610a22799a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:23:24 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-bd89654b-1290-4564-9cd5-cfa33a31fb3a tempest-VolumesMetadataTest-2014251078 None] Volume 1579e5ee-3e9c-411e-ab20-88009124ff09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1579e5ee-3e9c-411e-ab20-88009124ff09', 'volume_size': 1} Sep 10 21:23:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-bd89654b-1290-4564-9cd5-cfa33a31fb3a tempest-VolumesMetadataTest-2014251078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:23:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-bd89654b-1290-4564-9cd5-cfa33a31fb3a tempest-VolumesMetadataTest-2014251078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:23:24 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-bd89654b-1290-4564-9cd5-cfa33a31fb3a tempest-VolumesMetadataTest-2014251078 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1745126850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1579e5ee-3e9c-411e-ab20-88009124ff09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c7d9e80ab614e96baae292418b7cf11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:23:24Z,use_quota=True,user_id='fa5225b52ce1435a8fbc1cce97d118f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:23:24 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-bd89654b-1290-4564-9cd5-cfa33a31fb3a tempest-VolumesMetadataTest-2014251078 None] Creating volume 1579e5ee-3e9c-411e-ab20-88009124ff09 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:23:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-bd89654b-1290-4564-9cd5-cfa33a31fb3a tempest-VolumesMetadataTest-2014251078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:23:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-bd89654b-1290-4564-9cd5-cfa33a31fb3a tempest-VolumesMetadataTest-2014251078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:23:24 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-bd89654b-1290-4564-9cd5-cfa33a31fb3a tempest-VolumesMetadataTest-2014251078 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:23:24 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-bd89654b-1290-4564-9cd5-cfa33a31fb3a tempest-VolumesMetadataTest-2014251078 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:23:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-bd89654b-1290-4564-9cd5-cfa33a31fb3a tempest-VolumesMetadataTest-2014251078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:23:24 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-bd89654b-1290-4564-9cd5-cfa33a31fb3a tempest-VolumesMetadataTest-2014251078 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:23:24 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-bd89654b-1290-4564-9cd5-cfa33a31fb3a tempest-VolumesMetadataTest-2014251078 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:23:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-bd89654b-1290-4564-9cd5-cfa33a31fb3a tempest-VolumesMetadataTest-2014251078 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1579e5ee-3e9c-411e-ab20-88009124ff09 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:23:25 devstack quobyte-client[82807]: System call of process 94033 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:23:25 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=59, name=volume-1579e5ee-3e9c-411e-ab20-88009124ff09, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:23:25 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-bd89654b-1290-4564-9cd5-cfa33a31fb3a tempest-VolumesMetadataTest-2014251078 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1579e5ee-3e9c-411e-ab20-88009124ff09 1073741824" returned: 0 in 0.442s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:23:25 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-bd89654b-1290-4564-9cd5-cfa33a31fb3a tempest-VolumesMetadataTest-2014251078 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1579e5ee-3e9c-411e-ab20-88009124ff09 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:23:25 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-bd89654b-1290-4564-9cd5-cfa33a31fb3a tempest-VolumesMetadataTest-2014251078 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1579e5ee-3e9c-411e-ab20-88009124ff09" returned: 0 in 0.180s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:23:25 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-bd89654b-1290-4564-9cd5-cfa33a31fb3a tempest-VolumesMetadataTest-2014251078 None] <== create_volume: return (708ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:23:25 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-bd89654b-1290-4564-9cd5-cfa33a31fb3a tempest-VolumesMetadataTest-2014251078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:23:26 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-bd89654b-1290-4564-9cd5-cfa33a31fb3a tempest-VolumesMetadataTest-2014251078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e89cb23f-8d02-4049-ac88-610a22799a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1579e5ee-3e9c-411e-ab20-88009124ff09', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:23:26 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-bd89654b-1290-4564-9cd5-cfa33a31fb3a tempest-VolumesMetadataTest-2014251078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8aa75218-f95e-4789-8c33-e56c36db6b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:23:26 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-11112f91-681e-4871-8196-a3804d186e4d tempest-CreateVolumesFromImageTest-1602158055 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:23:26 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-11112f91-681e-4871-8196-a3804d186e4d tempest-CreateVolumesFromImageTest-1602158055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:23:26 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-11112f91-681e-4871-8196-a3804d186e4d tempest-CreateVolumesFromImageTest-1602158055 None] Flow 'volume_create_manager' (1220b3a8-e5d2-414a-a2e2-ee0920c6779b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:23:26 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-11112f91-681e-4871-8196-a3804d186e4d tempest-CreateVolumesFromImageTest-1602158055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aef03b01-1003-4102-9989-a8705c4a760f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:23:26 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-bd89654b-1290-4564-9cd5-cfa33a31fb3a tempest-VolumesMetadataTest-2014251078 None] Volume volume-1579e5ee-3e9c-411e-ab20-88009124ff09 (1579e5ee-3e9c-411e-ab20-88009124ff09): created successfully Sep 10 21:23:26 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-bd89654b-1290-4564-9cd5-cfa33a31fb3a tempest-VolumesMetadataTest-2014251078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8aa75218-f95e-4789-8c33-e56c36db6b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:23:26 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-bd89654b-1290-4564-9cd5-cfa33a31fb3a tempest-VolumesMetadataTest-2014251078 None] Flow 'volume_create_manager' (6c7fea01-628e-4a75-a208-43497063a92b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:23:26 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-11112f91-681e-4871-8196-a3804d186e4d tempest-CreateVolumesFromImageTest-1602158055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aef03b01-1003-4102-9989-a8705c4a760f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:23:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2112329237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fa1962b-c9a8-49f3-8d0d-ece163a159db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8455530ee4d447eb67ea746ef2564ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:23:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:23:26Z,use_quota=True,user_id='b196721084d2490c84ee2089d9a00baf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:23:26 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-11112f91-681e-4871-8196-a3804d186e4d tempest-CreateVolumesFromImageTest-1602158055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75c0fc8f-32c7-4518-928c-63a410128ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:23:26 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-11112f91-681e-4871-8196-a3804d186e4d tempest-CreateVolumesFromImageTest-1602158055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75c0fc8f-32c7-4518-928c-63a410128ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:23:26 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-11112f91-681e-4871-8196-a3804d186e4d tempest-CreateVolumesFromImageTest-1602158055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ad13193-cd37-48c7-a4d1-414cddbf89d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:23:26 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-11112f91-681e-4871-8196-a3804d186e4d tempest-CreateVolumesFromImageTest-1602158055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ad13193-cd37-48c7-a4d1-414cddbf89d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fa1962b-c9a8-49f3-8d0d-ece163a159db', 'volume_name': 'volume-6fa1962b-c9a8-49f3-8d0d-ece163a159db', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:23:26 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-11112f91-681e-4871-8196-a3804d186e4d tempest-CreateVolumesFromImageTest-1602158055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c440c5af-284e-4c74-876a-8279c574422d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:23:26 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-11112f91-681e-4871-8196-a3804d186e4d tempest-CreateVolumesFromImageTest-1602158055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c440c5af-284e-4c74-876a-8279c574422d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:23:26 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-11112f91-681e-4871-8196-a3804d186e4d tempest-CreateVolumesFromImageTest-1602158055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f89ca71-681e-4c7a-a989-db2929c41255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:23:26 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-11112f91-681e-4871-8196-a3804d186e4d tempest-CreateVolumesFromImageTest-1602158055 None] Volume 6fa1962b-c9a8-49f3-8d0d-ece163a159db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fa1962b-c9a8-49f3-8d0d-ece163a159db', 'volume_size': 1} Sep 10 21:23:26 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-11112f91-681e-4871-8196-a3804d186e4d tempest-CreateVolumesFromImageTest-1602158055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:23:26 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-11112f91-681e-4871-8196-a3804d186e4d tempest-CreateVolumesFromImageTest-1602158055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:23:26 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-11112f91-681e-4871-8196-a3804d186e4d tempest-CreateVolumesFromImageTest-1602158055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:23:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2112329237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fa1962b-c9a8-49f3-8d0d-ece163a159db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8455530ee4d447eb67ea746ef2564ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:23:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:23:26Z,use_quota=True,user_id='b196721084d2490c84ee2089d9a00baf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:23:26 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-11112f91-681e-4871-8196-a3804d186e4d tempest-CreateVolumesFromImageTest-1602158055 None] Creating volume 6fa1962b-c9a8-49f3-8d0d-ece163a159db {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:23:26 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-11112f91-681e-4871-8196-a3804d186e4d tempest-CreateVolumesFromImageTest-1602158055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:23:26 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-11112f91-681e-4871-8196-a3804d186e4d tempest-CreateVolumesFromImageTest-1602158055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:23:26 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-11112f91-681e-4871-8196-a3804d186e4d tempest-CreateVolumesFromImageTest-1602158055 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:23:26 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-11112f91-681e-4871-8196-a3804d186e4d tempest-CreateVolumesFromImageTest-1602158055 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:23:26 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-11112f91-681e-4871-8196-a3804d186e4d tempest-CreateVolumesFromImageTest-1602158055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:23:26 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-11112f91-681e-4871-8196-a3804d186e4d tempest-CreateVolumesFromImageTest-1602158055 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:23:26 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-11112f91-681e-4871-8196-a3804d186e4d tempest-CreateVolumesFromImageTest-1602158055 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:23:26 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-11112f91-681e-4871-8196-a3804d186e4d tempest-CreateVolumesFromImageTest-1602158055 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-6fa1962b-c9a8-49f3-8d0d-ece163a159db 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:23:26 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-bd89654b-1290-4564-9cd5-cfa33a31fb3a tempest-VolumesMetadataTest-2014251078 None] Created volume successfully. Sep 10 21:23:26 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=60, name=volume-6fa1962b-c9a8-49f3-8d0d-ece163a159db, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:23:27 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-11112f91-681e-4871-8196-a3804d186e4d tempest-CreateVolumesFromImageTest-1602158055 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-6fa1962b-c9a8-49f3-8d0d-ece163a159db 1073741824" returned: 0 in 0.799s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:23:27 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-11112f91-681e-4871-8196-a3804d186e4d tempest-CreateVolumesFromImageTest-1602158055 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-6fa1962b-c9a8-49f3-8d0d-ece163a159db {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:23:27 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-ed659da9-2c30-4fef-8f2b-2a48cd72ca42 tempest-CreateVolumesFromImageTest-1602158055 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:23:27 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed659da9-2c30-4fef-8f2b-2a48cd72ca42 tempest-CreateVolumesFromImageTest-1602158055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:23:27 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ed659da9-2c30-4fef-8f2b-2a48cd72ca42 tempest-CreateVolumesFromImageTest-1602158055 None] Flow 'volume_create_manager' (9d83ee37-bd57-42a3-85fa-6e9527c965af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:23:27 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ed659da9-2c30-4fef-8f2b-2a48cd72ca42 tempest-CreateVolumesFromImageTest-1602158055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93be431f-f81f-47ba-9a4d-47d8891b3528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:23:27 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-5da1b8dd-07b4-4b50-89f6-2102f0d8a0cf tempest-CreateVolumesFromImageTest-1602158055 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:23:27 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-5da1b8dd-07b4-4b50-89f6-2102f0d8a0cf tempest-CreateVolumesFromImageTest-1602158055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:23:27 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-5da1b8dd-07b4-4b50-89f6-2102f0d8a0cf tempest-CreateVolumesFromImageTest-1602158055 None] Flow 'volume_create_manager' (9f93edd8-33a3-40fc-bfce-28e891672c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:23:27 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-5da1b8dd-07b4-4b50-89f6-2102f0d8a0cf tempest-CreateVolumesFromImageTest-1602158055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (970832cd-f34c-4543-951a-0b3c52abae96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:23:27 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-5da1b8dd-07b4-4b50-89f6-2102f0d8a0cf tempest-CreateVolumesFromImageTest-1602158055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (970832cd-f34c-4543-951a-0b3c52abae96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:23:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-776995699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e7f57d2-74da-4b22-a647-8e0d3e0ce4fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8455530ee4d447eb67ea746ef2564ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:23:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:23:26Z,use_quota=True,user_id='b196721084d2490c84ee2089d9a00baf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:23:27 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-5da1b8dd-07b4-4b50-89f6-2102f0d8a0cf tempest-CreateVolumesFromImageTest-1602158055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc0d1dd9-0316-4567-8ff8-7721544c4634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:23:27 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-5da1b8dd-07b4-4b50-89f6-2102f0d8a0cf tempest-CreateVolumesFromImageTest-1602158055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc0d1dd9-0316-4567-8ff8-7721544c4634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:23:27 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-5da1b8dd-07b4-4b50-89f6-2102f0d8a0cf tempest-CreateVolumesFromImageTest-1602158055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9de41bef-7f91-4cb4-89f2-140f9f0fa7e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:23:27 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-5da1b8dd-07b4-4b50-89f6-2102f0d8a0cf tempest-CreateVolumesFromImageTest-1602158055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9de41bef-7f91-4cb4-89f2-140f9f0fa7e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e7f57d2-74da-4b22-a647-8e0d3e0ce4fc', 'volume_name': 'volume-9e7f57d2-74da-4b22-a647-8e0d3e0ce4fc', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:23:27 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-5da1b8dd-07b4-4b50-89f6-2102f0d8a0cf tempest-CreateVolumesFromImageTest-1602158055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c93e90c-b095-49fa-ba25-e49fde9cee2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:23:27 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-5da1b8dd-07b4-4b50-89f6-2102f0d8a0cf tempest-CreateVolumesFromImageTest-1602158055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c93e90c-b095-49fa-ba25-e49fde9cee2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:23:27 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-5da1b8dd-07b4-4b50-89f6-2102f0d8a0cf tempest-CreateVolumesFromImageTest-1602158055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (787f4c10-427f-467d-af37-9151a4c24ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:23:27 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-5da1b8dd-07b4-4b50-89f6-2102f0d8a0cf tempest-CreateVolumesFromImageTest-1602158055 None] Volume 9e7f57d2-74da-4b22-a647-8e0d3e0ce4fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e7f57d2-74da-4b22-a647-8e0d3e0ce4fc', 'volume_size': 1} Sep 10 21:23:27 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-5da1b8dd-07b4-4b50-89f6-2102f0d8a0cf tempest-CreateVolumesFromImageTest-1602158055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:23:28 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ed659da9-2c30-4fef-8f2b-2a48cd72ca42 tempest-CreateVolumesFromImageTest-1602158055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93be431f-f81f-47ba-9a4d-47d8891b3528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:23:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1795896750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29a598b2-42da-49d2-9f87-a7a7a2d1c1f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8455530ee4d447eb67ea746ef2564ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:23:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:23:27Z,use_quota=True,user_id='b196721084d2490c84ee2089d9a00baf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:23:28 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ed659da9-2c30-4fef-8f2b-2a48cd72ca42 tempest-CreateVolumesFromImageTest-1602158055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bb2e1c4-4310-4ec1-a095-cb234c8c8f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:23:28 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ed659da9-2c30-4fef-8f2b-2a48cd72ca42 tempest-CreateVolumesFromImageTest-1602158055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bb2e1c4-4310-4ec1-a095-cb234c8c8f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:23:28 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ed659da9-2c30-4fef-8f2b-2a48cd72ca42 tempest-CreateVolumesFromImageTest-1602158055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f23399c-61ba-428c-bc6c-ac8c7f12895d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:23:28 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ed659da9-2c30-4fef-8f2b-2a48cd72ca42 tempest-CreateVolumesFromImageTest-1602158055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f23399c-61ba-428c-bc6c-ac8c7f12895d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29a598b2-42da-49d2-9f87-a7a7a2d1c1f5', 'volume_name': 'volume-29a598b2-42da-49d2-9f87-a7a7a2d1c1f5', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:23:28 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ed659da9-2c30-4fef-8f2b-2a48cd72ca42 tempest-CreateVolumesFromImageTest-1602158055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8df2d169-5bfd-4498-8e5d-d52e8bdc1825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:23:28 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ed659da9-2c30-4fef-8f2b-2a48cd72ca42 tempest-CreateVolumesFromImageTest-1602158055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8df2d169-5bfd-4498-8e5d-d52e8bdc1825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:23:28 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ed659da9-2c30-4fef-8f2b-2a48cd72ca42 tempest-CreateVolumesFromImageTest-1602158055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c6b24db-bae7-41b7-a708-e6f4107e474e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:23:28 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-ed659da9-2c30-4fef-8f2b-2a48cd72ca42 tempest-CreateVolumesFromImageTest-1602158055 None] Volume 29a598b2-42da-49d2-9f87-a7a7a2d1c1f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29a598b2-42da-49d2-9f87-a7a7a2d1c1f5', 'volume_size': 1} Sep 10 21:23:28 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-ed659da9-2c30-4fef-8f2b-2a48cd72ca42 tempest-CreateVolumesFromImageTest-1602158055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:23:28 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-be573152-e46e-4b55-a482-dd6ece45c0fa tempest-CreateVolumesFromImageTest-1602158055 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:23:28 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-be573152-e46e-4b55-a482-dd6ece45c0fa tempest-CreateVolumesFromImageTest-1602158055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:23:28 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-be573152-e46e-4b55-a482-dd6ece45c0fa tempest-CreateVolumesFromImageTest-1602158055 None] Flow 'volume_create_manager' (fdfb6980-599d-4a1b-b93b-d645d22c0a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:23:28 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-be573152-e46e-4b55-a482-dd6ece45c0fa tempest-CreateVolumesFromImageTest-1602158055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (902708a4-9254-4bbd-b3ef-a4a30073b68d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:23:28 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-11112f91-681e-4871-8196-a3804d186e4d tempest-CreateVolumesFromImageTest-1602158055 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-6fa1962b-c9a8-49f3-8d0d-ece163a159db" returned: 0 in 1.118s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:23:28 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-be573152-e46e-4b55-a482-dd6ece45c0fa tempest-CreateVolumesFromImageTest-1602158055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (902708a4-9254-4bbd-b3ef-a4a30073b68d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:23:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1290925002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=354174c0-bb2d-45a9-8397-3a088e84f749,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8455530ee4d447eb67ea746ef2564ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:23:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:23:28Z,use_quota=True,user_id='b196721084d2490c84ee2089d9a00baf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:23:28 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-be573152-e46e-4b55-a482-dd6ece45c0fa tempest-CreateVolumesFromImageTest-1602158055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bfd1c5a-9993-4662-8ad5-f9ae51bd025b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:23:28 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-be573152-e46e-4b55-a482-dd6ece45c0fa tempest-CreateVolumesFromImageTest-1602158055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bfd1c5a-9993-4662-8ad5-f9ae51bd025b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:23:28 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-be573152-e46e-4b55-a482-dd6ece45c0fa tempest-CreateVolumesFromImageTest-1602158055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0042e80c-0353-48bb-b913-974df551e19f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:23:28 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-be573152-e46e-4b55-a482-dd6ece45c0fa tempest-CreateVolumesFromImageTest-1602158055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0042e80c-0353-48bb-b913-974df551e19f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '354174c0-bb2d-45a9-8397-3a088e84f749', 'volume_name': 'volume-354174c0-bb2d-45a9-8397-3a088e84f749', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:23:28 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-be573152-e46e-4b55-a482-dd6ece45c0fa tempest-CreateVolumesFromImageTest-1602158055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cc78d68-2a8d-4eb3-8bc0-8109e590ec04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:23:28 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-be573152-e46e-4b55-a482-dd6ece45c0fa tempest-CreateVolumesFromImageTest-1602158055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cc78d68-2a8d-4eb3-8bc0-8109e590ec04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:23:28 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-be573152-e46e-4b55-a482-dd6ece45c0fa tempest-CreateVolumesFromImageTest-1602158055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1b57886-4768-4e1d-907a-3f7c8a199569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:23:28 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-be573152-e46e-4b55-a482-dd6ece45c0fa tempest-CreateVolumesFromImageTest-1602158055 None] Volume 354174c0-bb2d-45a9-8397-3a088e84f749: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-354174c0-bb2d-45a9-8397-3a088e84f749', 'volume_size': 1} Sep 10 21:23:28 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-be573152-e46e-4b55-a482-dd6ece45c0fa tempest-CreateVolumesFromImageTest-1602158055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:23:28 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-11112f91-681e-4871-8196-a3804d186e4d tempest-CreateVolumesFromImageTest-1602158055 None] <== create_volume: return (1984ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:23:28 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-11112f91-681e-4871-8196-a3804d186e4d tempest-CreateVolumesFromImageTest-1602158055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.991s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:23:28 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-5da1b8dd-07b4-4b50-89f6-2102f0d8a0cf tempest-CreateVolumesFromImageTest-1602158055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.320s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:23:28 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-5da1b8dd-07b4-4b50-89f6-2102f0d8a0cf tempest-CreateVolumesFromImageTest-1602158055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:23:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-776995699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e7f57d2-74da-4b22-a647-8e0d3e0ce4fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8455530ee4d447eb67ea746ef2564ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:23:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:23:26Z,use_quota=True,user_id='b196721084d2490c84ee2089d9a00baf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:23:28 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-5da1b8dd-07b4-4b50-89f6-2102f0d8a0cf tempest-CreateVolumesFromImageTest-1602158055 None] Creating volume 9e7f57d2-74da-4b22-a647-8e0d3e0ce4fc {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:23:28 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-5da1b8dd-07b4-4b50-89f6-2102f0d8a0cf tempest-CreateVolumesFromImageTest-1602158055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:23:28 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-5da1b8dd-07b4-4b50-89f6-2102f0d8a0cf tempest-CreateVolumesFromImageTest-1602158055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:23:28 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-5da1b8dd-07b4-4b50-89f6-2102f0d8a0cf tempest-CreateVolumesFromImageTest-1602158055 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:23:28 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-5da1b8dd-07b4-4b50-89f6-2102f0d8a0cf tempest-CreateVolumesFromImageTest-1602158055 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:23:28 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-5da1b8dd-07b4-4b50-89f6-2102f0d8a0cf tempest-CreateVolumesFromImageTest-1602158055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:23:28 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-5da1b8dd-07b4-4b50-89f6-2102f0d8a0cf tempest-CreateVolumesFromImageTest-1602158055 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:23:28 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-5da1b8dd-07b4-4b50-89f6-2102f0d8a0cf tempest-CreateVolumesFromImageTest-1602158055 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:23:28 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-5da1b8dd-07b4-4b50-89f6-2102f0d8a0cf tempest-CreateVolumesFromImageTest-1602158055 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-9e7f57d2-74da-4b22-a647-8e0d3e0ce4fc 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:23:28 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=61, name=volume-9e7f57d2-74da-4b22-a647-8e0d3e0ce4fc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:23:28 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-11112f91-681e-4871-8196-a3804d186e4d tempest-CreateVolumesFromImageTest-1602158055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f89ca71-681e-4c7a-a989-db2929c41255) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fa1962b-c9a8-49f3-8d0d-ece163a159db', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:23:28 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-11112f91-681e-4871-8196-a3804d186e4d tempest-CreateVolumesFromImageTest-1602158055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b94271ce-e14a-4c78-872b-4310e8a9b943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:23:28 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-3b5349c7-1bd8-481d-b2a9-43abae8a43e3 tempest-VolumesMetadataTest-2014251078 None] Acquiring lock "cinder-1579e5ee-3e9c-411e-ab20-88009124ff09-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:23:28 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-c89e93f0-cbee-476c-afe0-aec17de6c24d tempest-CreateVolumesFromImageTest-1602158055 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:23:28 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-c89e93f0-cbee-476c-afe0-aec17de6c24d tempest-CreateVolumesFromImageTest-1602158055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:23:28 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c89e93f0-cbee-476c-afe0-aec17de6c24d tempest-CreateVolumesFromImageTest-1602158055 None] Flow 'volume_create_manager' (8fec0733-d5b0-40aa-a63e-1a8b62ad5d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:23:28 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c89e93f0-cbee-476c-afe0-aec17de6c24d tempest-CreateVolumesFromImageTest-1602158055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b33650e7-d247-4d66-a1a7-61bfeb03772b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:23:29 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-5da1b8dd-07b4-4b50-89f6-2102f0d8a0cf tempest-CreateVolumesFromImageTest-1602158055 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-9e7f57d2-74da-4b22-a647-8e0d3e0ce4fc 1073741824" returned: 0 in 0.737s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:23:29 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-5da1b8dd-07b4-4b50-89f6-2102f0d8a0cf tempest-CreateVolumesFromImageTest-1602158055 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-9e7f57d2-74da-4b22-a647-8e0d3e0ce4fc {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:23:29 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c89e93f0-cbee-476c-afe0-aec17de6c24d tempest-CreateVolumesFromImageTest-1602158055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b33650e7-d247-4d66-a1a7-61bfeb03772b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:23:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1763464906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0cf83c9-32c5-4ed6-9222-4f7f371590cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8455530ee4d447eb67ea746ef2564ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:23:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:23:28Z,use_quota=True,user_id='b196721084d2490c84ee2089d9a00baf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:23:29 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c89e93f0-cbee-476c-afe0-aec17de6c24d tempest-CreateVolumesFromImageTest-1602158055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f21bbe96-c726-4cb3-b211-ab10f2afe3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:23:29 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c89e93f0-cbee-476c-afe0-aec17de6c24d tempest-CreateVolumesFromImageTest-1602158055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f21bbe96-c726-4cb3-b211-ab10f2afe3c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:23:29 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c89e93f0-cbee-476c-afe0-aec17de6c24d tempest-CreateVolumesFromImageTest-1602158055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f15f85f9-8003-4a94-948e-e32f852f55f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:23:29 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c89e93f0-cbee-476c-afe0-aec17de6c24d tempest-CreateVolumesFromImageTest-1602158055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f15f85f9-8003-4a94-948e-e32f852f55f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0cf83c9-32c5-4ed6-9222-4f7f371590cd', 'volume_name': 'volume-a0cf83c9-32c5-4ed6-9222-4f7f371590cd', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:23:29 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c89e93f0-cbee-476c-afe0-aec17de6c24d tempest-CreateVolumesFromImageTest-1602158055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0928767-0862-4132-a664-499518a1aee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:23:29 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c89e93f0-cbee-476c-afe0-aec17de6c24d tempest-CreateVolumesFromImageTest-1602158055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0928767-0862-4132-a664-499518a1aee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:23:29 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c89e93f0-cbee-476c-afe0-aec17de6c24d tempest-CreateVolumesFromImageTest-1602158055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fd9cb9f-b463-4a16-b1c4-782f8da0b21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:23:29 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-c89e93f0-cbee-476c-afe0-aec17de6c24d tempest-CreateVolumesFromImageTest-1602158055 None] Volume a0cf83c9-32c5-4ed6-9222-4f7f371590cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0cf83c9-32c5-4ed6-9222-4f7f371590cd', 'volume_size': 1} Sep 10 21:23:29 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-c89e93f0-cbee-476c-afe0-aec17de6c24d tempest-CreateVolumesFromImageTest-1602158055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:23:29 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-11112f91-681e-4871-8196-a3804d186e4d tempest-CreateVolumesFromImageTest-1602158055 None] Volume volume-6fa1962b-c9a8-49f3-8d0d-ece163a159db (6fa1962b-c9a8-49f3-8d0d-ece163a159db): created successfully Sep 10 21:23:29 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-11112f91-681e-4871-8196-a3804d186e4d tempest-CreateVolumesFromImageTest-1602158055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b94271ce-e14a-4c78-872b-4310e8a9b943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:23:29 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-11112f91-681e-4871-8196-a3804d186e4d tempest-CreateVolumesFromImageTest-1602158055 None] Flow 'volume_create_manager' (1220b3a8-e5d2-414a-a2e2-ee0920c6779b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:23:29 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-3b5349c7-1bd8-481d-b2a9-43abae8a43e3 tempest-VolumesMetadataTest-2014251078 None] Lock "cinder-1579e5ee-3e9c-411e-ab20-88009124ff09-delete_volume" acquired by "delete_volume" :: waited 0.657s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:23:29 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-5da1b8dd-07b4-4b50-89f6-2102f0d8a0cf tempest-CreateVolumesFromImageTest-1602158055 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-9e7f57d2-74da-4b22-a647-8e0d3e0ce4fc" returned: 0 in 0.478s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:23:29 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-5da1b8dd-07b4-4b50-89f6-2102f0d8a0cf tempest-CreateVolumesFromImageTest-1602158055 None] <== create_volume: return (1238ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:23:29 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-5da1b8dd-07b4-4b50-89f6-2102f0d8a0cf tempest-CreateVolumesFromImageTest-1602158055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.245s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:23:29 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-ed659da9-2c30-4fef-8f2b-2a48cd72ca42 tempest-CreateVolumesFromImageTest-1602158055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.457s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:23:29 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-ed659da9-2c30-4fef-8f2b-2a48cd72ca42 tempest-CreateVolumesFromImageTest-1602158055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:23:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1795896750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29a598b2-42da-49d2-9f87-a7a7a2d1c1f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8455530ee4d447eb67ea746ef2564ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:23:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:23:27Z,use_quota=True,user_id='b196721084d2490c84ee2089d9a00baf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:23:29 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-ed659da9-2c30-4fef-8f2b-2a48cd72ca42 tempest-CreateVolumesFromImageTest-1602158055 None] Creating volume 29a598b2-42da-49d2-9f87-a7a7a2d1c1f5 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:23:29 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-ed659da9-2c30-4fef-8f2b-2a48cd72ca42 tempest-CreateVolumesFromImageTest-1602158055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:23:29 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-ed659da9-2c30-4fef-8f2b-2a48cd72ca42 tempest-CreateVolumesFromImageTest-1602158055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:23:29 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-ed659da9-2c30-4fef-8f2b-2a48cd72ca42 tempest-CreateVolumesFromImageTest-1602158055 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:23:29 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-ed659da9-2c30-4fef-8f2b-2a48cd72ca42 tempest-CreateVolumesFromImageTest-1602158055 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:23:29 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-ed659da9-2c30-4fef-8f2b-2a48cd72ca42 tempest-CreateVolumesFromImageTest-1602158055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:23:29 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-ed659da9-2c30-4fef-8f2b-2a48cd72ca42 tempest-CreateVolumesFromImageTest-1602158055 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:23:29 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-ed659da9-2c30-4fef-8f2b-2a48cd72ca42 tempest-CreateVolumesFromImageTest-1602158055 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:23:29 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ed659da9-2c30-4fef-8f2b-2a48cd72ca42 tempest-CreateVolumesFromImageTest-1602158055 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-29a598b2-42da-49d2-9f87-a7a7a2d1c1f5 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:23:29 devstack quobyte-client[82807]: System call of process 94046 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:23:29 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=62, name=volume-29a598b2-42da-49d2-9f87-a7a7a2d1c1f5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:23:29 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-11112f91-681e-4871-8196-a3804d186e4d tempest-CreateVolumesFromImageTest-1602158055 None] Created volume successfully. Sep 10 21:23:30 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-5da1b8dd-07b4-4b50-89f6-2102f0d8a0cf tempest-CreateVolumesFromImageTest-1602158055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (787f4c10-427f-467d-af37-9151a4c24ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e7f57d2-74da-4b22-a647-8e0d3e0ce4fc', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:23:30 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-5da1b8dd-07b4-4b50-89f6-2102f0d8a0cf tempest-CreateVolumesFromImageTest-1602158055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d342a83-8852-4cfc-a133-6267b740e6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:23:30 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-3b5349c7-1bd8-481d-b2a9-43abae8a43e3 tempest-VolumesMetadataTest-2014251078 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:23:30 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-3b5349c7-1bd8-481d-b2a9-43abae8a43e3 tempest-VolumesMetadataTest-2014251078 None] Acquiring lock "cinder-quobyte-1579e5ee-3e9c-411e-ab20-88009124ff09" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:23:30 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ed659da9-2c30-4fef-8f2b-2a48cd72ca42 tempest-CreateVolumesFromImageTest-1602158055 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-29a598b2-42da-49d2-9f87-a7a7a2d1c1f5 1073741824" returned: 0 in 0.643s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:23:30 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ed659da9-2c30-4fef-8f2b-2a48cd72ca42 tempest-CreateVolumesFromImageTest-1602158055 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-29a598b2-42da-49d2-9f87-a7a7a2d1c1f5 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:23:30 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-5da1b8dd-07b4-4b50-89f6-2102f0d8a0cf tempest-CreateVolumesFromImageTest-1602158055 None] Volume volume-9e7f57d2-74da-4b22-a647-8e0d3e0ce4fc (9e7f57d2-74da-4b22-a647-8e0d3e0ce4fc): created successfully Sep 10 21:23:30 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-5da1b8dd-07b4-4b50-89f6-2102f0d8a0cf tempest-CreateVolumesFromImageTest-1602158055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d342a83-8852-4cfc-a133-6267b740e6ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:23:30 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-5da1b8dd-07b4-4b50-89f6-2102f0d8a0cf tempest-CreateVolumesFromImageTest-1602158055 None] Flow 'volume_create_manager' (9f93edd8-33a3-40fc-bfce-28e891672c16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:23:30 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-3b5349c7-1bd8-481d-b2a9-43abae8a43e3 tempest-VolumesMetadataTest-2014251078 None] Lock "cinder-quobyte-1579e5ee-3e9c-411e-ab20-88009124ff09" acquired by "delete_volume" :: waited 0.424s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:23:30 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ed659da9-2c30-4fef-8f2b-2a48cd72ca42 tempest-CreateVolumesFromImageTest-1602158055 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-29a598b2-42da-49d2-9f87-a7a7a2d1c1f5" returned: 0 in 0.425s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:23:30 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-ed659da9-2c30-4fef-8f2b-2a48cd72ca42 tempest-CreateVolumesFromImageTest-1602158055 None] <== create_volume: return (1085ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:23:30 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-ed659da9-2c30-4fef-8f2b-2a48cd72ca42 tempest-CreateVolumesFromImageTest-1602158055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:23:30 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-be573152-e46e-4b55-a482-dd6ece45c0fa tempest-CreateVolumesFromImageTest-1602158055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.385s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:23:30 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-be573152-e46e-4b55-a482-dd6ece45c0fa tempest-CreateVolumesFromImageTest-1602158055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:23:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1290925002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=354174c0-bb2d-45a9-8397-3a088e84f749,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8455530ee4d447eb67ea746ef2564ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:23:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:23:28Z,use_quota=True,user_id='b196721084d2490c84ee2089d9a00baf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:23:30 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-be573152-e46e-4b55-a482-dd6ece45c0fa tempest-CreateVolumesFromImageTest-1602158055 None] Creating volume 354174c0-bb2d-45a9-8397-3a088e84f749 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:23:30 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-be573152-e46e-4b55-a482-dd6ece45c0fa tempest-CreateVolumesFromImageTest-1602158055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:23:30 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-be573152-e46e-4b55-a482-dd6ece45c0fa tempest-CreateVolumesFromImageTest-1602158055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:23:30 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-be573152-e46e-4b55-a482-dd6ece45c0fa tempest-CreateVolumesFromImageTest-1602158055 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:23:30 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-be573152-e46e-4b55-a482-dd6ece45c0fa tempest-CreateVolumesFromImageTest-1602158055 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:23:30 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-be573152-e46e-4b55-a482-dd6ece45c0fa tempest-CreateVolumesFromImageTest-1602158055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:23:30 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-be573152-e46e-4b55-a482-dd6ece45c0fa tempest-CreateVolumesFromImageTest-1602158055 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:23:30 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-be573152-e46e-4b55-a482-dd6ece45c0fa tempest-CreateVolumesFromImageTest-1602158055 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:23:30 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-be573152-e46e-4b55-a482-dd6ece45c0fa tempest-CreateVolumesFromImageTest-1602158055 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-354174c0-bb2d-45a9-8397-3a088e84f749 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:23:30 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-5da1b8dd-07b4-4b50-89f6-2102f0d8a0cf tempest-CreateVolumesFromImageTest-1602158055 None] Created volume successfully. Sep 10 21:23:30 devstack quobyte-client[82807]: System call of process 94050 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:23:30 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=63, name=volume-354174c0-bb2d-45a9-8397-3a088e84f749, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:23:30 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5bd4bc0-6d0a-425b-ad0c-1b9de0dd0162]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:23:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-3b5349c7-1bd8-481d-b2a9-43abae8a43e3 tempest-VolumesMetadataTest-2014251078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1579e5ee-3e9c-411e-ab20-88009124ff09 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:23:31 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ed659da9-2c30-4fef-8f2b-2a48cd72ca42 tempest-CreateVolumesFromImageTest-1602158055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c6b24db-bae7-41b7-a708-e6f4107e474e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29a598b2-42da-49d2-9f87-a7a7a2d1c1f5', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:23:31 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ed659da9-2c30-4fef-8f2b-2a48cd72ca42 tempest-CreateVolumesFromImageTest-1602158055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcfa83be-d66d-4bdd-af3b-de3d550f4d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:23:31 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-ed659da9-2c30-4fef-8f2b-2a48cd72ca42 tempest-CreateVolumesFromImageTest-1602158055 None] Volume volume-29a598b2-42da-49d2-9f87-a7a7a2d1c1f5 (29a598b2-42da-49d2-9f87-a7a7a2d1c1f5): created successfully Sep 10 21:23:31 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ed659da9-2c30-4fef-8f2b-2a48cd72ca42 tempest-CreateVolumesFromImageTest-1602158055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcfa83be-d66d-4bdd-af3b-de3d550f4d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:23:31 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ed659da9-2c30-4fef-8f2b-2a48cd72ca42 tempest-CreateVolumesFromImageTest-1602158055 None] Flow 'volume_create_manager' (9d83ee37-bd57-42a3-85fa-6e9527c965af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:23:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-be573152-e46e-4b55-a482-dd6ece45c0fa tempest-CreateVolumesFromImageTest-1602158055 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-354174c0-bb2d-45a9-8397-3a088e84f749 1073741824" returned: 0 in 0.831s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:23:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-be573152-e46e-4b55-a482-dd6ece45c0fa tempest-CreateVolumesFromImageTest-1602158055 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-354174c0-bb2d-45a9-8397-3a088e84f749 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:23:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-be573152-e46e-4b55-a482-dd6ece45c0fa tempest-CreateVolumesFromImageTest-1602158055 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-354174c0-bb2d-45a9-8397-3a088e84f749" returned: 0 in 0.195s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:23:31 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-be573152-e46e-4b55-a482-dd6ece45c0fa tempest-CreateVolumesFromImageTest-1602158055 None] <== create_volume: return (1071ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:23:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-be573152-e46e-4b55-a482-dd6ece45c0fa tempest-CreateVolumesFromImageTest-1602158055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:23:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-c89e93f0-cbee-476c-afe0-aec17de6c24d tempest-CreateVolumesFromImageTest-1602158055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.472s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:23:31 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-c89e93f0-cbee-476c-afe0-aec17de6c24d tempest-CreateVolumesFromImageTest-1602158055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:23:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1763464906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0cf83c9-32c5-4ed6-9222-4f7f371590cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8455530ee4d447eb67ea746ef2564ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:23:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:23:28Z,use_quota=True,user_id='b196721084d2490c84ee2089d9a00baf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:23:31 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-c89e93f0-cbee-476c-afe0-aec17de6c24d tempest-CreateVolumesFromImageTest-1602158055 None] Creating volume a0cf83c9-32c5-4ed6-9222-4f7f371590cd {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:23:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-c89e93f0-cbee-476c-afe0-aec17de6c24d tempest-CreateVolumesFromImageTest-1602158055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:23:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-c89e93f0-cbee-476c-afe0-aec17de6c24d tempest-CreateVolumesFromImageTest-1602158055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:23:31 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-c89e93f0-cbee-476c-afe0-aec17de6c24d tempest-CreateVolumesFromImageTest-1602158055 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:23:31 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-c89e93f0-cbee-476c-afe0-aec17de6c24d tempest-CreateVolumesFromImageTest-1602158055 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:23:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-c89e93f0-cbee-476c-afe0-aec17de6c24d tempest-CreateVolumesFromImageTest-1602158055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:23:31 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-c89e93f0-cbee-476c-afe0-aec17de6c24d tempest-CreateVolumesFromImageTest-1602158055 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:23:31 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-c89e93f0-cbee-476c-afe0-aec17de6c24d tempest-CreateVolumesFromImageTest-1602158055 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:23:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c89e93f0-cbee-476c-afe0-aec17de6c24d tempest-CreateVolumesFromImageTest-1602158055 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a0cf83c9-32c5-4ed6-9222-4f7f371590cd 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:23:32 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-ed659da9-2c30-4fef-8f2b-2a48cd72ca42 tempest-CreateVolumesFromImageTest-1602158055 None] Created volume successfully. Sep 10 21:23:32 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=64, name=volume-a0cf83c9-32c5-4ed6-9222-4f7f371590cd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:23:32 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-3b5349c7-1bd8-481d-b2a9-43abae8a43e3 tempest-VolumesMetadataTest-2014251078 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1579e5ee-3e9c-411e-ab20-88009124ff09" returned: 0 in 1.136s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:23:32 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-3b5349c7-1bd8-481d-b2a9-43abae8a43e3 tempest-VolumesMetadataTest-2014251078 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1579e5ee-3e9c-411e-ab20-88009124ff09 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:23:32 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-be573152-e46e-4b55-a482-dd6ece45c0fa tempest-CreateVolumesFromImageTest-1602158055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1b57886-4768-4e1d-907a-3f7c8a199569) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-354174c0-bb2d-45a9-8397-3a088e84f749', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:23:32 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-be573152-e46e-4b55-a482-dd6ece45c0fa tempest-CreateVolumesFromImageTest-1602158055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c32f4484-8c14-4107-9ed7-2811c2368b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:23:32 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c89e93f0-cbee-476c-afe0-aec17de6c24d tempest-CreateVolumesFromImageTest-1602158055 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a0cf83c9-32c5-4ed6-9222-4f7f371590cd 1073741824" returned: 0 in 0.706s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:23:32 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-3b5349c7-1bd8-481d-b2a9-43abae8a43e3 tempest-VolumesMetadataTest-2014251078 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1579e5ee-3e9c-411e-ab20-88009124ff09" returned: 0 in 0.400s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:23:32 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c89e93f0-cbee-476c-afe0-aec17de6c24d tempest-CreateVolumesFromImageTest-1602158055 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a0cf83c9-32c5-4ed6-9222-4f7f371590cd {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:23:32 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-be573152-e46e-4b55-a482-dd6ece45c0fa tempest-CreateVolumesFromImageTest-1602158055 None] Volume volume-354174c0-bb2d-45a9-8397-3a088e84f749 (354174c0-bb2d-45a9-8397-3a088e84f749): created successfully Sep 10 21:23:32 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-be573152-e46e-4b55-a482-dd6ece45c0fa tempest-CreateVolumesFromImageTest-1602158055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c32f4484-8c14-4107-9ed7-2811c2368b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:23:32 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-be573152-e46e-4b55-a482-dd6ece45c0fa tempest-CreateVolumesFromImageTest-1602158055 None] Flow 'volume_create_manager' (fdfb6980-599d-4a1b-b93b-d645d22c0a4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:23:32 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-3b5349c7-1bd8-481d-b2a9-43abae8a43e3 tempest-VolumesMetadataTest-2014251078 None] Lock "cinder-quobyte-1579e5ee-3e9c-411e-ab20-88009124ff09" released by "delete_volume" :: held 2.336s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:23:33 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c89e93f0-cbee-476c-afe0-aec17de6c24d tempest-CreateVolumesFromImageTest-1602158055 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a0cf83c9-32c5-4ed6-9222-4f7f371590cd" returned: 0 in 0.454s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:23:33 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-c89e93f0-cbee-476c-afe0-aec17de6c24d tempest-CreateVolumesFromImageTest-1602158055 None] <== create_volume: return (1196ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:23:33 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-c89e93f0-cbee-476c-afe0-aec17de6c24d tempest-CreateVolumesFromImageTest-1602158055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.217s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:23:33 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-be573152-e46e-4b55-a482-dd6ece45c0fa tempest-CreateVolumesFromImageTest-1602158055 None] Created volume successfully. Sep 10 21:23:33 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c89e93f0-cbee-476c-afe0-aec17de6c24d tempest-CreateVolumesFromImageTest-1602158055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fd9cb9f-b463-4a16-b1c4-782f8da0b21e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0cf83c9-32c5-4ed6-9222-4f7f371590cd', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:23:33 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c89e93f0-cbee-476c-afe0-aec17de6c24d tempest-CreateVolumesFromImageTest-1602158055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b35f3ea-2fff-42cb-be80-9fb5feeb5d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:23:33 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-c89e93f0-cbee-476c-afe0-aec17de6c24d tempest-CreateVolumesFromImageTest-1602158055 None] Volume volume-a0cf83c9-32c5-4ed6-9222-4f7f371590cd (a0cf83c9-32c5-4ed6-9222-4f7f371590cd): created successfully Sep 10 21:23:33 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c89e93f0-cbee-476c-afe0-aec17de6c24d tempest-CreateVolumesFromImageTest-1602158055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b35f3ea-2fff-42cb-be80-9fb5feeb5d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:23:33 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c89e93f0-cbee-476c-afe0-aec17de6c24d tempest-CreateVolumesFromImageTest-1602158055 None] Flow 'volume_create_manager' (8fec0733-d5b0-40aa-a63e-1a8b62ad5d0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:23:33 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-3b5349c7-1bd8-481d-b2a9-43abae8a43e3 tempest-VolumesMetadataTest-2014251078 None] Created reservations ['b0712cf9-5f3c-43ab-a6bf-89801e3dff5c', '1d9a833e-ab77-4a19-b8c5-69a411e67ffd', '03366fff-32ed-478a-965c-b09769421316', '94be9b47-84fc-42d1-a13d-209c9ef7e195'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:23:33 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-c89e93f0-cbee-476c-afe0-aec17de6c24d tempest-CreateVolumesFromImageTest-1602158055 None] Created volume successfully. Sep 10 21:23:33 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-3b5349c7-1bd8-481d-b2a9-43abae8a43e3 tempest-VolumesMetadataTest-2014251078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:23:33 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-3b5349c7-1bd8-481d-b2a9-43abae8a43e3 tempest-VolumesMetadataTest-2014251078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:23:33 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-3b5349c7-1bd8-481d-b2a9-43abae8a43e3 tempest-VolumesMetadataTest-2014251078 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:23:33 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-3b5349c7-1bd8-481d-b2a9-43abae8a43e3 tempest-VolumesMetadataTest-2014251078 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:23:33 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-3b5349c7-1bd8-481d-b2a9-43abae8a43e3 tempest-VolumesMetadataTest-2014251078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:23:33 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-3b5349c7-1bd8-481d-b2a9-43abae8a43e3 tempest-VolumesMetadataTest-2014251078 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:23:33 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-3b5349c7-1bd8-481d-b2a9-43abae8a43e3 tempest-VolumesMetadataTest-2014251078 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.111s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:23:33 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-3b5349c7-1bd8-481d-b2a9-43abae8a43e3 tempest-VolumesMetadataTest-2014251078 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:23:33 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-3b5349c7-1bd8-481d-b2a9-43abae8a43e3 tempest-VolumesMetadataTest-2014251078 None] Deleted volume successfully. Sep 10 21:23:33 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-3b5349c7-1bd8-481d-b2a9-43abae8a43e3 tempest-VolumesMetadataTest-2014251078 None] Lock "cinder-1579e5ee-3e9c-411e-ab20-88009124ff09-delete_volume" released by "delete_volume" :: held 4.397s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:23:34 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-705948be-def0-4b83-bd61-263044ec8802 tempest-CreateVolumesFromImageTest-1602158055 None] Acquiring lock "cinder-a0cf83c9-32c5-4ed6-9222-4f7f371590cd-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:23:34 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-705948be-def0-4b83-bd61-263044ec8802 tempest-CreateVolumesFromImageTest-1602158055 None] Lock "cinder-a0cf83c9-32c5-4ed6-9222-4f7f371590cd-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:23:34 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-705948be-def0-4b83-bd61-263044ec8802 tempest-CreateVolumesFromImageTest-1602158055 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:23:34 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-705948be-def0-4b83-bd61-263044ec8802 tempest-CreateVolumesFromImageTest-1602158055 None] Acquiring lock "cinder-quobyte-a0cf83c9-32c5-4ed6-9222-4f7f371590cd" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:23:34 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-705948be-def0-4b83-bd61-263044ec8802 tempest-CreateVolumesFromImageTest-1602158055 None] Lock "cinder-quobyte-a0cf83c9-32c5-4ed6-9222-4f7f371590cd" acquired by "delete_volume" :: waited 0.012s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:23:34 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[59301ac7-379e-4844-9997-570350db3ad9]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:23:34 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-705948be-def0-4b83-bd61-263044ec8802 tempest-CreateVolumesFromImageTest-1602158055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a0cf83c9-32c5-4ed6-9222-4f7f371590cd {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:23:35 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-705948be-def0-4b83-bd61-263044ec8802 tempest-CreateVolumesFromImageTest-1602158055 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a0cf83c9-32c5-4ed6-9222-4f7f371590cd" returned: 0 in 0.519s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:23:35 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-705948be-def0-4b83-bd61-263044ec8802 tempest-CreateVolumesFromImageTest-1602158055 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a0cf83c9-32c5-4ed6-9222-4f7f371590cd {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:23:35 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-705948be-def0-4b83-bd61-263044ec8802 tempest-CreateVolumesFromImageTest-1602158055 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a0cf83c9-32c5-4ed6-9222-4f7f371590cd" returned: 0 in 0.116s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:23:35 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-705948be-def0-4b83-bd61-263044ec8802 tempest-CreateVolumesFromImageTest-1602158055 None] Lock "cinder-quobyte-a0cf83c9-32c5-4ed6-9222-4f7f371590cd" released by "delete_volume" :: held 0.920s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:23:36 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-705948be-def0-4b83-bd61-263044ec8802 tempest-CreateVolumesFromImageTest-1602158055 None] Created reservations ['1e983e5c-5284-43b6-aef6-23347ca710bd', '2a0c636c-c5c1-4c29-b947-f916db1797fb', '762cd49e-9a1d-4049-bb0f-85eee6436229', '26c8fdb6-5f6d-47a3-a39b-190737aad5d2'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:23:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-705948be-def0-4b83-bd61-263044ec8802 tempest-CreateVolumesFromImageTest-1602158055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:23:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-705948be-def0-4b83-bd61-263044ec8802 tempest-CreateVolumesFromImageTest-1602158055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:23:36 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-705948be-def0-4b83-bd61-263044ec8802 tempest-CreateVolumesFromImageTest-1602158055 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:23:36 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-705948be-def0-4b83-bd61-263044ec8802 tempest-CreateVolumesFromImageTest-1602158055 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:23:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-705948be-def0-4b83-bd61-263044ec8802 tempest-CreateVolumesFromImageTest-1602158055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:23:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-705948be-def0-4b83-bd61-263044ec8802 tempest-CreateVolumesFromImageTest-1602158055 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:23:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-705948be-def0-4b83-bd61-263044ec8802 tempest-CreateVolumesFromImageTest-1602158055 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.152s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:23:36 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-705948be-def0-4b83-bd61-263044ec8802 tempest-CreateVolumesFromImageTest-1602158055 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:23:37 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-705948be-def0-4b83-bd61-263044ec8802 tempest-CreateVolumesFromImageTest-1602158055 None] Deleted volume successfully. Sep 10 21:23:37 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-ab4aec2f-be98-4fdd-a3ae-5d6ca27a3edf tempest-CreateVolumesFromImageTest-1602158055 None] Acquiring lock "cinder-354174c0-bb2d-45a9-8397-3a088e84f749-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:23:37 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-705948be-def0-4b83-bd61-263044ec8802 tempest-CreateVolumesFromImageTest-1602158055 None] Lock "cinder-a0cf83c9-32c5-4ed6-9222-4f7f371590cd-delete_volume" released by "delete_volume" :: held 2.795s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:23:37 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-ab4aec2f-be98-4fdd-a3ae-5d6ca27a3edf tempest-CreateVolumesFromImageTest-1602158055 None] Lock "cinder-354174c0-bb2d-45a9-8397-3a088e84f749-delete_volume" acquired by "delete_volume" :: waited 0.101s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:23:37 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-ab4aec2f-be98-4fdd-a3ae-5d6ca27a3edf tempest-CreateVolumesFromImageTest-1602158055 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:23:37 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-ab4aec2f-be98-4fdd-a3ae-5d6ca27a3edf tempest-CreateVolumesFromImageTest-1602158055 None] Acquiring lock "cinder-quobyte-354174c0-bb2d-45a9-8397-3a088e84f749" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:23:37 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-ab4aec2f-be98-4fdd-a3ae-5d6ca27a3edf tempest-CreateVolumesFromImageTest-1602158055 None] Lock "cinder-quobyte-354174c0-bb2d-45a9-8397-3a088e84f749" acquired by "delete_volume" :: waited 0.015s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:23:37 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e51f703-198e-4c3a-ad23-f186f74d307b]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:23:37 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ab4aec2f-be98-4fdd-a3ae-5d6ca27a3edf tempest-CreateVolumesFromImageTest-1602158055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-354174c0-bb2d-45a9-8397-3a088e84f749 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:23:38 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ab4aec2f-be98-4fdd-a3ae-5d6ca27a3edf tempest-CreateVolumesFromImageTest-1602158055 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-354174c0-bb2d-45a9-8397-3a088e84f749" returned: 0 in 0.555s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:23:38 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ab4aec2f-be98-4fdd-a3ae-5d6ca27a3edf tempest-CreateVolumesFromImageTest-1602158055 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-354174c0-bb2d-45a9-8397-3a088e84f749 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:23:38 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ab4aec2f-be98-4fdd-a3ae-5d6ca27a3edf tempest-CreateVolumesFromImageTest-1602158055 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-354174c0-bb2d-45a9-8397-3a088e84f749" returned: 0 in 0.125s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:23:38 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-ab4aec2f-be98-4fdd-a3ae-5d6ca27a3edf tempest-CreateVolumesFromImageTest-1602158055 None] Lock "cinder-quobyte-354174c0-bb2d-45a9-8397-3a088e84f749" released by "delete_volume" :: held 0.877s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:23:38 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-ab4aec2f-be98-4fdd-a3ae-5d6ca27a3edf tempest-CreateVolumesFromImageTest-1602158055 None] Created reservations ['9e94728b-5d9f-4e1b-a7cf-c46e9f67e7e8', '3bb704c1-9ea1-4e62-b3ba-3d42c4a7bfdc', 'f01dd5a1-4171-4ccd-a6bd-838c042c472e', 'fd10de62-53b0-4abe-bf90-5c3e6bd77891'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:23:38 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-ab4aec2f-be98-4fdd-a3ae-5d6ca27a3edf tempest-CreateVolumesFromImageTest-1602158055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:23:38 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-ab4aec2f-be98-4fdd-a3ae-5d6ca27a3edf tempest-CreateVolumesFromImageTest-1602158055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:23:38 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-ab4aec2f-be98-4fdd-a3ae-5d6ca27a3edf tempest-CreateVolumesFromImageTest-1602158055 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:23:38 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-ab4aec2f-be98-4fdd-a3ae-5d6ca27a3edf tempest-CreateVolumesFromImageTest-1602158055 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:23:38 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-ab4aec2f-be98-4fdd-a3ae-5d6ca27a3edf tempest-CreateVolumesFromImageTest-1602158055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:23:38 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ab4aec2f-be98-4fdd-a3ae-5d6ca27a3edf tempest-CreateVolumesFromImageTest-1602158055 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:23:39 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ab4aec2f-be98-4fdd-a3ae-5d6ca27a3edf tempest-CreateVolumesFromImageTest-1602158055 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.140s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:23:39 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-ab4aec2f-be98-4fdd-a3ae-5d6ca27a3edf tempest-CreateVolumesFromImageTest-1602158055 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:23:39 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-ab4aec2f-be98-4fdd-a3ae-5d6ca27a3edf tempest-CreateVolumesFromImageTest-1602158055 None] Deleted volume successfully. Sep 10 21:23:39 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-ab4aec2f-be98-4fdd-a3ae-5d6ca27a3edf tempest-CreateVolumesFromImageTest-1602158055 None] Lock "cinder-354174c0-bb2d-45a9-8397-3a088e84f749-delete_volume" released by "delete_volume" :: held 2.025s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:23:39 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-c8e21a68-7533-4be4-b54c-a7ebe0344064 tempest-CreateVolumesFromImageTest-1602158055 None] Acquiring lock "cinder-29a598b2-42da-49d2-9f87-a7a7a2d1c1f5-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:23:39 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-c8e21a68-7533-4be4-b54c-a7ebe0344064 tempest-CreateVolumesFromImageTest-1602158055 None] Lock "cinder-29a598b2-42da-49d2-9f87-a7a7a2d1c1f5-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:23:39 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-c8e21a68-7533-4be4-b54c-a7ebe0344064 tempest-CreateVolumesFromImageTest-1602158055 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:23:39 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-c8e21a68-7533-4be4-b54c-a7ebe0344064 tempest-CreateVolumesFromImageTest-1602158055 None] Acquiring lock "cinder-quobyte-29a598b2-42da-49d2-9f87-a7a7a2d1c1f5" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:23:39 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-c8e21a68-7533-4be4-b54c-a7ebe0344064 tempest-CreateVolumesFromImageTest-1602158055 None] Lock "cinder-quobyte-29a598b2-42da-49d2-9f87-a7a7a2d1c1f5" acquired by "delete_volume" :: waited 0.013s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:23:39 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e03380e-f2b0-4f65-838f-81838be32ab5]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:23:39 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c8e21a68-7533-4be4-b54c-a7ebe0344064 tempest-CreateVolumesFromImageTest-1602158055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-29a598b2-42da-49d2-9f87-a7a7a2d1c1f5 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:23:40 devstack quobyte-client[82807]: System call of process 94106 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:23:40 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-de6bbc9c-cb32-4bb9-883a-fd5a6387c537 tempest-VolumesTransfersV355Test-1420676445 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:23:40 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-de6bbc9c-cb32-4bb9-883a-fd5a6387c537 tempest-VolumesTransfersV355Test-1420676445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:23:40 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-de6bbc9c-cb32-4bb9-883a-fd5a6387c537 tempest-VolumesTransfersV355Test-1420676445 None] Flow 'volume_create_manager' (afce97ee-6ce7-4ec9-a2e9-e62a2f40c18a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:23:40 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-de6bbc9c-cb32-4bb9-883a-fd5a6387c537 tempest-VolumesTransfersV355Test-1420676445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e9510a1-41f6-4e48-800a-85837f3363aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:23:40 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-de6bbc9c-cb32-4bb9-883a-fd5a6387c537 tempest-VolumesTransfersV355Test-1420676445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e9510a1-41f6-4e48-800a-85837f3363aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1446622065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbc23a4f-846f-4831-80be-16f8779355dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdd17a1f61df4b729390c3960c877890',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:23:40Z,use_quota=True,user_id='329d9fbdb17f49be95e5083e4d829677',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:23:40 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-de6bbc9c-cb32-4bb9-883a-fd5a6387c537 tempest-VolumesTransfersV355Test-1420676445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54de85c0-76d6-4ec7-a998-043dd5332911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:23:40 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-de6bbc9c-cb32-4bb9-883a-fd5a6387c537 tempest-VolumesTransfersV355Test-1420676445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54de85c0-76d6-4ec7-a998-043dd5332911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:23:40 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-de6bbc9c-cb32-4bb9-883a-fd5a6387c537 tempest-VolumesTransfersV355Test-1420676445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (639eb61e-53c2-48ac-86af-b6c61c06a27a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:23:40 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-de6bbc9c-cb32-4bb9-883a-fd5a6387c537 tempest-VolumesTransfersV355Test-1420676445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (639eb61e-53c2-48ac-86af-b6c61c06a27a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbc23a4f-846f-4831-80be-16f8779355dd', 'volume_name': 'volume-dbc23a4f-846f-4831-80be-16f8779355dd', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:23:40 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-de6bbc9c-cb32-4bb9-883a-fd5a6387c537 tempest-VolumesTransfersV355Test-1420676445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afd39031-19bb-4d2f-9483-5410b291286d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:23:40 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-de6bbc9c-cb32-4bb9-883a-fd5a6387c537 tempest-VolumesTransfersV355Test-1420676445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afd39031-19bb-4d2f-9483-5410b291286d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:23:40 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-de6bbc9c-cb32-4bb9-883a-fd5a6387c537 tempest-VolumesTransfersV355Test-1420676445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00417e1a-442e-40d6-a04d-fceea98be3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:23:40 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-de6bbc9c-cb32-4bb9-883a-fd5a6387c537 tempest-VolumesTransfersV355Test-1420676445 None] Volume dbc23a4f-846f-4831-80be-16f8779355dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbc23a4f-846f-4831-80be-16f8779355dd', 'volume_size': 1} Sep 10 21:23:40 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-de6bbc9c-cb32-4bb9-883a-fd5a6387c537 tempest-VolumesTransfersV355Test-1420676445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:23:40 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-de6bbc9c-cb32-4bb9-883a-fd5a6387c537 tempest-VolumesTransfersV355Test-1420676445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:23:40 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-de6bbc9c-cb32-4bb9-883a-fd5a6387c537 tempest-VolumesTransfersV355Test-1420676445 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1446622065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbc23a4f-846f-4831-80be-16f8779355dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdd17a1f61df4b729390c3960c877890',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:23:40Z,use_quota=True,user_id='329d9fbdb17f49be95e5083e4d829677',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:23:40 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-de6bbc9c-cb32-4bb9-883a-fd5a6387c537 tempest-VolumesTransfersV355Test-1420676445 None] Creating volume dbc23a4f-846f-4831-80be-16f8779355dd {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:23:40 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-de6bbc9c-cb32-4bb9-883a-fd5a6387c537 tempest-VolumesTransfersV355Test-1420676445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:23:40 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-de6bbc9c-cb32-4bb9-883a-fd5a6387c537 tempest-VolumesTransfersV355Test-1420676445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:23:40 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-de6bbc9c-cb32-4bb9-883a-fd5a6387c537 tempest-VolumesTransfersV355Test-1420676445 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:23:40 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-de6bbc9c-cb32-4bb9-883a-fd5a6387c537 tempest-VolumesTransfersV355Test-1420676445 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:23:40 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-de6bbc9c-cb32-4bb9-883a-fd5a6387c537 tempest-VolumesTransfersV355Test-1420676445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:23:40 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-de6bbc9c-cb32-4bb9-883a-fd5a6387c537 tempest-VolumesTransfersV355Test-1420676445 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:23:40 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-de6bbc9c-cb32-4bb9-883a-fd5a6387c537 tempest-VolumesTransfersV355Test-1420676445 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:23:40 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-de6bbc9c-cb32-4bb9-883a-fd5a6387c537 tempest-VolumesTransfersV355Test-1420676445 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-dbc23a4f-846f-4831-80be-16f8779355dd 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:23:40 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=65, name=volume-dbc23a4f-846f-4831-80be-16f8779355dd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:23:40 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c8e21a68-7533-4be4-b54c-a7ebe0344064 tempest-CreateVolumesFromImageTest-1602158055 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-29a598b2-42da-49d2-9f87-a7a7a2d1c1f5" returned: 0 in 0.981s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:23:40 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c8e21a68-7533-4be4-b54c-a7ebe0344064 tempest-CreateVolumesFromImageTest-1602158055 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-29a598b2-42da-49d2-9f87-a7a7a2d1c1f5 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:23:41 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c8e21a68-7533-4be4-b54c-a7ebe0344064 tempest-CreateVolumesFromImageTest-1602158055 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-29a598b2-42da-49d2-9f87-a7a7a2d1c1f5" returned: 0 in 0.163s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:23:41 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-c8e21a68-7533-4be4-b54c-a7ebe0344064 tempest-CreateVolumesFromImageTest-1602158055 None] Lock "cinder-quobyte-29a598b2-42da-49d2-9f87-a7a7a2d1c1f5" released by "delete_volume" :: held 1.360s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:23:41 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-de6bbc9c-cb32-4bb9-883a-fd5a6387c537 tempest-VolumesTransfersV355Test-1420676445 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-dbc23a4f-846f-4831-80be-16f8779355dd 1073741824" returned: 0 in 0.665s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:23:41 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-de6bbc9c-cb32-4bb9-883a-fd5a6387c537 tempest-VolumesTransfersV355Test-1420676445 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-dbc23a4f-846f-4831-80be-16f8779355dd {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:23:41 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-de6bbc9c-cb32-4bb9-883a-fd5a6387c537 tempest-VolumesTransfersV355Test-1420676445 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-dbc23a4f-846f-4831-80be-16f8779355dd" returned: 0 in 0.216s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:23:41 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-de6bbc9c-cb32-4bb9-883a-fd5a6387c537 tempest-VolumesTransfersV355Test-1420676445 None] <== create_volume: return (934ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:23:41 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-de6bbc9c-cb32-4bb9-883a-fd5a6387c537 tempest-VolumesTransfersV355Test-1420676445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:23:41 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-de6bbc9c-cb32-4bb9-883a-fd5a6387c537 tempest-VolumesTransfersV355Test-1420676445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00417e1a-442e-40d6-a04d-fceea98be3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbc23a4f-846f-4831-80be-16f8779355dd', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:23:41 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-de6bbc9c-cb32-4bb9-883a-fd5a6387c537 tempest-VolumesTransfersV355Test-1420676445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (840d4978-0478-4f4a-b595-4f962bb5694b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:23:41 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-de6bbc9c-cb32-4bb9-883a-fd5a6387c537 tempest-VolumesTransfersV355Test-1420676445 None] Volume volume-dbc23a4f-846f-4831-80be-16f8779355dd (dbc23a4f-846f-4831-80be-16f8779355dd): created successfully Sep 10 21:23:41 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-de6bbc9c-cb32-4bb9-883a-fd5a6387c537 tempest-VolumesTransfersV355Test-1420676445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (840d4978-0478-4f4a-b595-4f962bb5694b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:23:41 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-de6bbc9c-cb32-4bb9-883a-fd5a6387c537 tempest-VolumesTransfersV355Test-1420676445 None] Flow 'volume_create_manager' (afce97ee-6ce7-4ec9-a2e9-e62a2f40c18a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:23:41 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-c8e21a68-7533-4be4-b54c-a7ebe0344064 tempest-CreateVolumesFromImageTest-1602158055 None] Created reservations ['8cee4640-e829-4ca9-a39f-9da4e3e52397', '24631003-9b3a-4cad-a680-f59f06d60bd4', '6a5ec100-671d-422a-89cd-126230bea7ab', '61413206-7f6f-43e5-b0b6-f15989733021'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:23:41 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-de6bbc9c-cb32-4bb9-883a-fd5a6387c537 tempest-VolumesTransfersV355Test-1420676445 None] Created volume successfully. Sep 10 21:23:42 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-c8e21a68-7533-4be4-b54c-a7ebe0344064 tempest-CreateVolumesFromImageTest-1602158055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:23:42 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-c8e21a68-7533-4be4-b54c-a7ebe0344064 tempest-CreateVolumesFromImageTest-1602158055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:23:42 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-c8e21a68-7533-4be4-b54c-a7ebe0344064 tempest-CreateVolumesFromImageTest-1602158055 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:23:42 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-c8e21a68-7533-4be4-b54c-a7ebe0344064 tempest-CreateVolumesFromImageTest-1602158055 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:23:42 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-c8e21a68-7533-4be4-b54c-a7ebe0344064 tempest-CreateVolumesFromImageTest-1602158055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:23:42 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c8e21a68-7533-4be4-b54c-a7ebe0344064 tempest-CreateVolumesFromImageTest-1602158055 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:23:42 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c8e21a68-7533-4be4-b54c-a7ebe0344064 tempest-CreateVolumesFromImageTest-1602158055 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.089s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:23:42 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-c8e21a68-7533-4be4-b54c-a7ebe0344064 tempest-CreateVolumesFromImageTest-1602158055 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:23:42 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-c8e21a68-7533-4be4-b54c-a7ebe0344064 tempest-CreateVolumesFromImageTest-1602158055 None] Deleted volume successfully. Sep 10 21:23:42 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-c8e21a68-7533-4be4-b54c-a7ebe0344064 tempest-CreateVolumesFromImageTest-1602158055 None] Lock "cinder-29a598b2-42da-49d2-9f87-a7a7a2d1c1f5-delete_volume" released by "delete_volume" :: held 2.779s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:23:43 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-aa68b1cc-d090-4b5a-b107-db78bbaa4ba5 tempest-CreateVolumesFromImageTest-1602158055 None] Acquiring lock "cinder-9e7f57d2-74da-4b22-a647-8e0d3e0ce4fc-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:23:43 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-3a3b4b6b-6ac1-4c45-a84e-699e18de34b1 tempest-VolumesTransfersV355Test-1651163884 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:23:43 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-3a3b4b6b-6ac1-4c45-a84e-699e18de34b1 tempest-VolumesTransfersV355Test-1651163884 None] Transfer volume completed successfully. Sep 10 21:23:43 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-aa68b1cc-d090-4b5a-b107-db78bbaa4ba5 tempest-CreateVolumesFromImageTest-1602158055 None] Lock "cinder-9e7f57d2-74da-4b22-a647-8e0d3e0ce4fc-delete_volume" acquired by "delete_volume" :: waited 0.352s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:23:43 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-aa68b1cc-d090-4b5a-b107-db78bbaa4ba5 tempest-CreateVolumesFromImageTest-1602158055 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:23:43 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-aa68b1cc-d090-4b5a-b107-db78bbaa4ba5 tempest-CreateVolumesFromImageTest-1602158055 None] Acquiring lock "cinder-quobyte-9e7f57d2-74da-4b22-a647-8e0d3e0ce4fc" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:23:43 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-aa68b1cc-d090-4b5a-b107-db78bbaa4ba5 tempest-CreateVolumesFromImageTest-1602158055 None] Lock "cinder-quobyte-9e7f57d2-74da-4b22-a647-8e0d3e0ce4fc" acquired by "delete_volume" :: waited 0.019s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:23:43 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7821f3-9604-4dd5-badc-dc0012489a12]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:23:43 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-aa68b1cc-d090-4b5a-b107-db78bbaa4ba5 tempest-CreateVolumesFromImageTest-1602158055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-9e7f57d2-74da-4b22-a647-8e0d3e0ce4fc {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:23:44 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-aa68b1cc-d090-4b5a-b107-db78bbaa4ba5 tempest-CreateVolumesFromImageTest-1602158055 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-9e7f57d2-74da-4b22-a647-8e0d3e0ce4fc" returned: 0 in 0.557s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:23:44 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-aa68b1cc-d090-4b5a-b107-db78bbaa4ba5 tempest-CreateVolumesFromImageTest-1602158055 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-9e7f57d2-74da-4b22-a647-8e0d3e0ce4fc {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:23:44 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-aa68b1cc-d090-4b5a-b107-db78bbaa4ba5 tempest-CreateVolumesFromImageTest-1602158055 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-9e7f57d2-74da-4b22-a647-8e0d3e0ce4fc" returned: 0 in 0.117s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:23:44 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-aa68b1cc-d090-4b5a-b107-db78bbaa4ba5 tempest-CreateVolumesFromImageTest-1602158055 None] Lock "cinder-quobyte-9e7f57d2-74da-4b22-a647-8e0d3e0ce4fc" released by "delete_volume" :: held 0.855s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:23:44 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-8ba00824-6feb-49b2-b3d4-e2c9b970801b tempest-VolumesTransfersV355Test-71681915 None] Acquiring lock "cinder-dbc23a4f-846f-4831-80be-16f8779355dd-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:23:44 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-8ba00824-6feb-49b2-b3d4-e2c9b970801b tempest-VolumesTransfersV355Test-71681915 None] Lock "cinder-dbc23a4f-846f-4831-80be-16f8779355dd-delete_volume" acquired by "delete_volume" :: waited 0.097s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:23:44 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-aa68b1cc-d090-4b5a-b107-db78bbaa4ba5 tempest-CreateVolumesFromImageTest-1602158055 None] Created reservations ['e96e4cbd-8c9b-481c-a047-57a5d89189d1', 'd0d7ac2c-a1a1-4cf8-a510-915a3afb8334', '4177cdf5-3671-4241-bcfb-a242ab1d501c', '14a86bd8-f01a-4119-97d2-72928406f8e7'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:23:45 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-8ba00824-6feb-49b2-b3d4-e2c9b970801b tempest-VolumesTransfersV355Test-71681915 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:23:45 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-8ba00824-6feb-49b2-b3d4-e2c9b970801b tempest-VolumesTransfersV355Test-71681915 None] Acquiring lock "cinder-quobyte-dbc23a4f-846f-4831-80be-16f8779355dd" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:23:45 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-8ba00824-6feb-49b2-b3d4-e2c9b970801b tempest-VolumesTransfersV355Test-71681915 None] Lock "cinder-quobyte-dbc23a4f-846f-4831-80be-16f8779355dd" acquired by "delete_volume" :: waited 0.098s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:23:45 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b73ed19c-dcd5-402b-86ea-037b3be22865]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:23:45 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-8ba00824-6feb-49b2-b3d4-e2c9b970801b tempest-VolumesTransfersV355Test-71681915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-dbc23a4f-846f-4831-80be-16f8779355dd {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:23:45 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-aa68b1cc-d090-4b5a-b107-db78bbaa4ba5 tempest-CreateVolumesFromImageTest-1602158055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:23:45 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-aa68b1cc-d090-4b5a-b107-db78bbaa4ba5 tempest-CreateVolumesFromImageTest-1602158055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.030s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:23:45 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-aa68b1cc-d090-4b5a-b107-db78bbaa4ba5 tempest-CreateVolumesFromImageTest-1602158055 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:23:45 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-aa68b1cc-d090-4b5a-b107-db78bbaa4ba5 tempest-CreateVolumesFromImageTest-1602158055 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:23:45 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-aa68b1cc-d090-4b5a-b107-db78bbaa4ba5 tempest-CreateVolumesFromImageTest-1602158055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:23:45 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-aa68b1cc-d090-4b5a-b107-db78bbaa4ba5 tempest-CreateVolumesFromImageTest-1602158055 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:23:46 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-23875c04-3986-4c79-b53b-4a75d801e752 tempest-CreateVolumesFromImageTest-1602158055 None] Acquiring lock "cinder-6fa1962b-c9a8-49f3-8d0d-ece163a159db-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:23:46 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-b2ee6377-1636-49bd-b3e5-fea38a7fbaf4 req-48a65274-272f-4ffb-9791-3583baa910a3 tempest-AttachVolumeTestJSON-828295401 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:23:46 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-23875c04-3986-4c79-b53b-4a75d801e752 tempest-CreateVolumesFromImageTest-1602158055 None] Lock "cinder-6fa1962b-c9a8-49f3-8d0d-ece163a159db-delete_volume" acquired by "delete_volume" :: waited 0.312s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:23:46 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-b2ee6377-1636-49bd-b3e5-fea38a7fbaf4 req-48a65274-272f-4ffb-9791-3583baa910a3 tempest-AttachVolumeTestJSON-828295401 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:23:46 devstack cinder-volume[82780]: INFO cinder.volume.manager [req-b2ee6377-1636-49bd-b3e5-fea38a7fbaf4 req-48a65274-272f-4ffb-9791-3583baa910a3 tempest-AttachVolumeTestJSON-828295401 None] Terminate volume connection completed successfully. Sep 10 21:23:46 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-b2ee6377-1636-49bd-b3e5-fea38a7fbaf4 req-48a65274-272f-4ffb-9791-3583baa910a3 tempest-AttachVolumeTestJSON-828295401 None] Deleting attachment 2a1db3eb-f92a-44b4-b3a3-f7ae3bd1a135. {{(pid=82780) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 21:23:46 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-8ba00824-6feb-49b2-b3d4-e2c9b970801b tempest-VolumesTransfersV355Test-71681915 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-dbc23a4f-846f-4831-80be-16f8779355dd" returned: 0 in 1.224s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:23:46 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-8ba00824-6feb-49b2-b3d4-e2c9b970801b tempest-VolumesTransfersV355Test-71681915 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-dbc23a4f-846f-4831-80be-16f8779355dd {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:23:46 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-aa68b1cc-d090-4b5a-b107-db78bbaa4ba5 tempest-CreateVolumesFromImageTest-1602158055 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.806s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:23:46 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-aa68b1cc-d090-4b5a-b107-db78bbaa4ba5 tempest-CreateVolumesFromImageTest-1602158055 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:23:46 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-aa68b1cc-d090-4b5a-b107-db78bbaa4ba5 tempest-CreateVolumesFromImageTest-1602158055 None] Deleted volume successfully. Sep 10 21:23:47 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-8ba00824-6feb-49b2-b3d4-e2c9b970801b tempest-VolumesTransfersV355Test-71681915 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-dbc23a4f-846f-4831-80be-16f8779355dd" returned: 0 in 0.628s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:23:47 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-aa68b1cc-d090-4b5a-b107-db78bbaa4ba5 tempest-CreateVolumesFromImageTest-1602158055 None] Lock "cinder-9e7f57d2-74da-4b22-a647-8e0d3e0ce4fc-delete_volume" released by "delete_volume" :: held 3.636s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:23:47 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-8ba00824-6feb-49b2-b3d4-e2c9b970801b tempest-VolumesTransfersV355Test-71681915 None] Lock "cinder-quobyte-dbc23a4f-846f-4831-80be-16f8779355dd" released by "delete_volume" :: held 2.051s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:23:47 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-23875c04-3986-4c79-b53b-4a75d801e752 tempest-CreateVolumesFromImageTest-1602158055 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:23:47 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-23875c04-3986-4c79-b53b-4a75d801e752 tempest-CreateVolumesFromImageTest-1602158055 None] Acquiring lock "cinder-quobyte-6fa1962b-c9a8-49f3-8d0d-ece163a159db" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:23:47 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-23875c04-3986-4c79-b53b-4a75d801e752 tempest-CreateVolumesFromImageTest-1602158055 None] Lock "cinder-quobyte-6fa1962b-c9a8-49f3-8d0d-ece163a159db" acquired by "delete_volume" :: waited 0.029s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:23:47 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[312f39c7-cd98-4935-8359-c15e5dfa43d8]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:23:47 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-23875c04-3986-4c79-b53b-4a75d801e752 tempest-CreateVolumesFromImageTest-1602158055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-6fa1962b-c9a8-49f3-8d0d-ece163a159db {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:23:47 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-8ba00824-6feb-49b2-b3d4-e2c9b970801b tempest-VolumesTransfersV355Test-71681915 None] Created reservations ['1796a8a2-46b6-40c0-bfe6-947fc075c676', '36993d8d-2eb4-425c-bcea-7a7999cd79cd', 'f1e31c7c-37fd-466b-978b-9e0915345e3d', 'cba87f65-cb51-47c0-bcc3-15a18ac5fbb5'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:23:48 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-8ba00824-6feb-49b2-b3d4-e2c9b970801b tempest-VolumesTransfersV355Test-71681915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:23:48 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-8ba00824-6feb-49b2-b3d4-e2c9b970801b tempest-VolumesTransfersV355Test-71681915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:23:48 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-8ba00824-6feb-49b2-b3d4-e2c9b970801b tempest-VolumesTransfersV355Test-71681915 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:23:48 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-8ba00824-6feb-49b2-b3d4-e2c9b970801b tempest-VolumesTransfersV355Test-71681915 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:23:48 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-8ba00824-6feb-49b2-b3d4-e2c9b970801b tempest-VolumesTransfersV355Test-71681915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.047s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:23:48 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-8ba00824-6feb-49b2-b3d4-e2c9b970801b tempest-VolumesTransfersV355Test-71681915 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:23:48 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-23875c04-3986-4c79-b53b-4a75d801e752 tempest-CreateVolumesFromImageTest-1602158055 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-6fa1962b-c9a8-49f3-8d0d-ece163a159db" returned: 0 in 1.276s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:23:48 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-8ba00824-6feb-49b2-b3d4-e2c9b970801b tempest-VolumesTransfersV355Test-71681915 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.583s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:23:48 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-23875c04-3986-4c79-b53b-4a75d801e752 tempest-CreateVolumesFromImageTest-1602158055 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-6fa1962b-c9a8-49f3-8d0d-ece163a159db {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:23:48 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-8ba00824-6feb-49b2-b3d4-e2c9b970801b tempest-VolumesTransfersV355Test-71681915 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:23:49 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-8ba00824-6feb-49b2-b3d4-e2c9b970801b tempest-VolumesTransfersV355Test-71681915 None] Deleted volume successfully. Sep 10 21:23:49 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-23875c04-3986-4c79-b53b-4a75d801e752 tempest-CreateVolumesFromImageTest-1602158055 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-6fa1962b-c9a8-49f3-8d0d-ece163a159db" returned: 0 in 0.589s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:23:49 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-23875c04-3986-4c79-b53b-4a75d801e752 tempest-CreateVolumesFromImageTest-1602158055 None] Lock "cinder-quobyte-6fa1962b-c9a8-49f3-8d0d-ece163a159db" released by "delete_volume" :: held 2.176s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:23:49 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-8ba00824-6feb-49b2-b3d4-e2c9b970801b tempest-VolumesTransfersV355Test-71681915 None] Lock "cinder-dbc23a4f-846f-4831-80be-16f8779355dd-delete_volume" released by "delete_volume" :: held 4.663s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:23:49 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-8506a0a6-cc1a-470d-940d-59c45011d666 tempest-VolumesTransfersV355Test-1420676445 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:23:49 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-8506a0a6-cc1a-470d-940d-59c45011d666 tempest-VolumesTransfersV355Test-1420676445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:23:49 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-8506a0a6-cc1a-470d-940d-59c45011d666 tempest-VolumesTransfersV355Test-1420676445 None] Flow 'volume_create_manager' (92d1b198-5ff7-454e-8577-02b59caa5b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:23:49 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-8506a0a6-cc1a-470d-940d-59c45011d666 tempest-VolumesTransfersV355Test-1420676445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3e93e4c-0dc3-4252-ba4b-c8f64869f787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:23:49 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-8506a0a6-cc1a-470d-940d-59c45011d666 tempest-VolumesTransfersV355Test-1420676445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3e93e4c-0dc3-4252-ba4b-c8f64869f787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1952275242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1af06651-21de-499d-b47a-be5157653c99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdd17a1f61df4b729390c3960c877890',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:23:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:23:49Z,use_quota=True,user_id='329d9fbdb17f49be95e5083e4d829677',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:23:49 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-8506a0a6-cc1a-470d-940d-59c45011d666 tempest-VolumesTransfersV355Test-1420676445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cea9a071-c310-4e9d-a3ad-ec765e14fdd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:23:49 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-8506a0a6-cc1a-470d-940d-59c45011d666 tempest-VolumesTransfersV355Test-1420676445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cea9a071-c310-4e9d-a3ad-ec765e14fdd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:23:49 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-8506a0a6-cc1a-470d-940d-59c45011d666 tempest-VolumesTransfersV355Test-1420676445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7c0923a-1e8a-457a-b409-2883b9f54314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:23:49 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-8506a0a6-cc1a-470d-940d-59c45011d666 tempest-VolumesTransfersV355Test-1420676445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7c0923a-1e8a-457a-b409-2883b9f54314) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1af06651-21de-499d-b47a-be5157653c99', 'volume_name': 'volume-1af06651-21de-499d-b47a-be5157653c99', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:23:49 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-8506a0a6-cc1a-470d-940d-59c45011d666 tempest-VolumesTransfersV355Test-1420676445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9678aa6a-c846-494d-8363-b1d10b363bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:23:49 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-8506a0a6-cc1a-470d-940d-59c45011d666 tempest-VolumesTransfersV355Test-1420676445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9678aa6a-c846-494d-8363-b1d10b363bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:23:49 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-8506a0a6-cc1a-470d-940d-59c45011d666 tempest-VolumesTransfersV355Test-1420676445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5985ce5-cee7-445e-88d5-0551c13dd5ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:23:49 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-8506a0a6-cc1a-470d-940d-59c45011d666 tempest-VolumesTransfersV355Test-1420676445 None] Volume 1af06651-21de-499d-b47a-be5157653c99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1af06651-21de-499d-b47a-be5157653c99', 'volume_size': 1} Sep 10 21:23:49 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-8506a0a6-cc1a-470d-940d-59c45011d666 tempest-VolumesTransfersV355Test-1420676445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:23:49 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-8506a0a6-cc1a-470d-940d-59c45011d666 tempest-VolumesTransfersV355Test-1420676445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:23:49 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-8506a0a6-cc1a-470d-940d-59c45011d666 tempest-VolumesTransfersV355Test-1420676445 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1952275242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1af06651-21de-499d-b47a-be5157653c99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdd17a1f61df4b729390c3960c877890',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:23:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:23:49Z,use_quota=True,user_id='329d9fbdb17f49be95e5083e4d829677',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:23:49 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-8506a0a6-cc1a-470d-940d-59c45011d666 tempest-VolumesTransfersV355Test-1420676445 None] Creating volume 1af06651-21de-499d-b47a-be5157653c99 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:23:49 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-8506a0a6-cc1a-470d-940d-59c45011d666 tempest-VolumesTransfersV355Test-1420676445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:23:49 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-8506a0a6-cc1a-470d-940d-59c45011d666 tempest-VolumesTransfersV355Test-1420676445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:23:49 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-8506a0a6-cc1a-470d-940d-59c45011d666 tempest-VolumesTransfersV355Test-1420676445 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:23:49 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-8506a0a6-cc1a-470d-940d-59c45011d666 tempest-VolumesTransfersV355Test-1420676445 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:23:49 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-8506a0a6-cc1a-470d-940d-59c45011d666 tempest-VolumesTransfersV355Test-1420676445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:23:49 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-8506a0a6-cc1a-470d-940d-59c45011d666 tempest-VolumesTransfersV355Test-1420676445 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:23:49 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-8506a0a6-cc1a-470d-940d-59c45011d666 tempest-VolumesTransfersV355Test-1420676445 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:23:49 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-8506a0a6-cc1a-470d-940d-59c45011d666 tempest-VolumesTransfersV355Test-1420676445 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1af06651-21de-499d-b47a-be5157653c99 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:23:49 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=66, name=volume-1af06651-21de-499d-b47a-be5157653c99, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:23:50 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-23875c04-3986-4c79-b53b-4a75d801e752 tempest-CreateVolumesFromImageTest-1602158055 None] Created reservations ['44ef4b3d-eebb-431f-8a7a-6d576ab3fdbe', '2b8172d9-2303-498f-a87a-c5c8eca3be5d', 'a0da0070-d010-4429-bc18-61b355a00bdb', '5dd52e8e-74b7-4b18-ad42-2f3973730475'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:23:50 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-8506a0a6-cc1a-470d-940d-59c45011d666 tempest-VolumesTransfersV355Test-1420676445 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1af06651-21de-499d-b47a-be5157653c99 1073741824" returned: 0 in 0.551s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:23:50 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-8506a0a6-cc1a-470d-940d-59c45011d666 tempest-VolumesTransfersV355Test-1420676445 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1af06651-21de-499d-b47a-be5157653c99 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:23:50 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-8506a0a6-cc1a-470d-940d-59c45011d666 tempest-VolumesTransfersV355Test-1420676445 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1af06651-21de-499d-b47a-be5157653c99" returned: 0 in 0.459s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:23:50 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-8506a0a6-cc1a-470d-940d-59c45011d666 tempest-VolumesTransfersV355Test-1420676445 None] <== create_volume: return (1090ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:23:50 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-8506a0a6-cc1a-470d-940d-59c45011d666 tempest-VolumesTransfersV355Test-1420676445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:23:51 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-8506a0a6-cc1a-470d-940d-59c45011d666 tempest-VolumesTransfersV355Test-1420676445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5985ce5-cee7-445e-88d5-0551c13dd5ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1af06651-21de-499d-b47a-be5157653c99', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:23:51 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-8506a0a6-cc1a-470d-940d-59c45011d666 tempest-VolumesTransfersV355Test-1420676445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bca627e9-ca32-4202-a048-fe4a1aaf1448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:23:51 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-8506a0a6-cc1a-470d-940d-59c45011d666 tempest-VolumesTransfersV355Test-1420676445 None] Volume volume-1af06651-21de-499d-b47a-be5157653c99 (1af06651-21de-499d-b47a-be5157653c99): created successfully Sep 10 21:23:51 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-8506a0a6-cc1a-470d-940d-59c45011d666 tempest-VolumesTransfersV355Test-1420676445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bca627e9-ca32-4202-a048-fe4a1aaf1448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:23:51 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-8506a0a6-cc1a-470d-940d-59c45011d666 tempest-VolumesTransfersV355Test-1420676445 None] Flow 'volume_create_manager' (92d1b198-5ff7-454e-8577-02b59caa5b7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:23:51 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-8506a0a6-cc1a-470d-940d-59c45011d666 tempest-VolumesTransfersV355Test-1420676445 None] Created volume successfully. Sep 10 21:23:51 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-23875c04-3986-4c79-b53b-4a75d801e752 tempest-CreateVolumesFromImageTest-1602158055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:23:51 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-23875c04-3986-4c79-b53b-4a75d801e752 tempest-CreateVolumesFromImageTest-1602158055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:23:51 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-23875c04-3986-4c79-b53b-4a75d801e752 tempest-CreateVolumesFromImageTest-1602158055 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:23:51 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-23875c04-3986-4c79-b53b-4a75d801e752 tempest-CreateVolumesFromImageTest-1602158055 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:23:51 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-23875c04-3986-4c79-b53b-4a75d801e752 tempest-CreateVolumesFromImageTest-1602158055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:23:51 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-23875c04-3986-4c79-b53b-4a75d801e752 tempest-CreateVolumesFromImageTest-1602158055 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:23:51 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-23875c04-3986-4c79-b53b-4a75d801e752 tempest-CreateVolumesFromImageTest-1602158055 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.171s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:23:51 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-23875c04-3986-4c79-b53b-4a75d801e752 tempest-CreateVolumesFromImageTest-1602158055 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:23:51 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-23875c04-3986-4c79-b53b-4a75d801e752 tempest-CreateVolumesFromImageTest-1602158055 None] Deleted volume successfully. Sep 10 21:23:51 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-23875c04-3986-4c79-b53b-4a75d801e752 tempest-CreateVolumesFromImageTest-1602158055 None] Lock "cinder-6fa1962b-c9a8-49f3-8d0d-ece163a159db-delete_volume" released by "delete_volume" :: held 5.477s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:23:52 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-31edfc6c-580b-43f4-9d6c-aa37e64001f2 tempest-VolumesTransfersV355Test-71681915 None] Acquiring lock "cinder-1af06651-21de-499d-b47a-be5157653c99-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:23:52 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-31edfc6c-580b-43f4-9d6c-aa37e64001f2 tempest-VolumesTransfersV355Test-71681915 None] Lock "cinder-1af06651-21de-499d-b47a-be5157653c99-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:23:52 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-31edfc6c-580b-43f4-9d6c-aa37e64001f2 tempest-VolumesTransfersV355Test-71681915 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:23:52 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-31edfc6c-580b-43f4-9d6c-aa37e64001f2 tempest-VolumesTransfersV355Test-71681915 None] Acquiring lock "cinder-quobyte-1af06651-21de-499d-b47a-be5157653c99" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:23:52 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-31edfc6c-580b-43f4-9d6c-aa37e64001f2 tempest-VolumesTransfersV355Test-71681915 None] Lock "cinder-quobyte-1af06651-21de-499d-b47a-be5157653c99" acquired by "delete_volume" :: waited 0.026s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:23:52 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[2097a988-2680-4703-a151-360dace1d151]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:23:52 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-31edfc6c-580b-43f4-9d6c-aa37e64001f2 tempest-VolumesTransfersV355Test-71681915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1af06651-21de-499d-b47a-be5157653c99 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:23:53 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-31edfc6c-580b-43f4-9d6c-aa37e64001f2 tempest-VolumesTransfersV355Test-71681915 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1af06651-21de-499d-b47a-be5157653c99" returned: 0 in 0.498s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:23:53 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-31edfc6c-580b-43f4-9d6c-aa37e64001f2 tempest-VolumesTransfersV355Test-71681915 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1af06651-21de-499d-b47a-be5157653c99 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:23:53 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-31edfc6c-580b-43f4-9d6c-aa37e64001f2 tempest-VolumesTransfersV355Test-71681915 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1af06651-21de-499d-b47a-be5157653c99" returned: 0 in 0.105s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:23:53 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-31edfc6c-580b-43f4-9d6c-aa37e64001f2 tempest-VolumesTransfersV355Test-71681915 None] Lock "cinder-quobyte-1af06651-21de-499d-b47a-be5157653c99" released by "delete_volume" :: held 0.824s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:23:53 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-31edfc6c-580b-43f4-9d6c-aa37e64001f2 tempest-VolumesTransfersV355Test-71681915 None] Created reservations ['45a6860f-9570-4602-be95-4517d992b9ae', '6b5ec522-2a1b-41ea-b72e-5ae4f6ee64e2', '4b921a4d-1165-4e95-b67a-8d02e077463a', '92f51786-7135-43b4-9e22-6f7c3f295e04'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:23:54 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-31edfc6c-580b-43f4-9d6c-aa37e64001f2 tempest-VolumesTransfersV355Test-71681915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:23:54 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-31edfc6c-580b-43f4-9d6c-aa37e64001f2 tempest-VolumesTransfersV355Test-71681915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:23:54 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-31edfc6c-580b-43f4-9d6c-aa37e64001f2 tempest-VolumesTransfersV355Test-71681915 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:23:54 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-31edfc6c-580b-43f4-9d6c-aa37e64001f2 tempest-VolumesTransfersV355Test-71681915 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:23:54 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-31edfc6c-580b-43f4-9d6c-aa37e64001f2 tempest-VolumesTransfersV355Test-71681915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:23:54 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-31edfc6c-580b-43f4-9d6c-aa37e64001f2 tempest-VolumesTransfersV355Test-71681915 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:23:54 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-31edfc6c-580b-43f4-9d6c-aa37e64001f2 tempest-VolumesTransfersV355Test-71681915 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.133s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:23:54 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-31edfc6c-580b-43f4-9d6c-aa37e64001f2 tempest-VolumesTransfersV355Test-71681915 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:23:54 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-31edfc6c-580b-43f4-9d6c-aa37e64001f2 tempest-VolumesTransfersV355Test-71681915 None] Deleted volume successfully. Sep 10 21:23:54 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-31edfc6c-580b-43f4-9d6c-aa37e64001f2 tempest-VolumesTransfersV355Test-71681915 None] Lock "cinder-1af06651-21de-499d-b47a-be5157653c99-delete_volume" released by "delete_volume" :: held 2.095s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:23:55 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=71,cinder:UPDATE=92,cinder:DELETE=12,cinder:INSERT=23 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:23:55 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-b9cffff1-23c7-4235-a6bc-c30d11f72fd1 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:23:55 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9cffff1-23c7-4235-a6bc-c30d11f72fd1 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:23:56 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-b9cffff1-23c7-4235-a6bc-c30d11f72fd1 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Flow 'volume_create_manager' (e0a16d16-28ad-490e-9b12-5ae7d1712de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:23:56 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-b9cffff1-23c7-4235-a6bc-c30d11f72fd1 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff385de7-8a32-4cd1-8d63-b15e034579c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:23:56 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-b9cffff1-23c7-4235-a6bc-c30d11f72fd1 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff385de7-8a32-4cd1-8d63-b15e034579c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:23:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1337557981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c539dc1-9533-452b-aecb-ca3c3f5e6fd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fb8e00175a147719167e3e27399fae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:23:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:23:56Z,use_quota=True,user_id='ca248854a72b40d3baca6a4966672c65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:23:56 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-b9cffff1-23c7-4235-a6bc-c30d11f72fd1 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c7ca9b7-99f3-4921-adef-5f96a1e2a3e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:23:56 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-b9cffff1-23c7-4235-a6bc-c30d11f72fd1 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c7ca9b7-99f3-4921-adef-5f96a1e2a3e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:23:56 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-b9cffff1-23c7-4235-a6bc-c30d11f72fd1 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (addb55bb-07d0-4ffd-8b84-aeb41648273e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:23:56 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-b9cffff1-23c7-4235-a6bc-c30d11f72fd1 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (addb55bb-07d0-4ffd-8b84-aeb41648273e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c539dc1-9533-452b-aecb-ca3c3f5e6fd9', 'volume_name': 'volume-8c539dc1-9533-452b-aecb-ca3c3f5e6fd9', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:23:56 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-b9cffff1-23c7-4235-a6bc-c30d11f72fd1 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aff93bc7-a080-4cee-bedb-93c7f75739a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:23:56 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-b9cffff1-23c7-4235-a6bc-c30d11f72fd1 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aff93bc7-a080-4cee-bedb-93c7f75739a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:23:56 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-b9cffff1-23c7-4235-a6bc-c30d11f72fd1 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3803463-c077-43ee-9e30-5e1271319539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:23:56 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-b9cffff1-23c7-4235-a6bc-c30d11f72fd1 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Volume 8c539dc1-9533-452b-aecb-ca3c3f5e6fd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c539dc1-9533-452b-aecb-ca3c3f5e6fd9', 'volume_size': 1} Sep 10 21:23:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-b9cffff1-23c7-4235-a6bc-c30d11f72fd1 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:23:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-b9cffff1-23c7-4235-a6bc-c30d11f72fd1 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:23:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-b9cffff1-23c7-4235-a6bc-c30d11f72fd1 tempest-CreateVolumesFromSnapshotTest-1357788047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:23:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1337557981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c539dc1-9533-452b-aecb-ca3c3f5e6fd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fb8e00175a147719167e3e27399fae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:23:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:23:56Z,use_quota=True,user_id='ca248854a72b40d3baca6a4966672c65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:23:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-b9cffff1-23c7-4235-a6bc-c30d11f72fd1 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Creating volume 8c539dc1-9533-452b-aecb-ca3c3f5e6fd9 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:23:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-b9cffff1-23c7-4235-a6bc-c30d11f72fd1 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:23:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-b9cffff1-23c7-4235-a6bc-c30d11f72fd1 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:23:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-b9cffff1-23c7-4235-a6bc-c30d11f72fd1 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:23:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-b9cffff1-23c7-4235-a6bc-c30d11f72fd1 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:23:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-b9cffff1-23c7-4235-a6bc-c30d11f72fd1 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:23:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-b9cffff1-23c7-4235-a6bc-c30d11f72fd1 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:23:56 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-b9cffff1-23c7-4235-a6bc-c30d11f72fd1 tempest-CreateVolumesFromSnapshotTest-1357788047 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:23:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b9cffff1-23c7-4235-a6bc-c30d11f72fd1 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-8c539dc1-9533-452b-aecb-ca3c3f5e6fd9 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:23:56 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=67, name=volume-8c539dc1-9533-452b-aecb-ca3c3f5e6fd9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:23:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b9cffff1-23c7-4235-a6bc-c30d11f72fd1 tempest-CreateVolumesFromSnapshotTest-1357788047 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-8c539dc1-9533-452b-aecb-ca3c3f5e6fd9 1073741824" returned: 0 in 0.482s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:23:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b9cffff1-23c7-4235-a6bc-c30d11f72fd1 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-8c539dc1-9533-452b-aecb-ca3c3f5e6fd9 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:23:56 devstack cinder-volume[82780]: DEBUG oslo_service.periodic_task [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82780) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 21:23:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:23:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:23:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:23:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:23:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:23:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:23:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b9cffff1-23c7-4235-a6bc-c30d11f72fd1 tempest-CreateVolumesFromSnapshotTest-1357788047 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-8c539dc1-9533-452b-aecb-ca3c3f5e6fd9" returned: 0 in 0.323s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:23:57 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-b9cffff1-23c7-4235-a6bc-c30d11f72fd1 tempest-CreateVolumesFromSnapshotTest-1357788047 None] <== create_volume: return (883ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:23:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-b9cffff1-23c7-4235-a6bc-c30d11f72fd1 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:23:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.311s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:23:57 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:23:57 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-b9cffff1-23c7-4235-a6bc-c30d11f72fd1 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3803463-c077-43ee-9e30-5e1271319539) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c539dc1-9533-452b-aecb-ca3c3f5e6fd9', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:23:57 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-b9cffff1-23c7-4235-a6bc-c30d11f72fd1 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bba7d659-e370-4cd0-8e13-a1767a3504b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:23:57 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-b9cffff1-23c7-4235-a6bc-c30d11f72fd1 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Volume volume-8c539dc1-9533-452b-aecb-ca3c3f5e6fd9 (8c539dc1-9533-452b-aecb-ca3c3f5e6fd9): created successfully Sep 10 21:23:57 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-b9cffff1-23c7-4235-a6bc-c30d11f72fd1 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bba7d659-e370-4cd0-8e13-a1767a3504b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:23:57 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-b9cffff1-23c7-4235-a6bc-c30d11f72fd1 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Flow 'volume_create_manager' (e0a16d16-28ad-490e-9b12-5ae7d1712de4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:23:57 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-b9cffff1-23c7-4235-a6bc-c30d11f72fd1 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Created volume successfully. Sep 10 21:24:00 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-b77658ba-4b57-4d18-a5a9-3e8b75628802 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:24:00 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-b77658ba-4b57-4d18-a5a9-3e8b75628802 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:24:00 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-b77658ba-4b57-4d18-a5a9-3e8b75628802 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:24:00 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-b77658ba-4b57-4d18-a5a9-3e8b75628802 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Creating offline snapshot 8e4eed04-1b27-4397-8c47-61906365cd18 of volume 8c539dc1-9533-452b-aecb-ca3c3f5e6fd9 {{(pid=82780) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 21:24:00 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23f7630-55d5-4700-ac37-2f3086f52a41]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:24:00 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b77658ba-4b57-4d18-a5a9-3e8b75628802 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-8c539dc1-9533-452b-aecb-ca3c3f5e6fd9 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:00 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b77658ba-4b57-4d18-a5a9-3e8b75628802 tempest-CreateVolumesFromSnapshotTest-1357788047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-8c539dc1-9533-452b-aecb-ca3c3f5e6fd9" returned: 0 in 0.497s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:00 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b77658ba-4b57-4d18-a5a9-3e8b75628802 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-8c539dc1-9533-452b-aecb-ca3c3f5e6fd9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-8c539dc1-9533-452b-aecb-ca3c3f5e6fd9.8e4eed04-1b27-4397-8c47-61906365cd18 1G {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:00 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=68, name=volume-8c539dc1-9533-452b-aecb-ca3c3f5e6fd9.8e4eed04-1b27-4397-8c47-61906365cd18, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:24:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b77658ba-4b57-4d18-a5a9-3e8b75628802 tempest-CreateVolumesFromSnapshotTest-1357788047 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-8c539dc1-9533-452b-aecb-ca3c3f5e6fd9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-8c539dc1-9533-452b-aecb-ca3c3f5e6fd9.8e4eed04-1b27-4397-8c47-61906365cd18 1G" returned: 0 in 0.331s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b77658ba-4b57-4d18-a5a9-3e8b75628802 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Running cmd (subprocess): qemu-img rebase -u -b volume-8c539dc1-9533-452b-aecb-ca3c3f5e6fd9 -F qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-8c539dc1-9533-452b-aecb-ca3c3f5e6fd9.8e4eed04-1b27-4397-8c47-61906365cd18 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b77658ba-4b57-4d18-a5a9-3e8b75628802 tempest-CreateVolumesFromSnapshotTest-1357788047 None] CMD "qemu-img rebase -u -b volume-8c539dc1-9533-452b-aecb-ca3c3f5e6fd9 -F qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-8c539dc1-9533-452b-aecb-ca3c3f5e6fd9.8e4eed04-1b27-4397-8c47-61906365cd18" returned: 0 in 0.229s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:01 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-b77658ba-4b57-4d18-a5a9-3e8b75628802 tempest-CreateVolumesFromSnapshotTest-1357788047 None] File path /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-8c539dc1-9533-452b-aecb-ca3c3f5e6fd9.8e4eed04-1b27-4397-8c47-61906365cd18 is being set with permissions: 660 {{(pid=82780) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 21:24:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b77658ba-4b57-4d18-a5a9-3e8b75628802 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-8c539dc1-9533-452b-aecb-ca3c3f5e6fd9.8e4eed04-1b27-4397-8c47-61906365cd18 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b77658ba-4b57-4d18-a5a9-3e8b75628802 tempest-CreateVolumesFromSnapshotTest-1357788047 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-8c539dc1-9533-452b-aecb-ca3c3f5e6fd9.8e4eed04-1b27-4397-8c47-61906365cd18" returned: 0 in 0.103s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:01 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-b77658ba-4b57-4d18-a5a9-3e8b75628802 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Setting permissions: /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-8c539dc1-9533-452b-aecb-ca3c3f5e6fd9 -> 1000:1000 {{(pid=82780) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 21:24:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b77658ba-4b57-4d18-a5a9-3e8b75628802 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-8c539dc1-9533-452b-aecb-ca3c3f5e6fd9 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-8c539dc1-9533-452b-aecb-ca3c3f5e6fd9.8e4eed04-1b27-4397-8c47-61906365cd18 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b77658ba-4b57-4d18-a5a9-3e8b75628802 tempest-CreateVolumesFromSnapshotTest-1357788047 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-8c539dc1-9533-452b-aecb-ca3c3f5e6fd9 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-8c539dc1-9533-452b-aecb-ca3c3f5e6fd9.8e4eed04-1b27-4397-8c47-61906365cd18" returned: 0 in 0.108s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b77658ba-4b57-4d18-a5a9-3e8b75628802 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-8c539dc1-9533-452b-aecb-ca3c3f5e6fd9.info {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b77658ba-4b57-4d18-a5a9-3e8b75628802 tempest-CreateVolumesFromSnapshotTest-1357788047 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-8c539dc1-9533-452b-aecb-ca3c3f5e6fd9.info" returned: 0 in 0.124s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:01 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-b77658ba-4b57-4d18-a5a9-3e8b75628802 tempest-CreateVolumesFromSnapshotTest-1357788047 None] File path /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-8c539dc1-9533-452b-aecb-ca3c3f5e6fd9.info is being set with permissions: 660 {{(pid=82780) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 21:24:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b77658ba-4b57-4d18-a5a9-3e8b75628802 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-8c539dc1-9533-452b-aecb-ca3c3f5e6fd9.info {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b77658ba-4b57-4d18-a5a9-3e8b75628802 tempest-CreateVolumesFromSnapshotTest-1357788047 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-8c539dc1-9533-452b-aecb-ca3c3f5e6fd9.info" returned: 0 in 0.144s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-b77658ba-4b57-4d18-a5a9-3e8b75628802 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.948s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:24:02 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=78,cinder:UPDATE=126,cinder:DELETE=8,cinder:INSERT=21 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:24:02 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-b77658ba-4b57-4d18-a5a9-3e8b75628802 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Create snapshot completed successfully Sep 10 21:24:03 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-ea65c503-0ad2-4de0-ba55-03785ee0adfa tempest-CreateVolumesFromSnapshotTest-1357788047 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:24:03 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea65c503-0ad2-4de0-ba55-03785ee0adfa tempest-CreateVolumesFromSnapshotTest-1357788047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:24:03 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ea65c503-0ad2-4de0-ba55-03785ee0adfa tempest-CreateVolumesFromSnapshotTest-1357788047 None] Flow 'volume_create_manager' (66b45409-3141-43d1-a77b-91d8b5e76b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:24:03 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ea65c503-0ad2-4de0-ba55-03785ee0adfa tempest-CreateVolumesFromSnapshotTest-1357788047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22ab46ef-c7a6-4895-a1fe-601139bf9b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:24:03 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ea65c503-0ad2-4de0-ba55-03785ee0adfa tempest-CreateVolumesFromSnapshotTest-1357788047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22ab46ef-c7a6-4895-a1fe-601139bf9b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:24:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-213482647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2293f2a-e251-43bb-a66d-4c8475689220,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fb8e00175a147719167e3e27399fae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:24:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:24:04Z,use_quota=True,user_id='ca248854a72b40d3baca6a4966672c65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:24:03 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ea65c503-0ad2-4de0-ba55-03785ee0adfa tempest-CreateVolumesFromSnapshotTest-1357788047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (102ac302-3fe4-448c-a70f-a8db03756240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:24:03 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ea65c503-0ad2-4de0-ba55-03785ee0adfa tempest-CreateVolumesFromSnapshotTest-1357788047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (102ac302-3fe4-448c-a70f-a8db03756240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:24:03 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ea65c503-0ad2-4de0-ba55-03785ee0adfa tempest-CreateVolumesFromSnapshotTest-1357788047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36e8f76f-551e-4e07-bb7a-3abbd0dd15ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:24:04 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ea65c503-0ad2-4de0-ba55-03785ee0adfa tempest-CreateVolumesFromSnapshotTest-1357788047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36e8f76f-551e-4e07-bb7a-3abbd0dd15ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2293f2a-e251-43bb-a66d-4c8475689220', 'volume_name': 'volume-e2293f2a-e251-43bb-a66d-4c8475689220', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:24:04 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ea65c503-0ad2-4de0-ba55-03785ee0adfa tempest-CreateVolumesFromSnapshotTest-1357788047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aa9fa56-7ae1-4ee3-b894-15318996923d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:24:04 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ea65c503-0ad2-4de0-ba55-03785ee0adfa tempest-CreateVolumesFromSnapshotTest-1357788047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aa9fa56-7ae1-4ee3-b894-15318996923d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:24:04 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ea65c503-0ad2-4de0-ba55-03785ee0adfa tempest-CreateVolumesFromSnapshotTest-1357788047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bf2a5a7-6357-4832-a257-547d54207772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:24:04 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-ea65c503-0ad2-4de0-ba55-03785ee0adfa tempest-CreateVolumesFromSnapshotTest-1357788047 None] Volume e2293f2a-e251-43bb-a66d-4c8475689220: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2293f2a-e251-43bb-a66d-4c8475689220', 'volume_size': 1} Sep 10 21:24:04 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-ea65c503-0ad2-4de0-ba55-03785ee0adfa tempest-CreateVolumesFromSnapshotTest-1357788047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:24:04 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-ea65c503-0ad2-4de0-ba55-03785ee0adfa tempest-CreateVolumesFromSnapshotTest-1357788047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:24:04 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-ea65c503-0ad2-4de0-ba55-03785ee0adfa tempest-CreateVolumesFromSnapshotTest-1357788047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:24:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-213482647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2293f2a-e251-43bb-a66d-4c8475689220,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fb8e00175a147719167e3e27399fae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:24:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:24:04Z,use_quota=True,user_id='ca248854a72b40d3baca6a4966672c65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:24:04 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-ea65c503-0ad2-4de0-ba55-03785ee0adfa tempest-CreateVolumesFromSnapshotTest-1357788047 None] Creating volume e2293f2a-e251-43bb-a66d-4c8475689220 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:24:04 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-ea65c503-0ad2-4de0-ba55-03785ee0adfa tempest-CreateVolumesFromSnapshotTest-1357788047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:24:04 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-ea65c503-0ad2-4de0-ba55-03785ee0adfa tempest-CreateVolumesFromSnapshotTest-1357788047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:24:04 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-ea65c503-0ad2-4de0-ba55-03785ee0adfa tempest-CreateVolumesFromSnapshotTest-1357788047 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:24:04 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-ea65c503-0ad2-4de0-ba55-03785ee0adfa tempest-CreateVolumesFromSnapshotTest-1357788047 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:24:04 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-ea65c503-0ad2-4de0-ba55-03785ee0adfa tempest-CreateVolumesFromSnapshotTest-1357788047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:24:04 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-ea65c503-0ad2-4de0-ba55-03785ee0adfa tempest-CreateVolumesFromSnapshotTest-1357788047 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:24:04 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-ea65c503-0ad2-4de0-ba55-03785ee0adfa tempest-CreateVolumesFromSnapshotTest-1357788047 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:24:04 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ea65c503-0ad2-4de0-ba55-03785ee0adfa tempest-CreateVolumesFromSnapshotTest-1357788047 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-e2293f2a-e251-43bb-a66d-4c8475689220 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:04 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=70, name=volume-e2293f2a-e251-43bb-a66d-4c8475689220, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:24:04 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ea65c503-0ad2-4de0-ba55-03785ee0adfa tempest-CreateVolumesFromSnapshotTest-1357788047 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-e2293f2a-e251-43bb-a66d-4c8475689220 1073741824" returned: 0 in 0.797s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:04 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ea65c503-0ad2-4de0-ba55-03785ee0adfa tempest-CreateVolumesFromSnapshotTest-1357788047 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-e2293f2a-e251-43bb-a66d-4c8475689220 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:05 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-20a522cb-0a7a-415f-b9d5-2ebe16658017 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:24:05 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-20a522cb-0a7a-415f-b9d5-2ebe16658017 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:24:05 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-20a522cb-0a7a-415f-b9d5-2ebe16658017 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Flow 'volume_create_manager' (50b0e351-a5e4-4187-a88c-9abf82271a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:24:05 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-20a522cb-0a7a-415f-b9d5-2ebe16658017 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cfac788-851f-44ee-9caf-b429836946f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:24:05 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-20a522cb-0a7a-415f-b9d5-2ebe16658017 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cfac788-851f-44ee-9caf-b429836946f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:24:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-118896688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3a897ad-d6e9-4210-99a4-7c65a3c806a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fb8e00175a147719167e3e27399fae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:24:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:24:04Z,use_quota=True,user_id='ca248854a72b40d3baca6a4966672c65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:24:05 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-20a522cb-0a7a-415f-b9d5-2ebe16658017 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b5aba04-c957-4a3d-a802-d74d0705b1e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:24:05 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-20a522cb-0a7a-415f-b9d5-2ebe16658017 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b5aba04-c957-4a3d-a802-d74d0705b1e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:24:05 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-20a522cb-0a7a-415f-b9d5-2ebe16658017 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccc0396a-0ebd-482d-8685-3dcb90ec1429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:24:05 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-20a522cb-0a7a-415f-b9d5-2ebe16658017 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccc0396a-0ebd-482d-8685-3dcb90ec1429) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3a897ad-d6e9-4210-99a4-7c65a3c806a6', 'volume_name': 'volume-e3a897ad-d6e9-4210-99a4-7c65a3c806a6', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:24:05 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-20a522cb-0a7a-415f-b9d5-2ebe16658017 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d925c2b-7b38-4516-a03b-5fd88fe42e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:24:05 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-20a522cb-0a7a-415f-b9d5-2ebe16658017 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d925c2b-7b38-4516-a03b-5fd88fe42e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:24:05 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-20a522cb-0a7a-415f-b9d5-2ebe16658017 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d94bd8f9-4106-48ed-ae0a-a39c13db478c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:24:05 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-20a522cb-0a7a-415f-b9d5-2ebe16658017 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Volume e3a897ad-d6e9-4210-99a4-7c65a3c806a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3a897ad-d6e9-4210-99a4-7c65a3c806a6', 'volume_size': 1} Sep 10 21:24:05 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-20a522cb-0a7a-415f-b9d5-2ebe16658017 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:24:05 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ea65c503-0ad2-4de0-ba55-03785ee0adfa tempest-CreateVolumesFromSnapshotTest-1357788047 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-e2293f2a-e251-43bb-a66d-4c8475689220" returned: 0 in 0.855s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:05 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-ea65c503-0ad2-4de0-ba55-03785ee0adfa tempest-CreateVolumesFromSnapshotTest-1357788047 None] <== create_volume: return (1706ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:24:05 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-ea65c503-0ad2-4de0-ba55-03785ee0adfa tempest-CreateVolumesFromSnapshotTest-1357788047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.714s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:24:05 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-20a522cb-0a7a-415f-b9d5-2ebe16658017 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.104s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:24:05 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-20a522cb-0a7a-415f-b9d5-2ebe16658017 tempest-CreateVolumesFromSnapshotTest-1357788047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:24:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-118896688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3a897ad-d6e9-4210-99a4-7c65a3c806a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fb8e00175a147719167e3e27399fae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:24:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:24:04Z,use_quota=True,user_id='ca248854a72b40d3baca6a4966672c65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:24:05 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-20a522cb-0a7a-415f-b9d5-2ebe16658017 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Creating volume e3a897ad-d6e9-4210-99a4-7c65a3c806a6 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:24:05 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-20a522cb-0a7a-415f-b9d5-2ebe16658017 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:24:05 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-20a522cb-0a7a-415f-b9d5-2ebe16658017 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:24:05 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-20a522cb-0a7a-415f-b9d5-2ebe16658017 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:24:05 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-20a522cb-0a7a-415f-b9d5-2ebe16658017 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:24:05 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-20a522cb-0a7a-415f-b9d5-2ebe16658017 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:24:05 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-20a522cb-0a7a-415f-b9d5-2ebe16658017 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:24:05 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-20a522cb-0a7a-415f-b9d5-2ebe16658017 tempest-CreateVolumesFromSnapshotTest-1357788047 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:24:05 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-20a522cb-0a7a-415f-b9d5-2ebe16658017 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-e3a897ad-d6e9-4210-99a4-7c65a3c806a6 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:06 devstack quobyte-client[82807]: System call of process 94186 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:24:06 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=71, name=volume-e3a897ad-d6e9-4210-99a4-7c65a3c806a6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:24:06 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-c931ffdd-3887-4b18-9b3f-fe159f034f32 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:24:06 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-c931ffdd-3887-4b18-9b3f-fe159f034f32 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:24:06 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c931ffdd-3887-4b18-9b3f-fe159f034f32 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Flow 'volume_create_manager' (af81c187-1d6f-48e5-8dc3-b10add0d3c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:24:06 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c931ffdd-3887-4b18-9b3f-fe159f034f32 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79b8cc57-6fd5-4721-9fa2-f2d06c97d669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:24:06 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ea65c503-0ad2-4de0-ba55-03785ee0adfa tempest-CreateVolumesFromSnapshotTest-1357788047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bf2a5a7-6357-4832-a257-547d54207772) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2293f2a-e251-43bb-a66d-4c8475689220', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:24:06 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ea65c503-0ad2-4de0-ba55-03785ee0adfa tempest-CreateVolumesFromSnapshotTest-1357788047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (856f8615-f822-40c0-a320-e6d4f1ca7059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:24:06 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-20a522cb-0a7a-415f-b9d5-2ebe16658017 tempest-CreateVolumesFromSnapshotTest-1357788047 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-e3a897ad-d6e9-4210-99a4-7c65a3c806a6 1073741824" returned: 0 in 0.728s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:06 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-20a522cb-0a7a-415f-b9d5-2ebe16658017 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-e3a897ad-d6e9-4210-99a4-7c65a3c806a6 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:06 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-ea65c503-0ad2-4de0-ba55-03785ee0adfa tempest-CreateVolumesFromSnapshotTest-1357788047 None] Volume volume-e2293f2a-e251-43bb-a66d-4c8475689220 (e2293f2a-e251-43bb-a66d-4c8475689220): created successfully Sep 10 21:24:06 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ea65c503-0ad2-4de0-ba55-03785ee0adfa tempest-CreateVolumesFromSnapshotTest-1357788047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (856f8615-f822-40c0-a320-e6d4f1ca7059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:24:06 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ea65c503-0ad2-4de0-ba55-03785ee0adfa tempest-CreateVolumesFromSnapshotTest-1357788047 None] Flow 'volume_create_manager' (66b45409-3141-43d1-a77b-91d8b5e76b2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:24:06 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c931ffdd-3887-4b18-9b3f-fe159f034f32 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79b8cc57-6fd5-4721-9fa2-f2d06c97d669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:24:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1826512585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2c88ebf-6320-44ff-ba31-f20a4eba5c97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fb8e00175a147719167e3e27399fae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:24:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:24:05Z,use_quota=True,user_id='ca248854a72b40d3baca6a4966672c65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:24:06 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c931ffdd-3887-4b18-9b3f-fe159f034f32 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (725dccb9-048f-4fad-8ec8-e1e2ce82ca02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:24:06 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c931ffdd-3887-4b18-9b3f-fe159f034f32 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (725dccb9-048f-4fad-8ec8-e1e2ce82ca02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:24:06 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c931ffdd-3887-4b18-9b3f-fe159f034f32 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b88e1d2-8d7f-46a9-81fd-67e7cbf584de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:24:06 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c931ffdd-3887-4b18-9b3f-fe159f034f32 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b88e1d2-8d7f-46a9-81fd-67e7cbf584de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2c88ebf-6320-44ff-ba31-f20a4eba5c97', 'volume_name': 'volume-e2c88ebf-6320-44ff-ba31-f20a4eba5c97', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:24:06 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c931ffdd-3887-4b18-9b3f-fe159f034f32 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (439dfdff-2beb-485c-a1fb-dc0f054111aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:24:06 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c931ffdd-3887-4b18-9b3f-fe159f034f32 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (439dfdff-2beb-485c-a1fb-dc0f054111aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:24:06 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c931ffdd-3887-4b18-9b3f-fe159f034f32 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c71c6c89-7b91-4b07-bf91-bbd154ed700c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:24:06 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-c931ffdd-3887-4b18-9b3f-fe159f034f32 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Volume e2c88ebf-6320-44ff-ba31-f20a4eba5c97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2c88ebf-6320-44ff-ba31-f20a4eba5c97', 'volume_size': 1} Sep 10 21:24:06 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-c931ffdd-3887-4b18-9b3f-fe159f034f32 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:24:07 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-847b3768-c1d0-4038-a6fc-fcc7ac8d35ce tempest-CreateVolumesFromSnapshotTest-1357788047 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:24:07 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-847b3768-c1d0-4038-a6fc-fcc7ac8d35ce tempest-CreateVolumesFromSnapshotTest-1357788047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:24:07 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-847b3768-c1d0-4038-a6fc-fcc7ac8d35ce tempest-CreateVolumesFromSnapshotTest-1357788047 None] Flow 'volume_create_manager' (bd718394-ac8e-4a20-b95e-34242035981d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:24:07 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-847b3768-c1d0-4038-a6fc-fcc7ac8d35ce tempest-CreateVolumesFromSnapshotTest-1357788047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c6a1f1b-a31d-4ecd-99d0-cadcf3fd5c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:24:07 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-fff23d3e-02fb-4d72-9729-78a5f0c3f9cd tempest-CreateVolumesFromSnapshotTest-1357788047 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:24:07 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-fff23d3e-02fb-4d72-9729-78a5f0c3f9cd tempest-CreateVolumesFromSnapshotTest-1357788047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:24:07 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fff23d3e-02fb-4d72-9729-78a5f0c3f9cd tempest-CreateVolumesFromSnapshotTest-1357788047 None] Flow 'volume_create_manager' (ebcedd59-96ae-49e2-946c-dfef86398164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:24:07 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fff23d3e-02fb-4d72-9729-78a5f0c3f9cd tempest-CreateVolumesFromSnapshotTest-1357788047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (706562ee-0668-468f-9733-fa5ccfc9d368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:24:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-20a522cb-0a7a-415f-b9d5-2ebe16658017 tempest-CreateVolumesFromSnapshotTest-1357788047 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-e3a897ad-d6e9-4210-99a4-7c65a3c806a6" returned: 0 in 0.632s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:07 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-20a522cb-0a7a-415f-b9d5-2ebe16658017 tempest-CreateVolumesFromSnapshotTest-1357788047 None] <== create_volume: return (1437ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:24:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-20a522cb-0a7a-415f-b9d5-2ebe16658017 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.451s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:24:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-c931ffdd-3887-4b18-9b3f-fe159f034f32 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.254s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:24:07 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-c931ffdd-3887-4b18-9b3f-fe159f034f32 tempest-CreateVolumesFromSnapshotTest-1357788047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:24:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1826512585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2c88ebf-6320-44ff-ba31-f20a4eba5c97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fb8e00175a147719167e3e27399fae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:24:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:24:05Z,use_quota=True,user_id='ca248854a72b40d3baca6a4966672c65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:24:07 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-c931ffdd-3887-4b18-9b3f-fe159f034f32 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Creating volume e2c88ebf-6320-44ff-ba31-f20a4eba5c97 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:24:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-c931ffdd-3887-4b18-9b3f-fe159f034f32 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:24:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-c931ffdd-3887-4b18-9b3f-fe159f034f32 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:24:07 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-c931ffdd-3887-4b18-9b3f-fe159f034f32 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:24:07 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-c931ffdd-3887-4b18-9b3f-fe159f034f32 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:24:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-c931ffdd-3887-4b18-9b3f-fe159f034f32 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:24:07 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-c931ffdd-3887-4b18-9b3f-fe159f034f32 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:24:07 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-c931ffdd-3887-4b18-9b3f-fe159f034f32 tempest-CreateVolumesFromSnapshotTest-1357788047 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:24:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c931ffdd-3887-4b18-9b3f-fe159f034f32 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-e2c88ebf-6320-44ff-ba31-f20a4eba5c97 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:07 devstack quobyte-client[82807]: System call of process 94191 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:24:07 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=72, name=volume-e2c88ebf-6320-44ff-ba31-f20a4eba5c97, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:24:07 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-847b3768-c1d0-4038-a6fc-fcc7ac8d35ce tempest-CreateVolumesFromSnapshotTest-1357788047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c6a1f1b-a31d-4ecd-99d0-cadcf3fd5c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:24:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-303546262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca7908ff-c9fc-4497-8556-2f0d9a024c45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fb8e00175a147719167e3e27399fae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:24:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:24:05Z,use_quota=True,user_id='ca248854a72b40d3baca6a4966672c65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:24:07 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-847b3768-c1d0-4038-a6fc-fcc7ac8d35ce tempest-CreateVolumesFromSnapshotTest-1357788047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97f5db9b-be29-4f16-8ea0-4f39e741178d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:24:07 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-847b3768-c1d0-4038-a6fc-fcc7ac8d35ce tempest-CreateVolumesFromSnapshotTest-1357788047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97f5db9b-be29-4f16-8ea0-4f39e741178d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:24:07 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-847b3768-c1d0-4038-a6fc-fcc7ac8d35ce tempest-CreateVolumesFromSnapshotTest-1357788047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaffe99a-c200-41e1-bf58-8523b8132115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:24:07 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-847b3768-c1d0-4038-a6fc-fcc7ac8d35ce tempest-CreateVolumesFromSnapshotTest-1357788047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaffe99a-c200-41e1-bf58-8523b8132115) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca7908ff-c9fc-4497-8556-2f0d9a024c45', 'volume_name': 'volume-ca7908ff-c9fc-4497-8556-2f0d9a024c45', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:24:07 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-847b3768-c1d0-4038-a6fc-fcc7ac8d35ce tempest-CreateVolumesFromSnapshotTest-1357788047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68d740c3-d37f-4a9d-9af4-9a531fd6ad2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:24:07 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-847b3768-c1d0-4038-a6fc-fcc7ac8d35ce tempest-CreateVolumesFromSnapshotTest-1357788047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68d740c3-d37f-4a9d-9af4-9a531fd6ad2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:24:07 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-847b3768-c1d0-4038-a6fc-fcc7ac8d35ce tempest-CreateVolumesFromSnapshotTest-1357788047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a5db73e-c721-4931-a7c0-5d2ed55e6bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:24:07 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-847b3768-c1d0-4038-a6fc-fcc7ac8d35ce tempest-CreateVolumesFromSnapshotTest-1357788047 None] Volume ca7908ff-c9fc-4497-8556-2f0d9a024c45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca7908ff-c9fc-4497-8556-2f0d9a024c45', 'volume_size': 1} Sep 10 21:24:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-847b3768-c1d0-4038-a6fc-fcc7ac8d35ce tempest-CreateVolumesFromSnapshotTest-1357788047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:24:07 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fff23d3e-02fb-4d72-9729-78a5f0c3f9cd tempest-CreateVolumesFromSnapshotTest-1357788047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (706562ee-0668-468f-9733-fa5ccfc9d368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:24:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1987765724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fb61a96-52b5-43e3-9a0c-807745c14f37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fb8e00175a147719167e3e27399fae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:24:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:24:06Z,use_quota=True,user_id='ca248854a72b40d3baca6a4966672c65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:24:07 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fff23d3e-02fb-4d72-9729-78a5f0c3f9cd tempest-CreateVolumesFromSnapshotTest-1357788047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47ecaad6-3773-4c63-a233-6ab093de4f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:24:07 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fff23d3e-02fb-4d72-9729-78a5f0c3f9cd tempest-CreateVolumesFromSnapshotTest-1357788047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47ecaad6-3773-4c63-a233-6ab093de4f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:24:07 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fff23d3e-02fb-4d72-9729-78a5f0c3f9cd tempest-CreateVolumesFromSnapshotTest-1357788047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00a0de87-5e56-4c54-8159-2bec2b88f728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:24:07 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fff23d3e-02fb-4d72-9729-78a5f0c3f9cd tempest-CreateVolumesFromSnapshotTest-1357788047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00a0de87-5e56-4c54-8159-2bec2b88f728) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fb61a96-52b5-43e3-9a0c-807745c14f37', 'volume_name': 'volume-9fb61a96-52b5-43e3-9a0c-807745c14f37', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:24:07 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fff23d3e-02fb-4d72-9729-78a5f0c3f9cd tempest-CreateVolumesFromSnapshotTest-1357788047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2df691c-103e-4851-8e96-6eefe34b5354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:24:07 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fff23d3e-02fb-4d72-9729-78a5f0c3f9cd tempest-CreateVolumesFromSnapshotTest-1357788047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2df691c-103e-4851-8e96-6eefe34b5354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:24:07 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fff23d3e-02fb-4d72-9729-78a5f0c3f9cd tempest-CreateVolumesFromSnapshotTest-1357788047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a26f90f-3efb-4d08-8e78-d837eabdaf01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:24:07 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-fff23d3e-02fb-4d72-9729-78a5f0c3f9cd tempest-CreateVolumesFromSnapshotTest-1357788047 None] Volume 9fb61a96-52b5-43e3-9a0c-807745c14f37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fb61a96-52b5-43e3-9a0c-807745c14f37', 'volume_size': 1} Sep 10 21:24:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-fff23d3e-02fb-4d72-9729-78a5f0c3f9cd tempest-CreateVolumesFromSnapshotTest-1357788047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:24:07 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-ea65c503-0ad2-4de0-ba55-03785ee0adfa tempest-CreateVolumesFromSnapshotTest-1357788047 None] Created volume successfully. Sep 10 21:24:07 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-20a522cb-0a7a-415f-b9d5-2ebe16658017 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d94bd8f9-4106-48ed-ae0a-a39c13db478c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3a897ad-d6e9-4210-99a4-7c65a3c806a6', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:24:07 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-20a522cb-0a7a-415f-b9d5-2ebe16658017 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da273b9f-9ad4-4879-bb58-08b3cd4d635e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:24:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c931ffdd-3887-4b18-9b3f-fe159f034f32 tempest-CreateVolumesFromSnapshotTest-1357788047 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-e2c88ebf-6320-44ff-ba31-f20a4eba5c97 1073741824" returned: 0 in 0.637s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c931ffdd-3887-4b18-9b3f-fe159f034f32 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-e2c88ebf-6320-44ff-ba31-f20a4eba5c97 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:08 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-20a522cb-0a7a-415f-b9d5-2ebe16658017 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Volume volume-e3a897ad-d6e9-4210-99a4-7c65a3c806a6 (e3a897ad-d6e9-4210-99a4-7c65a3c806a6): created successfully Sep 10 21:24:08 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-20a522cb-0a7a-415f-b9d5-2ebe16658017 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da273b9f-9ad4-4879-bb58-08b3cd4d635e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:24:08 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-20a522cb-0a7a-415f-b9d5-2ebe16658017 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Flow 'volume_create_manager' (50b0e351-a5e4-4187-a88c-9abf82271a68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:24:08 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-0fb2514c-b139-4df7-b43d-4607085faf16 tempest-VolumesExtendTest-1539744333 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:24:08 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fb2514c-b139-4df7-b43d-4607085faf16 tempest-VolumesExtendTest-1539744333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:24:08 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0fb2514c-b139-4df7-b43d-4607085faf16 tempest-VolumesExtendTest-1539744333 None] Flow 'volume_create_manager' (f3812db9-e683-4c0d-a7b1-8d64c46b2d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:24:08 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0fb2514c-b139-4df7-b43d-4607085faf16 tempest-VolumesExtendTest-1539744333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (113e12f2-8f94-46e3-bb82-0d278a61dd77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:24:08 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c931ffdd-3887-4b18-9b3f-fe159f034f32 tempest-CreateVolumesFromSnapshotTest-1357788047 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-e2c88ebf-6320-44ff-ba31-f20a4eba5c97" returned: 0 in 0.512s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:08 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-20a522cb-0a7a-415f-b9d5-2ebe16658017 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Created volume successfully. Sep 10 21:24:08 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-c931ffdd-3887-4b18-9b3f-fe159f034f32 tempest-CreateVolumesFromSnapshotTest-1357788047 None] <== create_volume: return (1175ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:24:08 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-c931ffdd-3887-4b18-9b3f-fe159f034f32 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:24:08 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-847b3768-c1d0-4038-a6fc-fcc7ac8d35ce tempest-CreateVolumesFromSnapshotTest-1357788047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.890s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:24:08 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-847b3768-c1d0-4038-a6fc-fcc7ac8d35ce tempest-CreateVolumesFromSnapshotTest-1357788047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:24:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-303546262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca7908ff-c9fc-4497-8556-2f0d9a024c45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fb8e00175a147719167e3e27399fae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:24:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:24:05Z,use_quota=True,user_id='ca248854a72b40d3baca6a4966672c65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:24:08 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-847b3768-c1d0-4038-a6fc-fcc7ac8d35ce tempest-CreateVolumesFromSnapshotTest-1357788047 None] Creating volume ca7908ff-c9fc-4497-8556-2f0d9a024c45 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:24:08 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-847b3768-c1d0-4038-a6fc-fcc7ac8d35ce tempest-CreateVolumesFromSnapshotTest-1357788047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:24:08 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-847b3768-c1d0-4038-a6fc-fcc7ac8d35ce tempest-CreateVolumesFromSnapshotTest-1357788047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:24:08 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-847b3768-c1d0-4038-a6fc-fcc7ac8d35ce tempest-CreateVolumesFromSnapshotTest-1357788047 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:24:08 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-847b3768-c1d0-4038-a6fc-fcc7ac8d35ce tempest-CreateVolumesFromSnapshotTest-1357788047 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:24:08 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-847b3768-c1d0-4038-a6fc-fcc7ac8d35ce tempest-CreateVolumesFromSnapshotTest-1357788047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:24:08 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-847b3768-c1d0-4038-a6fc-fcc7ac8d35ce tempest-CreateVolumesFromSnapshotTest-1357788047 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:24:08 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-847b3768-c1d0-4038-a6fc-fcc7ac8d35ce tempest-CreateVolumesFromSnapshotTest-1357788047 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:24:08 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-847b3768-c1d0-4038-a6fc-fcc7ac8d35ce tempest-CreateVolumesFromSnapshotTest-1357788047 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ca7908ff-c9fc-4497-8556-2f0d9a024c45 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:08 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=73, name=volume-ca7908ff-c9fc-4497-8556-2f0d9a024c45, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:24:08 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0fb2514c-b139-4df7-b43d-4607085faf16 tempest-VolumesExtendTest-1539744333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (113e12f2-8f94-46e3-bb82-0d278a61dd77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:24:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-232781348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41e3a3d4-4b8c-42c8-a26d-63cee372e88e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a401cf5fa244e92a22d0b035c6a2949',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:24:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:24:07Z,use_quota=True,user_id='ca6664665d3a4625959836bb3befbe2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:24:08 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0fb2514c-b139-4df7-b43d-4607085faf16 tempest-VolumesExtendTest-1539744333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8711915-d5c4-423e-84a8-265fe391818f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:24:08 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0fb2514c-b139-4df7-b43d-4607085faf16 tempest-VolumesExtendTest-1539744333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8711915-d5c4-423e-84a8-265fe391818f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:24:08 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0fb2514c-b139-4df7-b43d-4607085faf16 tempest-VolumesExtendTest-1539744333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71f8f321-d252-426f-b871-4f42a4643e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:24:08 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c931ffdd-3887-4b18-9b3f-fe159f034f32 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c71c6c89-7b91-4b07-bf91-bbd154ed700c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2c88ebf-6320-44ff-ba31-f20a4eba5c97', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:24:08 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c931ffdd-3887-4b18-9b3f-fe159f034f32 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af6e602f-d770-4204-a53b-47a6549bc858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:24:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-847b3768-c1d0-4038-a6fc-fcc7ac8d35ce tempest-CreateVolumesFromSnapshotTest-1357788047 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ca7908ff-c9fc-4497-8556-2f0d9a024c45 1073741824" returned: 0 in 0.559s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-847b3768-c1d0-4038-a6fc-fcc7ac8d35ce tempest-CreateVolumesFromSnapshotTest-1357788047 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ca7908ff-c9fc-4497-8556-2f0d9a024c45 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:09 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-c931ffdd-3887-4b18-9b3f-fe159f034f32 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Volume volume-e2c88ebf-6320-44ff-ba31-f20a4eba5c97 (e2c88ebf-6320-44ff-ba31-f20a4eba5c97): created successfully Sep 10 21:24:09 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c931ffdd-3887-4b18-9b3f-fe159f034f32 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af6e602f-d770-4204-a53b-47a6549bc858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:24:09 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c931ffdd-3887-4b18-9b3f-fe159f034f32 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Flow 'volume_create_manager' (af81c187-1d6f-48e5-8dc3-b10add0d3c9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:24:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-847b3768-c1d0-4038-a6fc-fcc7ac8d35ce tempest-CreateVolumesFromSnapshotTest-1357788047 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ca7908ff-c9fc-4497-8556-2f0d9a024c45" returned: 0 in 0.507s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:09 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-847b3768-c1d0-4038-a6fc-fcc7ac8d35ce tempest-CreateVolumesFromSnapshotTest-1357788047 None] <== create_volume: return (1089ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:24:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-847b3768-c1d0-4038-a6fc-fcc7ac8d35ce tempest-CreateVolumesFromSnapshotTest-1357788047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:24:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-fff23d3e-02fb-4d72-9729-78a5f0c3f9cd tempest-CreateVolumesFromSnapshotTest-1357788047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.930s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:24:09 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-fff23d3e-02fb-4d72-9729-78a5f0c3f9cd tempest-CreateVolumesFromSnapshotTest-1357788047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:24:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1987765724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fb61a96-52b5-43e3-9a0c-807745c14f37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fb8e00175a147719167e3e27399fae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:24:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:24:06Z,use_quota=True,user_id='ca248854a72b40d3baca6a4966672c65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:24:09 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-fff23d3e-02fb-4d72-9729-78a5f0c3f9cd tempest-CreateVolumesFromSnapshotTest-1357788047 None] Creating volume 9fb61a96-52b5-43e3-9a0c-807745c14f37 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:24:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-fff23d3e-02fb-4d72-9729-78a5f0c3f9cd tempest-CreateVolumesFromSnapshotTest-1357788047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:24:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-fff23d3e-02fb-4d72-9729-78a5f0c3f9cd tempest-CreateVolumesFromSnapshotTest-1357788047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:24:09 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-fff23d3e-02fb-4d72-9729-78a5f0c3f9cd tempest-CreateVolumesFromSnapshotTest-1357788047 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:24:09 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-fff23d3e-02fb-4d72-9729-78a5f0c3f9cd tempest-CreateVolumesFromSnapshotTest-1357788047 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:24:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-fff23d3e-02fb-4d72-9729-78a5f0c3f9cd tempest-CreateVolumesFromSnapshotTest-1357788047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:24:09 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-fff23d3e-02fb-4d72-9729-78a5f0c3f9cd tempest-CreateVolumesFromSnapshotTest-1357788047 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:24:09 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-fff23d3e-02fb-4d72-9729-78a5f0c3f9cd tempest-CreateVolumesFromSnapshotTest-1357788047 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:24:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-fff23d3e-02fb-4d72-9729-78a5f0c3f9cd tempest-CreateVolumesFromSnapshotTest-1357788047 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-9fb61a96-52b5-43e3-9a0c-807745c14f37 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:09 devstack quobyte-client[82807]: System call of process 94199 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:24:09 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-c931ffdd-3887-4b18-9b3f-fe159f034f32 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Created volume successfully. Sep 10 21:24:09 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=74, name=volume-9fb61a96-52b5-43e3-9a0c-807745c14f37, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:24:10 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-847b3768-c1d0-4038-a6fc-fcc7ac8d35ce tempest-CreateVolumesFromSnapshotTest-1357788047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a5db73e-c721-4931-a7c0-5d2ed55e6bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca7908ff-c9fc-4497-8556-2f0d9a024c45', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:24:10 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-847b3768-c1d0-4038-a6fc-fcc7ac8d35ce tempest-CreateVolumesFromSnapshotTest-1357788047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (054309b1-40e4-4323-8563-33c99ac17936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:24:10 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0fb2514c-b139-4df7-b43d-4607085faf16 tempest-VolumesExtendTest-1539744333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71f8f321-d252-426f-b871-4f42a4643e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '41e3a3d4-4b8c-42c8-a26d-63cee372e88e', 'volume_name': 'volume-41e3a3d4-4b8c-42c8-a26d-63cee372e88e', 'volume_size': 1, 'image_id': '844acb65-e174-4c79-a335-b56b5bb82298', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2bf6d32ea4d94e048fb27411155cf2e9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '844acb65-e174-4c79-a335-b56b5bb82298', 'created_at': datetime.datetime(2025, 9, 10, 18, 53, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 18, 53, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/844acb65-e174-4c79-a335-b56b5bb82298/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:24:10 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0fb2514c-b139-4df7-b43d-4607085faf16 tempest-VolumesExtendTest-1539744333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52969a0a-611b-4bd6-8b63-fc8b7a30a97a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:24:10 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0fb2514c-b139-4df7-b43d-4607085faf16 tempest-VolumesExtendTest-1539744333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52969a0a-611b-4bd6-8b63-fc8b7a30a97a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:24:10 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0fb2514c-b139-4df7-b43d-4607085faf16 tempest-VolumesExtendTest-1539744333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f6f54cf-7fe0-4e84-a9a6-4ee097b8ff9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:24:10 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-0fb2514c-b139-4df7-b43d-4607085faf16 tempest-VolumesExtendTest-1539744333 None] Volume 41e3a3d4-4b8c-42c8-a26d-63cee372e88e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-41e3a3d4-4b8c-42c8-a26d-63cee372e88e', 'volume_size': 1, 'image_id': '844acb65-e174-4c79-a335-b56b5bb82298', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2bf6d32ea4d94e048fb27411155cf2e9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '844acb65-e174-4c79-a335-b56b5bb82298', 'created_at': datetime.datetime(2025, 9, 10, 18, 53, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 18, 53, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/844acb65-e174-4c79-a335-b56b5bb82298/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 10 21:24:10 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fb2514c-b139-4df7-b43d-4607085faf16 tempest-VolumesExtendTest-1539744333 None] Cloning 41e3a3d4-4b8c-42c8-a26d-63cee372e88e from image 844acb65-e174-4c79-a335-b56b5bb82298 at location (None, None). {{(pid=82780) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1083}} Sep 10 21:24:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-fff23d3e-02fb-4d72-9729-78a5f0c3f9cd tempest-CreateVolumesFromSnapshotTest-1357788047 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-9fb61a96-52b5-43e3-9a0c-807745c14f37 1073741824" returned: 0 in 0.593s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-fff23d3e-02fb-4d72-9729-78a5f0c3f9cd tempest-CreateVolumesFromSnapshotTest-1357788047 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-9fb61a96-52b5-43e3-9a0c-807745c14f37 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:10 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-847b3768-c1d0-4038-a6fc-fcc7ac8d35ce tempest-CreateVolumesFromSnapshotTest-1357788047 None] Volume volume-ca7908ff-c9fc-4497-8556-2f0d9a024c45 (ca7908ff-c9fc-4497-8556-2f0d9a024c45): created successfully Sep 10 21:24:10 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-847b3768-c1d0-4038-a6fc-fcc7ac8d35ce tempest-CreateVolumesFromSnapshotTest-1357788047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (054309b1-40e4-4323-8563-33c99ac17936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:24:10 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-847b3768-c1d0-4038-a6fc-fcc7ac8d35ce tempest-CreateVolumesFromSnapshotTest-1357788047 None] Flow 'volume_create_manager' (bd718394-ac8e-4a20-b95e-34242035981d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:24:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-fff23d3e-02fb-4d72-9729-78a5f0c3f9cd tempest-CreateVolumesFromSnapshotTest-1357788047 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-9fb61a96-52b5-43e3-9a0c-807745c14f37" returned: 0 in 0.429s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:10 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-fff23d3e-02fb-4d72-9729-78a5f0c3f9cd tempest-CreateVolumesFromSnapshotTest-1357788047 None] <== create_volume: return (1042ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:24:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-fff23d3e-02fb-4d72-9729-78a5f0c3f9cd tempest-CreateVolumesFromSnapshotTest-1357788047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:24:10 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-847b3768-c1d0-4038-a6fc-fcc7ac8d35ce tempest-CreateVolumesFromSnapshotTest-1357788047 None] Created volume successfully. Sep 10 21:24:10 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fff23d3e-02fb-4d72-9729-78a5f0c3f9cd tempest-CreateVolumesFromSnapshotTest-1357788047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a26f90f-3efb-4d08-8e78-d837eabdaf01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fb61a96-52b5-43e3-9a0c-807745c14f37', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:24:10 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fff23d3e-02fb-4d72-9729-78a5f0c3f9cd tempest-CreateVolumesFromSnapshotTest-1357788047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81c25599-026e-40e8-b6d6-3c0d9c33210b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:24:10 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-fff23d3e-02fb-4d72-9729-78a5f0c3f9cd tempest-CreateVolumesFromSnapshotTest-1357788047 None] Volume volume-9fb61a96-52b5-43e3-9a0c-807745c14f37 (9fb61a96-52b5-43e3-9a0c-807745c14f37): created successfully Sep 10 21:24:10 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fff23d3e-02fb-4d72-9729-78a5f0c3f9cd tempest-CreateVolumesFromSnapshotTest-1357788047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81c25599-026e-40e8-b6d6-3c0d9c33210b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:24:10 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fff23d3e-02fb-4d72-9729-78a5f0c3f9cd tempest-CreateVolumesFromSnapshotTest-1357788047 None] Flow 'volume_create_manager' (ebcedd59-96ae-49e2-946c-dfef86398164) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:24:10 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-fff23d3e-02fb-4d72-9729-78a5f0c3f9cd tempest-CreateVolumesFromSnapshotTest-1357788047 None] Created volume successfully. Sep 10 21:24:11 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-25cd800c-f32e-4beb-8306-f318fb1e9943 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Acquiring lock "cinder-9fb61a96-52b5-43e3-9a0c-807745c14f37-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:24:11 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-25cd800c-f32e-4beb-8306-f318fb1e9943 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Lock "cinder-9fb61a96-52b5-43e3-9a0c-807745c14f37-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:24:11 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-25cd800c-f32e-4beb-8306-f318fb1e9943 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:24:11 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-25cd800c-f32e-4beb-8306-f318fb1e9943 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Acquiring lock "cinder-quobyte-9fb61a96-52b5-43e3-9a0c-807745c14f37" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:24:11 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-25cd800c-f32e-4beb-8306-f318fb1e9943 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Lock "cinder-quobyte-9fb61a96-52b5-43e3-9a0c-807745c14f37" acquired by "delete_volume" :: waited 0.036s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:24:11 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[67cf1254-3ee9-4355-9315-547bb07c7c15]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:24:11 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-25cd800c-f32e-4beb-8306-f318fb1e9943 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-9fb61a96-52b5-43e3-9a0c-807745c14f37 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:11 devstack cinder-volume[82780]: DEBUG cinder.image.image_utils [None req-0fb2514c-b139-4df7-b43d-4607085faf16 tempest-VolumesExtendTest-1539744333 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_844acb65-e174-4c79-a335-b56b5bb82298_7ae717omdevstack@QuobyteHD, size 20.69 MB, duration 1.46 sec {{(pid=82780) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 10 21:24:11 devstack cinder-volume[82780]: INFO cinder.image.image_utils [None req-0fb2514c-b139-4df7-b43d-4607085faf16 tempest-VolumesExtendTest-1539744333 None] Image download 20.69 MB at 14.20 MB/s Sep 10 21:24:11 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c914c0-3f0e-46bb-95a8-564316e1e82e]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:24:11 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0fb2514c-b139-4df7-b43d-4607085faf16 tempest-VolumesExtendTest-1539744333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_844acb65-e174-4c79-a335-b56b5bb82298_7ae717omdevstack@QuobyteHD {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:12 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-dcceb655-e9b0-4604-a4d0-e3ac26fa12bc req-9f2d5496-c3a5-4611-81e8-ac09863eb768 tempest-AttachVolumeTestJSON-828295401 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:24:12 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-25cd800c-f32e-4beb-8306-f318fb1e9943 tempest-CreateVolumesFromSnapshotTest-1357788047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-9fb61a96-52b5-43e3-9a0c-807745c14f37" returned: 0 in 1.032s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:12 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-25cd800c-f32e-4beb-8306-f318fb1e9943 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-9fb61a96-52b5-43e3-9a0c-807745c14f37 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:12 devstack sudo[94206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_844acb65-e174-4c79-a335-b56b5bb82298_7ae717omdevstack@QuobyteHD Sep 10 21:24:12 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-dcceb655-e9b0-4604-a4d0-e3ac26fa12bc req-9f2d5496-c3a5-4611-81e8-ac09863eb768 tempest-AttachVolumeTestJSON-828295401 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:24:12 devstack sudo[94206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 21:24:12 devstack cinder-volume[82780]: INFO cinder.volume.manager [req-dcceb655-e9b0-4604-a4d0-e3ac26fa12bc req-9f2d5496-c3a5-4611-81e8-ac09863eb768 tempest-AttachVolumeTestJSON-828295401 None] Terminate volume connection completed successfully. Sep 10 21:24:12 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-dcceb655-e9b0-4604-a4d0-e3ac26fa12bc req-9f2d5496-c3a5-4611-81e8-ac09863eb768 tempest-AttachVolumeTestJSON-828295401 None] Deleting attachment 6d566e9d-87cc-4641-bb1c-f8afce22d219. {{(pid=82780) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 21:24:12 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-25cd800c-f32e-4beb-8306-f318fb1e9943 tempest-CreateVolumesFromSnapshotTest-1357788047 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-9fb61a96-52b5-43e3-9a0c-807745c14f37" returned: 0 in 0.363s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:12 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-25cd800c-f32e-4beb-8306-f318fb1e9943 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Lock "cinder-quobyte-9fb61a96-52b5-43e3-9a0c-807745c14f37" released by "delete_volume" :: held 1.508s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:24:13 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-25cd800c-f32e-4beb-8306-f318fb1e9943 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Created reservations ['edeb3f99-d3e3-42cc-bcfc-838de2b6b7b9', '03a69620-6080-4132-b98a-086fe74f22d4', '275d13df-c234-4535-8ebd-a501bd2818f6', 'cd28297c-cfc6-4a03-97ec-0b25e6987c3c'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:24:13 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-25cd800c-f32e-4beb-8306-f318fb1e9943 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:24:13 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-25cd800c-f32e-4beb-8306-f318fb1e9943 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:24:13 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-25cd800c-f32e-4beb-8306-f318fb1e9943 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:24:13 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-25cd800c-f32e-4beb-8306-f318fb1e9943 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:24:13 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-25cd800c-f32e-4beb-8306-f318fb1e9943 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:24:13 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-25cd800c-f32e-4beb-8306-f318fb1e9943 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:13 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-25cd800c-f32e-4beb-8306-f318fb1e9943 tempest-CreateVolumesFromSnapshotTest-1357788047 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.179s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:13 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-25cd800c-f32e-4beb-8306-f318fb1e9943 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:24:13 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-c27ec9b2-993d-473a-ade7-3ff5cfd8f6e5 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Acquiring lock "cinder-ca7908ff-c9fc-4497-8556-2f0d9a024c45-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:24:13 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-25cd800c-f32e-4beb-8306-f318fb1e9943 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Deleted volume successfully. Sep 10 21:24:14 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-c27ec9b2-993d-473a-ade7-3ff5cfd8f6e5 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Lock "cinder-ca7908ff-c9fc-4497-8556-2f0d9a024c45-delete_volume" acquired by "delete_volume" :: waited 0.267s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:24:14 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-25cd800c-f32e-4beb-8306-f318fb1e9943 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Lock "cinder-9fb61a96-52b5-43e3-9a0c-807745c14f37-delete_volume" released by "delete_volume" :: held 2.875s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:24:14 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-c27ec9b2-993d-473a-ade7-3ff5cfd8f6e5 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:24:14 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-c27ec9b2-993d-473a-ade7-3ff5cfd8f6e5 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Acquiring lock "cinder-quobyte-ca7908ff-c9fc-4497-8556-2f0d9a024c45" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:24:14 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-c27ec9b2-993d-473a-ade7-3ff5cfd8f6e5 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Lock "cinder-quobyte-ca7908ff-c9fc-4497-8556-2f0d9a024c45" acquired by "delete_volume" :: waited 0.017s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:24:14 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd69e20f-c110-4e35-8bb9-9ebc52569b31]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:24:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c27ec9b2-993d-473a-ade7-3ff5cfd8f6e5 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ca7908ff-c9fc-4497-8556-2f0d9a024c45 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:14 devstack quobyte-client[82807]: System call of process 94212 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:24:15 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c27ec9b2-993d-473a-ade7-3ff5cfd8f6e5 tempest-CreateVolumesFromSnapshotTest-1357788047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ca7908ff-c9fc-4497-8556-2f0d9a024c45" returned: 0 in 0.708s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:15 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c27ec9b2-993d-473a-ade7-3ff5cfd8f6e5 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ca7908ff-c9fc-4497-8556-2f0d9a024c45 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:15 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c27ec9b2-993d-473a-ade7-3ff5cfd8f6e5 tempest-CreateVolumesFromSnapshotTest-1357788047 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ca7908ff-c9fc-4497-8556-2f0d9a024c45" returned: 0 in 0.253s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:15 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-c27ec9b2-993d-473a-ade7-3ff5cfd8f6e5 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Lock "cinder-quobyte-ca7908ff-c9fc-4497-8556-2f0d9a024c45" released by "delete_volume" :: held 1.317s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:24:15 devstack sudo[94206]: pam_unix(sudo:session): session closed for user root Sep 10 21:24:15 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0fb2514c-b139-4df7-b43d-4607085faf16 tempest-VolumesExtendTest-1539744333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_844acb65-e174-4c79-a335-b56b5bb82298_7ae717omdevstack@QuobyteHD" returned: 0 in 3.861s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:15 devstack cinder-volume[82780]: DEBUG cinder.image.image_utils [None req-0fb2514c-b139-4df7-b43d-4607085faf16 tempest-VolumesExtendTest-1539744333 None] Temporary image 844acb65-e174-4c79-a335-b56b5bb82298 is fetched for user ca6664665d3a4625959836bb3befbe2d. {{(pid=82780) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 10 21:24:16 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfabbe7-79db-4df1-8cf8-ae2550bb2fbc]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:24:16 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0fb2514c-b139-4df7-b43d-4607085faf16 tempest-VolumesExtendTest-1539744333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_844acb65-e174-4c79-a335-b56b5bb82298_7ae717omdevstack@QuobyteHD {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:17 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-c27ec9b2-993d-473a-ade7-3ff5cfd8f6e5 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Created reservations ['b481b8a6-acc0-4842-8e24-716217998760', '669bbbe2-e2c3-477b-9aa7-e3c9ad4bdee4', '880f8461-487b-46c7-ac6f-0896bdbd4bb4', '25f77e7f-4a48-418e-86d8-e7dde8ec4d09'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:24:17 devstack sudo[94234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_844acb65-e174-4c79-a335-b56b5bb82298_7ae717omdevstack@QuobyteHD Sep 10 21:24:17 devstack sudo[94234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 21:24:18 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-c27ec9b2-993d-473a-ade7-3ff5cfd8f6e5 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:24:18 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-c27ec9b2-993d-473a-ade7-3ff5cfd8f6e5 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:24:18 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-c27ec9b2-993d-473a-ade7-3ff5cfd8f6e5 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:24:18 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-c27ec9b2-993d-473a-ade7-3ff5cfd8f6e5 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:24:18 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-c27ec9b2-993d-473a-ade7-3ff5cfd8f6e5 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:24:18 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c27ec9b2-993d-473a-ade7-3ff5cfd8f6e5 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:18 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c27ec9b2-993d-473a-ade7-3ff5cfd8f6e5 tempest-CreateVolumesFromSnapshotTest-1357788047 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.149s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:18 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-c27ec9b2-993d-473a-ade7-3ff5cfd8f6e5 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:24:18 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-c27ec9b2-993d-473a-ade7-3ff5cfd8f6e5 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Deleted volume successfully. Sep 10 21:24:18 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-c27ec9b2-993d-473a-ade7-3ff5cfd8f6e5 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Lock "cinder-ca7908ff-c9fc-4497-8556-2f0d9a024c45-delete_volume" released by "delete_volume" :: held 4.762s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:24:19 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-3e48ecbc-0b8b-4f23-9b12-b617ae0d9cb0 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Acquiring lock "cinder-e2c88ebf-6320-44ff-ba31-f20a4eba5c97-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:24:19 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-3e48ecbc-0b8b-4f23-9b12-b617ae0d9cb0 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Lock "cinder-e2c88ebf-6320-44ff-ba31-f20a4eba5c97-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:24:19 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-3e48ecbc-0b8b-4f23-9b12-b617ae0d9cb0 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:24:19 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-3e48ecbc-0b8b-4f23-9b12-b617ae0d9cb0 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Acquiring lock "cinder-quobyte-e2c88ebf-6320-44ff-ba31-f20a4eba5c97" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:24:19 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-3e48ecbc-0b8b-4f23-9b12-b617ae0d9cb0 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Lock "cinder-quobyte-e2c88ebf-6320-44ff-ba31-f20a4eba5c97" acquired by "delete_volume" :: waited 0.015s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:24:19 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70b192e-457a-4063-b4bf-4e35642e17f5]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:24:19 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-3e48ecbc-0b8b-4f23-9b12-b617ae0d9cb0 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-e2c88ebf-6320-44ff-ba31-f20a4eba5c97 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:20 devstack sudo[94234]: pam_unix(sudo:session): session closed for user root Sep 10 21:24:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0fb2514c-b139-4df7-b43d-4607085faf16 tempest-VolumesExtendTest-1539744333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_844acb65-e174-4c79-a335-b56b5bb82298_7ae717omdevstack@QuobyteHD" returned: 0 in 3.927s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-0fb2514c-b139-4df7-b43d-4607085faf16 tempest-VolumesExtendTest-1539744333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:24:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-0fb2514c-b139-4df7-b43d-4607085faf16 tempest-VolumesExtendTest-1539744333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.014s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:24:20 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-0fb2514c-b139-4df7-b43d-4607085faf16 tempest-VolumesExtendTest-1539744333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:24:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-232781348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41e3a3d4-4b8c-42c8-a26d-63cee372e88e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a401cf5fa244e92a22d0b035c6a2949',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:24:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:24:07Z,use_quota=True,user_id='ca6664665d3a4625959836bb3befbe2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:24:20 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-0fb2514c-b139-4df7-b43d-4607085faf16 tempest-VolumesExtendTest-1539744333 None] Creating volume 41e3a3d4-4b8c-42c8-a26d-63cee372e88e {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:24:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-0fb2514c-b139-4df7-b43d-4607085faf16 tempest-VolumesExtendTest-1539744333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:24:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-0fb2514c-b139-4df7-b43d-4607085faf16 tempest-VolumesExtendTest-1539744333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:24:20 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-0fb2514c-b139-4df7-b43d-4607085faf16 tempest-VolumesExtendTest-1539744333 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:24:20 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-0fb2514c-b139-4df7-b43d-4607085faf16 tempest-VolumesExtendTest-1539744333 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:24:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-0fb2514c-b139-4df7-b43d-4607085faf16 tempest-VolumesExtendTest-1539744333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:24:20 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-0fb2514c-b139-4df7-b43d-4607085faf16 tempest-VolumesExtendTest-1539744333 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:24:20 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-0fb2514c-b139-4df7-b43d-4607085faf16 tempest-VolumesExtendTest-1539744333 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:24:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0fb2514c-b139-4df7-b43d-4607085faf16 tempest-VolumesExtendTest-1539744333 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-41e3a3d4-4b8c-42c8-a26d-63cee372e88e 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:20 devstack quobyte-client[82807]: System call of process 94270 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:24:20 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=75, name=volume-41e3a3d4-4b8c-42c8-a26d-63cee372e88e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:24:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-3e48ecbc-0b8b-4f23-9b12-b617ae0d9cb0 tempest-CreateVolumesFromSnapshotTest-1357788047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-e2c88ebf-6320-44ff-ba31-f20a4eba5c97" returned: 0 in 1.312s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-3e48ecbc-0b8b-4f23-9b12-b617ae0d9cb0 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-e2c88ebf-6320-44ff-ba31-f20a4eba5c97 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0fb2514c-b139-4df7-b43d-4607085faf16 tempest-VolumesExtendTest-1539744333 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-41e3a3d4-4b8c-42c8-a26d-63cee372e88e 1073741824" returned: 0 in 0.762s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-3e48ecbc-0b8b-4f23-9b12-b617ae0d9cb0 tempest-CreateVolumesFromSnapshotTest-1357788047 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-e2c88ebf-6320-44ff-ba31-f20a4eba5c97" returned: 0 in 0.354s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0fb2514c-b139-4df7-b43d-4607085faf16 tempest-VolumesExtendTest-1539744333 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-41e3a3d4-4b8c-42c8-a26d-63cee372e88e {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:21 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-3e48ecbc-0b8b-4f23-9b12-b617ae0d9cb0 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Lock "cinder-quobyte-e2c88ebf-6320-44ff-ba31-f20a4eba5c97" released by "delete_volume" :: held 2.190s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:24:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0fb2514c-b139-4df7-b43d-4607085faf16 tempest-VolumesExtendTest-1539744333 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-41e3a3d4-4b8c-42c8-a26d-63cee372e88e" returned: 0 in 0.612s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:21 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-0fb2514c-b139-4df7-b43d-4607085faf16 tempest-VolumesExtendTest-1539744333 None] <== create_volume: return (1508ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:24:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-0fb2514c-b139-4df7-b43d-4607085faf16 tempest-VolumesExtendTest-1539744333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.543s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:24:22 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-3e48ecbc-0b8b-4f23-9b12-b617ae0d9cb0 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Created reservations ['b185043f-50ec-483b-85d2-11a81922cc11', 'daed90d1-42a0-428e-bd0d-44cd7ebcbb31', '885a03c9-96da-417b-b977-54e5e18ce8f8', 'abc1a852-1cca-4eed-8cf0-12293e37ecec'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:24:22 devstack cinder-volume[82780]: DEBUG cinder.volume.volume_utils [None req-0fb2514c-b139-4df7-b43d-4607085faf16 tempest-VolumesExtendTest-1539744333 None] Attempting download of 844acb65-e174-4c79-a335-b56b5bb82298 ((None, None)) to volume 41e3a3d4-4b8c-42c8-a26d-63cee372e88e. {{(pid=82780) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 10 21:24:22 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb15286d-a809-46db-b379-0718f5027a11]: (4, 'raw') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:24:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0fb2514c-b139-4df7-b43d-4607085faf16 tempest-VolumesExtendTest-1539744333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_844acb65-e174-4c79-a335-b56b5bb82298_miuos23o {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-3e48ecbc-0b8b-4f23-9b12-b617ae0d9cb0 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:24:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-3e48ecbc-0b8b-4f23-9b12-b617ae0d9cb0 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.033s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:24:22 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-3e48ecbc-0b8b-4f23-9b12-b617ae0d9cb0 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:24:22 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-3e48ecbc-0b8b-4f23-9b12-b617ae0d9cb0 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:24:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-3e48ecbc-0b8b-4f23-9b12-b617ae0d9cb0 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:24:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-3e48ecbc-0b8b-4f23-9b12-b617ae0d9cb0 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:23 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-2721863c-fd1a-4f04-a3a7-0b44ae55b338 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Acquiring lock "cinder-e3a897ad-d6e9-4210-99a4-7c65a3c806a6-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:24:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0fb2514c-b139-4df7-b43d-4607085faf16 tempest-VolumesExtendTest-1539744333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_844acb65-e174-4c79-a335-b56b5bb82298_miuos23o" returned: 0 in 0.816s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0fb2514c-b139-4df7-b43d-4607085faf16 tempest-VolumesExtendTest-1539744333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_844acb65-e174-4c79-a335-b56b5bb82298_miuos23o {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-3e48ecbc-0b8b-4f23-9b12-b617ae0d9cb0 tempest-CreateVolumesFromSnapshotTest-1357788047 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.561s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:23 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-3e48ecbc-0b8b-4f23-9b12-b617ae0d9cb0 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:24:23 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-2721863c-fd1a-4f04-a3a7-0b44ae55b338 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Lock "cinder-e3a897ad-d6e9-4210-99a4-7c65a3c806a6-delete_volume" acquired by "delete_volume" :: waited 0.476s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:24:23 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-3e48ecbc-0b8b-4f23-9b12-b617ae0d9cb0 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Deleted volume successfully. Sep 10 21:24:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0fb2514c-b139-4df7-b43d-4607085faf16 tempest-VolumesExtendTest-1539744333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_844acb65-e174-4c79-a335-b56b5bb82298_miuos23o" returned: 1 in 0.619s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0fb2514c-b139-4df7-b43d-4607085faf16 tempest-VolumesExtendTest-1539744333 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_844acb65-e174-4c79-a335-b56b5bb82298_miuos23o' failed. Not Retrying. {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 21:24:23 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-3e48ecbc-0b8b-4f23-9b12-b617ae0d9cb0 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Lock "cinder-e2c88ebf-6320-44ff-ba31-f20a4eba5c97-delete_volume" released by "delete_volume" :: held 4.749s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:24:23 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[2954650c-6b3c-4178-b6af-d0aff5412889]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:24:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0fb2514c-b139-4df7-b43d-4607085faf16 tempest-VolumesExtendTest-1539744333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_844acb65-e174-4c79-a335-b56b5bb82298_7ae717omdevstack@QuobyteHD {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:24 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-2721863c-fd1a-4f04-a3a7-0b44ae55b338 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:24:24 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-2721863c-fd1a-4f04-a3a7-0b44ae55b338 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Acquiring lock "cinder-quobyte-e3a897ad-d6e9-4210-99a4-7c65a3c806a6" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:24:24 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-2721863c-fd1a-4f04-a3a7-0b44ae55b338 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Lock "cinder-quobyte-e3a897ad-d6e9-4210-99a4-7c65a3c806a6" acquired by "delete_volume" :: waited 0.073s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:24:24 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d898e6-adac-4d78-a7f8-bf2fd8fe5115]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:24:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-2721863c-fd1a-4f04-a3a7-0b44ae55b338 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-e3a897ad-d6e9-4210-99a4-7c65a3c806a6 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0fb2514c-b139-4df7-b43d-4607085faf16 tempest-VolumesExtendTest-1539744333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_844acb65-e174-4c79-a335-b56b5bb82298_7ae717omdevstack@QuobyteHD" returned: 0 in 0.651s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:24 devstack cinder-volume[82780]: DEBUG cinder.image.image_utils [None req-0fb2514c-b139-4df7-b43d-4607085faf16 tempest-VolumesExtendTest-1539744333 None] 844acb65-e174-4c79-a335-b56b5bb82298 was qcow2, converting to raw {{(pid=82780) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 10 21:24:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0fb2514c-b139-4df7-b43d-4607085faf16 tempest-VolumesExtendTest-1539744333 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_844acb65-e174-4c79-a335-b56b5bb82298_7ae717omdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-41e3a3d4-4b8c-42c8-a26d-63cee372e88e {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:24 devstack quobyte-client[82807]: System call of process 94287 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:24:24 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=75, name=volume-41e3a3d4-4b8c-42c8-a26d-63cee372e88e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:24:25 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-2721863c-fd1a-4f04-a3a7-0b44ae55b338 tempest-CreateVolumesFromSnapshotTest-1357788047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-e3a897ad-d6e9-4210-99a4-7c65a3c806a6" returned: 0 in 0.729s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:25 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-2721863c-fd1a-4f04-a3a7-0b44ae55b338 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-e3a897ad-d6e9-4210-99a4-7c65a3c806a6 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:25 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-2721863c-fd1a-4f04-a3a7-0b44ae55b338 tempest-CreateVolumesFromSnapshotTest-1357788047 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-e3a897ad-d6e9-4210-99a4-7c65a3c806a6" returned: 0 in 0.125s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:25 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-2721863c-fd1a-4f04-a3a7-0b44ae55b338 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Lock "cinder-quobyte-e3a897ad-d6e9-4210-99a4-7c65a3c806a6" released by "delete_volume" :: held 1.075s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:24:25 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-2721863c-fd1a-4f04-a3a7-0b44ae55b338 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Created reservations ['3864e707-e877-41b3-9552-a291db22ded1', 'abdd3a4c-5c0e-4847-9386-4fcfad795921', '5c4a41f2-6276-484f-893f-a890b89f3feb', '0a87afd1-1a15-400e-b121-9033ac6a59d0'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:24:26 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-2721863c-fd1a-4f04-a3a7-0b44ae55b338 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:24:26 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-2721863c-fd1a-4f04-a3a7-0b44ae55b338 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.016s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:24:26 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-2721863c-fd1a-4f04-a3a7-0b44ae55b338 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:24:26 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-2721863c-fd1a-4f04-a3a7-0b44ae55b338 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:24:26 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-2721863c-fd1a-4f04-a3a7-0b44ae55b338 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:24:26 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-2721863c-fd1a-4f04-a3a7-0b44ae55b338 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:26 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0fb2514c-b139-4df7-b43d-4607085faf16 tempest-VolumesExtendTest-1539744333 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_844acb65-e174-4c79-a335-b56b5bb82298_7ae717omdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-41e3a3d4-4b8c-42c8-a26d-63cee372e88e" returned: 0 in 1.571s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:26 devstack cinder-volume[82780]: DEBUG cinder.image.image_utils [None req-0fb2514c-b139-4df7-b43d-4607085faf16 tempest-VolumesExtendTest-1539744333 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_844acb65-e174-4c79-a335-b56b5bb82298_7ae717omdevstack@QuobyteHD, size 112.00 MB, duration 1.61 sec, destination /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-41e3a3d4-4b8c-42c8-a26d-63cee372e88e {{(pid=82780) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 10 21:24:26 devstack cinder-volume[82780]: INFO cinder.image.image_utils [None req-0fb2514c-b139-4df7-b43d-4607085faf16 tempest-VolumesExtendTest-1539744333 None] Converted 112.00 MB image at 69.65 MB/s Sep 10 21:24:26 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0fb2514c-b139-4df7-b43d-4607085faf16 tempest-VolumesExtendTest-1539744333 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-41e3a3d4-4b8c-42c8-a26d-63cee372e88e 1G {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:26 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-2721863c-fd1a-4f04-a3a7-0b44ae55b338 tempest-CreateVolumesFromSnapshotTest-1357788047 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.318s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:26 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-2721863c-fd1a-4f04-a3a7-0b44ae55b338 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:24:26 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-2721863c-fd1a-4f04-a3a7-0b44ae55b338 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Deleted volume successfully. Sep 10 21:24:26 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-8f36c4a3-0de4-471c-852b-eb92e33c6a71 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Acquiring lock "cinder-e2293f2a-e251-43bb-a66d-4c8475689220-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:24:26 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0fb2514c-b139-4df7-b43d-4607085faf16 tempest-VolumesExtendTest-1539744333 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-41e3a3d4-4b8c-42c8-a26d-63cee372e88e 1G" returned: 0 in 0.670s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:27 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-8f36c4a3-0de4-471c-852b-eb92e33c6a71 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Lock "cinder-e2293f2a-e251-43bb-a66d-4c8475689220-delete_volume" acquired by "delete_volume" :: waited 0.118s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:24:27 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-2721863c-fd1a-4f04-a3a7-0b44ae55b338 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Lock "cinder-e3a897ad-d6e9-4210-99a4-7c65a3c806a6-delete_volume" released by "delete_volume" :: held 3.402s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:24:27 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb95a42-775f-41f0-ae06-07ac3fbaac8b]: (4, 'raw') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:24:27 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0fb2514c-b139-4df7-b43d-4607085faf16 tempest-VolumesExtendTest-1539744333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-41e3a3d4-4b8c-42c8-a26d-63cee372e88e {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:27 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-8f36c4a3-0de4-471c-852b-eb92e33c6a71 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:24:27 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-8f36c4a3-0de4-471c-852b-eb92e33c6a71 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Acquiring lock "cinder-quobyte-e2293f2a-e251-43bb-a66d-4c8475689220" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:24:27 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-8f36c4a3-0de4-471c-852b-eb92e33c6a71 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Lock "cinder-quobyte-e2293f2a-e251-43bb-a66d-4c8475689220" acquired by "delete_volume" :: waited 0.079s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:24:27 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0fb2514c-b139-4df7-b43d-4607085faf16 tempest-VolumesExtendTest-1539744333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-41e3a3d4-4b8c-42c8-a26d-63cee372e88e" returned: 0 in 0.608s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:27 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0fb2514c-b139-4df7-b43d-4607085faf16 tempest-VolumesExtendTest-1539744333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-41e3a3d4-4b8c-42c8-a26d-63cee372e88e {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:27 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c8f9db-808f-47cf-a3a1-3cbe12ce9b9a]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:24:28 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-8f36c4a3-0de4-471c-852b-eb92e33c6a71 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-e2293f2a-e251-43bb-a66d-4c8475689220 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:28 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-d5e154b7-dc40-4576-8a6d-10715568d2f8 tempest-AttachVolumeTestJSON-828295401 None] Acquiring lock "cinder-26f9eac4-a7a7-444c-8eb9-0e9d16842a73-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:24:28 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-d5e154b7-dc40-4576-8a6d-10715568d2f8 tempest-AttachVolumeTestJSON-828295401 None] Lock "cinder-26f9eac4-a7a7-444c-8eb9-0e9d16842a73-delete_volume" acquired by "delete_volume" :: waited 0.102s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:24:28 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0fb2514c-b139-4df7-b43d-4607085faf16 tempest-VolumesExtendTest-1539744333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-41e3a3d4-4b8c-42c8-a26d-63cee372e88e" returned: 1 in 0.911s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:28 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0fb2514c-b139-4df7-b43d-4607085faf16 tempest-VolumesExtendTest-1539744333 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-41e3a3d4-4b8c-42c8-a26d-63cee372e88e' failed. Not Retrying. {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 21:24:28 devstack cinder-volume[82780]: DEBUG cinder.volume.volume_utils [None req-0fb2514c-b139-4df7-b43d-4607085faf16 tempest-VolumesExtendTest-1539744333 None] Downloaded image 844acb65-e174-4c79-a335-b56b5bb82298 ((None, None)) to volume 41e3a3d4-4b8c-42c8-a26d-63cee372e88e successfully. {{(pid=82780) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 10 21:24:28 devstack cinder-volume[82780]: DEBUG cinder.image.image_utils [None req-0fb2514c-b139-4df7-b43d-4607085faf16 tempest-VolumesExtendTest-1539744333 None] Temporary image 844acb65-e174-4c79-a335-b56b5bb82298 for user ca6664665d3a4625959836bb3befbe2d is deleted. {{(pid=82780) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 10 21:24:28 devstack cinder-volume[82780]: DEBUG cinder.volume.volume_utils [None req-0fb2514c-b139-4df7-b43d-4607085faf16 tempest-VolumesExtendTest-1539744333 None] Marking volume 41e3a3d4-4b8c-42c8-a26d-63cee372e88e as bootable. {{(pid=82780) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 10 21:24:28 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fb2514c-b139-4df7-b43d-4607085faf16 tempest-VolumesExtendTest-1539744333 None] Copying metadata from image 844acb65-e174-4c79-a335-b56b5bb82298 to 41e3a3d4-4b8c-42c8-a26d-63cee372e88e. {{(pid=82780) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 10 21:24:28 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fb2514c-b139-4df7-b43d-4607085faf16 tempest-VolumesExtendTest-1539744333 None] Creating volume glance metadata for volume 41e3a3d4-4b8c-42c8-a26d-63cee372e88e backed by image 844acb65-e174-4c79-a335-b56b5bb82298 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '844acb65-e174-4c79-a335-b56b5bb82298', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82780) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 10 21:24:28 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-d5e154b7-dc40-4576-8a6d-10715568d2f8 tempest-AttachVolumeTestJSON-828295401 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:24:28 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-d5e154b7-dc40-4576-8a6d-10715568d2f8 tempest-AttachVolumeTestJSON-828295401 None] Acquiring lock "cinder-quobyte-26f9eac4-a7a7-444c-8eb9-0e9d16842a73" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:24:28 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-d5e154b7-dc40-4576-8a6d-10715568d2f8 tempest-AttachVolumeTestJSON-828295401 None] Lock "cinder-quobyte-26f9eac4-a7a7-444c-8eb9-0e9d16842a73" acquired by "delete_volume" :: waited 0.057s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:24:28 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-8f36c4a3-0de4-471c-852b-eb92e33c6a71 tempest-CreateVolumesFromSnapshotTest-1357788047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-e2293f2a-e251-43bb-a66d-4c8475689220" returned: 0 in 0.871s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:28 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-8f36c4a3-0de4-471c-852b-eb92e33c6a71 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-e2293f2a-e251-43bb-a66d-4c8475689220 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:29 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b726e83d-b59e-43cf-b7a2-657cd63b6f20]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:24:29 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-d5e154b7-dc40-4576-8a6d-10715568d2f8 tempest-AttachVolumeTestJSON-828295401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-26f9eac4-a7a7-444c-8eb9-0e9d16842a73 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:29 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-8f36c4a3-0de4-471c-852b-eb92e33c6a71 tempest-CreateVolumesFromSnapshotTest-1357788047 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-e2293f2a-e251-43bb-a66d-4c8475689220" returned: 0 in 0.621s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:29 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-8f36c4a3-0de4-471c-852b-eb92e33c6a71 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Lock "cinder-quobyte-e2293f2a-e251-43bb-a66d-4c8475689220" released by "delete_volume" :: held 1.904s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:24:29 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-8f36c4a3-0de4-471c-852b-eb92e33c6a71 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Created reservations ['41e71f5f-e984-4370-8171-b8b7dd45bdec', 'dfa37272-5b41-48f0-afb1-bd46873a146f', '21669f4c-5177-489b-bcee-431c3d3f33d8', '235c898c-53c3-47cc-95af-4af69416dfe6'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:24:29 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-d5e154b7-dc40-4576-8a6d-10715568d2f8 tempest-AttachVolumeTestJSON-828295401 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-26f9eac4-a7a7-444c-8eb9-0e9d16842a73" returned: 0 in 0.693s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:29 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-d5e154b7-dc40-4576-8a6d-10715568d2f8 tempest-AttachVolumeTestJSON-828295401 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-26f9eac4-a7a7-444c-8eb9-0e9d16842a73 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:30 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0fb2514c-b139-4df7-b43d-4607085faf16 tempest-VolumesExtendTest-1539744333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f6f54cf-7fe0-4e84-a9a6-4ee097b8ff9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41e3a3d4-4b8c-42c8-a26d-63cee372e88e', 'volume_size': 1, 'image_id': '844acb65-e174-4c79-a335-b56b5bb82298', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2bf6d32ea4d94e048fb27411155cf2e9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '844acb65-e174-4c79-a335-b56b5bb82298', 'created_at': datetime.datetime(2025, 9, 10, 18, 53, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 18, 53, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/844acb65-e174-4c79-a335-b56b5bb82298/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:24:30 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0fb2514c-b139-4df7-b43d-4607085faf16 tempest-VolumesExtendTest-1539744333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e555f5f-74b2-4630-8b2c-11fc8edac8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:24:30 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-6d46df4c-9049-42ac-8dbc-2bea9766be78 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Acquiring lock "cinder-8e4eed04-1b27-4397-8c47-61906365cd18-delete_snapshot" by "delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:24:30 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-0fb2514c-b139-4df7-b43d-4607085faf16 tempest-VolumesExtendTest-1539744333 None] Volume volume-41e3a3d4-4b8c-42c8-a26d-63cee372e88e (41e3a3d4-4b8c-42c8-a26d-63cee372e88e): created successfully Sep 10 21:24:30 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0fb2514c-b139-4df7-b43d-4607085faf16 tempest-VolumesExtendTest-1539744333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e555f5f-74b2-4630-8b2c-11fc8edac8e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:24:30 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0fb2514c-b139-4df7-b43d-4607085faf16 tempest-VolumesExtendTest-1539744333 None] Flow 'volume_create_manager' (f3812db9-e683-4c0d-a7b1-8d64c46b2d33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:24:30 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-d5e154b7-dc40-4576-8a6d-10715568d2f8 tempest-AttachVolumeTestJSON-828295401 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-26f9eac4-a7a7-444c-8eb9-0e9d16842a73" returned: 0 in 0.600s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:30 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-6d46df4c-9049-42ac-8dbc-2bea9766be78 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Lock "cinder-8e4eed04-1b27-4397-8c47-61906365cd18-delete_snapshot" acquired by "delete_snapshot" :: waited 0.172s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:24:30 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-6d46df4c-9049-42ac-8dbc-2bea9766be78 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:24:30 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-6d46df4c-9049-42ac-8dbc-2bea9766be78 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Acquiring lock "cinder-quobyte-8c539dc1-9533-452b-aecb-ca3c3f5e6fd9" by "delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:24:30 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-d5e154b7-dc40-4576-8a6d-10715568d2f8 tempest-AttachVolumeTestJSON-828295401 None] Lock "cinder-quobyte-26f9eac4-a7a7-444c-8eb9-0e9d16842a73" released by "delete_volume" :: held 1.712s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:24:30 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-0fb2514c-b139-4df7-b43d-4607085faf16 tempest-VolumesExtendTest-1539744333 None] Created volume successfully. Sep 10 21:24:30 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-6d46df4c-9049-42ac-8dbc-2bea9766be78 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Lock "cinder-quobyte-8c539dc1-9533-452b-aecb-ca3c3f5e6fd9" acquired by "delete_snapshot" :: waited 0.078s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:24:30 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-6d46df4c-9049-42ac-8dbc-2bea9766be78 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Acquiring lock "cinder-quobyte-8e4eed04-1b27-4397-8c47-61906365cd18" by "_delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:24:30 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-6d46df4c-9049-42ac-8dbc-2bea9766be78 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Lock "cinder-quobyte-8e4eed04-1b27-4397-8c47-61906365cd18" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:24:30 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-6d46df4c-9049-42ac-8dbc-2bea9766be78 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Deleting offline snapshot 8e4eed04-1b27-4397-8c47-61906365cd18 of volume 8c539dc1-9533-452b-aecb-ca3c3f5e6fd9 {{(pid=82780) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 21:24:30 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-6d46df4c-9049-42ac-8dbc-2bea9766be78 tempest-CreateVolumesFromSnapshotTest-1357788047 None] snapshot_file for this snap is: volume-8c539dc1-9533-452b-aecb-ca3c3f5e6fd9.8e4eed04-1b27-4397-8c47-61906365cd18 {{(pid=82780) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 21:24:30 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-8f36c4a3-0de4-471c-852b-eb92e33c6a71 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:24:30 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-8f36c4a3-0de4-471c-852b-eb92e33c6a71 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:24:30 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-8f36c4a3-0de4-471c-852b-eb92e33c6a71 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:24:30 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-8f36c4a3-0de4-471c-852b-eb92e33c6a71 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:24:30 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-8f36c4a3-0de4-471c-852b-eb92e33c6a71 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:24:30 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-8f36c4a3-0de4-471c-852b-eb92e33c6a71 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:30 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[acac3412-8e87-4cad-9696-1e5d1a159c1b]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:24:30 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-6d46df4c-9049-42ac-8dbc-2bea9766be78 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-8c539dc1-9533-452b-aecb-ca3c3f5e6fd9.8e4eed04-1b27-4397-8c47-61906365cd18 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:31 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-194cf08d-5f74-4be4-873c-f1873089b0b4 tempest-VolumesExtendTest-1539744333 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:24:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-194cf08d-5f74-4be4-873c-f1873089b0b4 tempest-VolumesExtendTest-1539744333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:24:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-194cf08d-5f74-4be4-873c-f1873089b0b4 tempest-VolumesExtendTest-1539744333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.005s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:24:31 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-d5e154b7-dc40-4576-8a6d-10715568d2f8 tempest-AttachVolumeTestJSON-828295401 None] Created reservations ['b7ab6cb8-5596-4b1d-a178-70ecca1c1a8f', '920ef28e-238b-47bf-b2ac-7b99061fa0d9', '32514119-a7d7-4908-ad2e-ab99f829d924', 'b62fe1cf-c21d-4937-87f2-7666b96e937c'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:24:31 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[77dc4968-52d5-4bbe-af03-998288e04ab6]: (4, 'raw') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:24:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-194cf08d-5f74-4be4-873c-f1873089b0b4 tempest-VolumesExtendTest-1539744333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-41e3a3d4-4b8c-42c8-a26d-63cee372e88e {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:31 devstack quobyte-client[82807]: System call of process 94317 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:24:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-8f36c4a3-0de4-471c-852b-eb92e33c6a71 tempest-CreateVolumesFromSnapshotTest-1357788047 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 1.078s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:31 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-8f36c4a3-0de4-471c-852b-eb92e33c6a71 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:24:31 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-8f36c4a3-0de4-471c-852b-eb92e33c6a71 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Deleted volume successfully. Sep 10 21:24:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-6d46df4c-9049-42ac-8dbc-2bea9766be78 tempest-CreateVolumesFromSnapshotTest-1357788047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-8c539dc1-9533-452b-aecb-ca3c3f5e6fd9.8e4eed04-1b27-4397-8c47-61906365cd18" returned: 0 in 1.011s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:31 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-6d46df4c-9049-42ac-8dbc-2bea9766be78 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c539dc1-9533-452b-aecb-ca3c3f5e6fd9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82780) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 21:24:32 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded3366c-d4d9-4bb0-9251-de7050c7ad26]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:24:32 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-6d46df4c-9049-42ac-8dbc-2bea9766be78 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-8c539dc1-9533-452b-aecb-ca3c3f5e6fd9 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:32 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-8f36c4a3-0de4-471c-852b-eb92e33c6a71 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Lock "cinder-e2293f2a-e251-43bb-a66d-4c8475689220-delete_volume" released by "delete_volume" :: held 5.313s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:24:32 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-194cf08d-5f74-4be4-873c-f1873089b0b4 tempest-VolumesExtendTest-1539744333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-41e3a3d4-4b8c-42c8-a26d-63cee372e88e" returned: 0 in 0.905s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:32 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-194cf08d-5f74-4be4-873c-f1873089b0b4 tempest-VolumesExtendTest-1539744333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-41e3a3d4-4b8c-42c8-a26d-63cee372e88e {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:32 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-d5e154b7-dc40-4576-8a6d-10715568d2f8 tempest-AttachVolumeTestJSON-828295401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:24:32 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-d5e154b7-dc40-4576-8a6d-10715568d2f8 tempest-AttachVolumeTestJSON-828295401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.035s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:24:32 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-d5e154b7-dc40-4576-8a6d-10715568d2f8 tempest-AttachVolumeTestJSON-828295401 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:24:32 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-d5e154b7-dc40-4576-8a6d-10715568d2f8 tempest-AttachVolumeTestJSON-828295401 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:24:32 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-d5e154b7-dc40-4576-8a6d-10715568d2f8 tempest-AttachVolumeTestJSON-828295401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:24:32 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-d5e154b7-dc40-4576-8a6d-10715568d2f8 tempest-AttachVolumeTestJSON-828295401 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:33 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-c950ee84-c7f5-4070-aa49-49163b667b31 tempest-AttachVolumeTestJSON-828295401 None] Acquiring lock "cinder-6ebd7362-cfa2-4f6b-b11f-726ee8859067-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:24:33 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-6d46df4c-9049-42ac-8dbc-2bea9766be78 tempest-CreateVolumesFromSnapshotTest-1357788047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-8c539dc1-9533-452b-aecb-ca3c3f5e6fd9" returned: 0 in 1.062s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:33 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-6d46df4c-9049-42ac-8dbc-2bea9766be78 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-8c539dc1-9533-452b-aecb-ca3c3f5e6fd9.8e4eed04-1b27-4397-8c47-61906365cd18 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:33 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-c950ee84-c7f5-4070-aa49-49163b667b31 tempest-AttachVolumeTestJSON-828295401 None] Lock "cinder-6ebd7362-cfa2-4f6b-b11f-726ee8859067-delete_volume" acquired by "delete_volume" :: waited 0.306s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:24:33 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-d5e154b7-dc40-4576-8a6d-10715568d2f8 tempest-AttachVolumeTestJSON-828295401 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.768s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:33 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-d5e154b7-dc40-4576-8a6d-10715568d2f8 tempest-AttachVolumeTestJSON-828295401 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:24:33 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-194cf08d-5f74-4be4-873c-f1873089b0b4 tempest-VolumesExtendTest-1539744333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-41e3a3d4-4b8c-42c8-a26d-63cee372e88e" returned: 1 in 1.160s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:33 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-194cf08d-5f74-4be4-873c-f1873089b0b4 tempest-VolumesExtendTest-1539744333 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-41e3a3d4-4b8c-42c8-a26d-63cee372e88e' failed. Not Retrying. {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 21:24:33 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-194cf08d-5f74-4be4-873c-f1873089b0b4 tempest-VolumesExtendTest-1539744333 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-41e3a3d4-4b8c-42c8-a26d-63cee372e88e 2G {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:33 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-6d46df4c-9049-42ac-8dbc-2bea9766be78 tempest-CreateVolumesFromSnapshotTest-1357788047 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-8c539dc1-9533-452b-aecb-ca3c3f5e6fd9.8e4eed04-1b27-4397-8c47-61906365cd18" returned: 0 in 0.496s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:33 devstack quobyte-client[82807]: System call of process 94333 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:24:33 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-d5e154b7-dc40-4576-8a6d-10715568d2f8 tempest-AttachVolumeTestJSON-828295401 None] Deleted volume successfully. Sep 10 21:24:33 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-6d46df4c-9049-42ac-8dbc-2bea9766be78 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-8c539dc1-9533-452b-aecb-ca3c3f5e6fd9.8e4eed04-1b27-4397-8c47-61906365cd18 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:34 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-c950ee84-c7f5-4070-aa49-49163b667b31 tempest-AttachVolumeTestJSON-828295401 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:24:34 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-c950ee84-c7f5-4070-aa49-49163b667b31 tempest-AttachVolumeTestJSON-828295401 None] Acquiring lock "cinder-quobyte-6ebd7362-cfa2-4f6b-b11f-726ee8859067" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:24:34 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-6d46df4c-9049-42ac-8dbc-2bea9766be78 tempest-CreateVolumesFromSnapshotTest-1357788047 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-8c539dc1-9533-452b-aecb-ca3c3f5e6fd9.8e4eed04-1b27-4397-8c47-61906365cd18" returned: 0 in 0.411s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:34 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-6d46df4c-9049-42ac-8dbc-2bea9766be78 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Lock "cinder-quobyte-8e4eed04-1b27-4397-8c47-61906365cd18" released by "_delete_snapshot" :: held 3.649s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:24:34 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-d5e154b7-dc40-4576-8a6d-10715568d2f8 tempest-AttachVolumeTestJSON-828295401 None] Lock "cinder-26f9eac4-a7a7-444c-8eb9-0e9d16842a73-delete_volume" released by "delete_volume" :: held 5.851s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:24:34 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-194cf08d-5f74-4be4-873c-f1873089b0b4 tempest-VolumesExtendTest-1539744333 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-41e3a3d4-4b8c-42c8-a26d-63cee372e88e 2G" returned: 0 in 0.764s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:34 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-6d46df4c-9049-42ac-8dbc-2bea9766be78 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Lock "cinder-quobyte-8c539dc1-9533-452b-aecb-ca3c3f5e6fd9" released by "delete_snapshot" :: held 3.707s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:24:34 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-194cf08d-5f74-4be4-873c-f1873089b0b4 tempest-VolumesExtendTest-1539744333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 3.079s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:24:34 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-c950ee84-c7f5-4070-aa49-49163b667b31 tempest-AttachVolumeTestJSON-828295401 None] Lock "cinder-quobyte-6ebd7362-cfa2-4f6b-b11f-726ee8859067" acquired by "delete_volume" :: waited 0.170s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:24:34 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c130ac-62d5-43f6-b1ed-b6b356ee526e]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:24:34 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c950ee84-c7f5-4070-aa49-49163b667b31 tempest-AttachVolumeTestJSON-828295401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-6ebd7362-cfa2-4f6b-b11f-726ee8859067 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:34 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-194cf08d-5f74-4be4-873c-f1873089b0b4 tempest-VolumesExtendTest-1539744333 None] Extend volume completed successfully. Sep 10 21:24:34 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-6d46df4c-9049-42ac-8dbc-2bea9766be78 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Created reservations ['e572971a-97dd-4e2e-8263-fcf5288db03e', '3c7de26c-0102-42cd-a2c8-4c4e273f2ec4', '8b290463-3bc0-4615-82b2-e7432291ff57', '3791a71e-e4aa-4c40-9b7d-11b45cd1cf58'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:24:35 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c950ee84-c7f5-4070-aa49-49163b667b31 tempest-AttachVolumeTestJSON-828295401 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-6ebd7362-cfa2-4f6b-b11f-726ee8859067" returned: 0 in 0.565s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:35 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c950ee84-c7f5-4070-aa49-49163b667b31 tempest-AttachVolumeTestJSON-828295401 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-6ebd7362-cfa2-4f6b-b11f-726ee8859067 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:35 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c950ee84-c7f5-4070-aa49-49163b667b31 tempest-AttachVolumeTestJSON-828295401 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-6ebd7362-cfa2-4f6b-b11f-726ee8859067" returned: 0 in 0.312s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:35 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-c950ee84-c7f5-4070-aa49-49163b667b31 tempest-AttachVolumeTestJSON-828295401 None] Lock "cinder-quobyte-6ebd7362-cfa2-4f6b-b11f-726ee8859067" released by "delete_volume" :: held 1.071s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:24:35 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-c170f7d0-69fc-4045-8d21-ce5ab15816a3 tempest-VolumesExtendTest-1539744333 None] Acquiring lock "cinder-41e3a3d4-4b8c-42c8-a26d-63cee372e88e-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:24:35 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-6d46df4c-9049-42ac-8dbc-2bea9766be78 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Delete snapshot completed successfully. Sep 10 21:24:35 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-6d46df4c-9049-42ac-8dbc-2bea9766be78 tempest-CreateVolumesFromSnapshotTest-1357788047 None] Lock "cinder-8e4eed04-1b27-4397-8c47-61906365cd18-delete_snapshot" released by "delete_snapshot" :: held 5.228s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:24:35 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-c170f7d0-69fc-4045-8d21-ce5ab15816a3 tempest-VolumesExtendTest-1539744333 None] Lock "cinder-41e3a3d4-4b8c-42c8-a26d-63cee372e88e-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:24:35 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-50e9e049-a9e3-47dc-bde8-82e997ea1a8e tempest-CreateVolumesFromSnapshotTest-1357788047 None] Acquiring lock "cinder-8c539dc1-9533-452b-aecb-ca3c3f5e6fd9-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:24:35 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-c950ee84-c7f5-4070-aa49-49163b667b31 tempest-AttachVolumeTestJSON-828295401 None] Created reservations ['93f4361b-db78-4956-a077-932fb5cca5e7', '1e72bed5-4ead-4baf-8ac0-6f850f8fbe50', 'a76dea0c-487f-47d2-93f7-4a38636aa2cd', 'b6f48da5-ea3e-4c85-84ab-bebda47ae0b1'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:24:35 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-50e9e049-a9e3-47dc-bde8-82e997ea1a8e tempest-CreateVolumesFromSnapshotTest-1357788047 None] Lock "cinder-8c539dc1-9533-452b-aecb-ca3c3f5e6fd9-delete_volume" acquired by "delete_volume" :: waited 0.103s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:24:35 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-c170f7d0-69fc-4045-8d21-ce5ab15816a3 tempest-VolumesExtendTest-1539744333 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:24:35 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-c170f7d0-69fc-4045-8d21-ce5ab15816a3 tempest-VolumesExtendTest-1539744333 None] Acquiring lock "cinder-quobyte-41e3a3d4-4b8c-42c8-a26d-63cee372e88e" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:24:36 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-50e9e049-a9e3-47dc-bde8-82e997ea1a8e tempest-CreateVolumesFromSnapshotTest-1357788047 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:24:36 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-50e9e049-a9e3-47dc-bde8-82e997ea1a8e tempest-CreateVolumesFromSnapshotTest-1357788047 None] Acquiring lock "cinder-quobyte-8c539dc1-9533-452b-aecb-ca3c3f5e6fd9" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:24:36 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-c170f7d0-69fc-4045-8d21-ce5ab15816a3 tempest-VolumesExtendTest-1539744333 None] Lock "cinder-quobyte-41e3a3d4-4b8c-42c8-a26d-63cee372e88e" acquired by "delete_volume" :: waited 0.048s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:24:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-c950ee84-c7f5-4070-aa49-49163b667b31 tempest-AttachVolumeTestJSON-828295401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:24:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-c950ee84-c7f5-4070-aa49-49163b667b31 tempest-AttachVolumeTestJSON-828295401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:24:36 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-c950ee84-c7f5-4070-aa49-49163b667b31 tempest-AttachVolumeTestJSON-828295401 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:24:36 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-c950ee84-c7f5-4070-aa49-49163b667b31 tempest-AttachVolumeTestJSON-828295401 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:24:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-c950ee84-c7f5-4070-aa49-49163b667b31 tempest-AttachVolumeTestJSON-828295401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:24:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c950ee84-c7f5-4070-aa49-49163b667b31 tempest-AttachVolumeTestJSON-828295401 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:36 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b509df2b-9a68-474c-9150-9908f094beaf]: (4, 'raw') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:24:36 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-50e9e049-a9e3-47dc-bde8-82e997ea1a8e tempest-CreateVolumesFromSnapshotTest-1357788047 None] Lock "cinder-quobyte-8c539dc1-9533-452b-aecb-ca3c3f5e6fd9" acquired by "delete_volume" :: waited 0.248s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:24:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c170f7d0-69fc-4045-8d21-ce5ab15816a3 tempest-VolumesExtendTest-1539744333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-41e3a3d4-4b8c-42c8-a26d-63cee372e88e {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:36 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e3ccc39-0b57-4ff5-9e0a-8277edb31180]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:24:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-50e9e049-a9e3-47dc-bde8-82e997ea1a8e tempest-CreateVolumesFromSnapshotTest-1357788047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-8c539dc1-9533-452b-aecb-ca3c3f5e6fd9 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:36 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-9efbee64-14e5-45f8-aeed-c57aca328a52 tempest-AttachVolumeTestJSON-828295401 None] Acquiring lock "cinder-073cd789-3c6c-4b05-840c-ba0fd5a97c64-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:24:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c950ee84-c7f5-4070-aa49-49163b667b31 tempest-AttachVolumeTestJSON-828295401 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.888s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:36 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-c950ee84-c7f5-4070-aa49-49163b667b31 tempest-AttachVolumeTestJSON-828295401 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:24:36 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-9efbee64-14e5-45f8-aeed-c57aca328a52 tempest-AttachVolumeTestJSON-828295401 None] Lock "cinder-073cd789-3c6c-4b05-840c-ba0fd5a97c64-delete_volume" acquired by "delete_volume" :: waited 0.225s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:24:37 devstack quobyte-client[82807]: System call of process 94343 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:24:37 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-c950ee84-c7f5-4070-aa49-49163b667b31 tempest-AttachVolumeTestJSON-828295401 None] Deleted volume successfully. Sep 10 21:24:37 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c170f7d0-69fc-4045-8d21-ce5ab15816a3 tempest-VolumesExtendTest-1539744333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-41e3a3d4-4b8c-42c8-a26d-63cee372e88e" returned: 0 in 0.931s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:37 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c170f7d0-69fc-4045-8d21-ce5ab15816a3 tempest-VolumesExtendTest-1539744333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-41e3a3d4-4b8c-42c8-a26d-63cee372e88e {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:38 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-9efbee64-14e5-45f8-aeed-c57aca328a52 tempest-AttachVolumeTestJSON-828295401 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:24:38 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-9efbee64-14e5-45f8-aeed-c57aca328a52 tempest-AttachVolumeTestJSON-828295401 None] Acquiring lock "cinder-quobyte-073cd789-3c6c-4b05-840c-ba0fd5a97c64" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:24:38 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-50e9e049-a9e3-47dc-bde8-82e997ea1a8e tempest-CreateVolumesFromSnapshotTest-1357788047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-8c539dc1-9533-452b-aecb-ca3c3f5e6fd9" returned: 0 in 1.599s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:38 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-c950ee84-c7f5-4070-aa49-49163b667b31 tempest-AttachVolumeTestJSON-828295401 None] Lock "cinder-6ebd7362-cfa2-4f6b-b11f-726ee8859067-delete_volume" released by "delete_volume" :: held 4.824s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:24:38 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-50e9e049-a9e3-47dc-bde8-82e997ea1a8e tempest-CreateVolumesFromSnapshotTest-1357788047 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-8c539dc1-9533-452b-aecb-ca3c3f5e6fd9 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:38 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-9efbee64-14e5-45f8-aeed-c57aca328a52 tempest-AttachVolumeTestJSON-828295401 None] Lock "cinder-quobyte-073cd789-3c6c-4b05-840c-ba0fd5a97c64" acquired by "delete_volume" :: waited 0.353s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:24:38 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c170f7d0-69fc-4045-8d21-ce5ab15816a3 tempest-VolumesExtendTest-1539744333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-41e3a3d4-4b8c-42c8-a26d-63cee372e88e" returned: 1 in 1.202s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:38 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c170f7d0-69fc-4045-8d21-ce5ab15816a3 tempest-VolumesExtendTest-1539744333 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-41e3a3d4-4b8c-42c8-a26d-63cee372e88e' failed. Not Retrying. {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 21:24:38 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-50e9e049-a9e3-47dc-bde8-82e997ea1a8e tempest-CreateVolumesFromSnapshotTest-1357788047 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-8c539dc1-9533-452b-aecb-ca3c3f5e6fd9" returned: 0 in 0.324s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:38 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c170f7d0-69fc-4045-8d21-ce5ab15816a3 tempest-VolumesExtendTest-1539744333 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-41e3a3d4-4b8c-42c8-a26d-63cee372e88e {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:38 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6fb1047-9323-4bec-99e6-644a1852c5b0]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:24:38 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9efbee64-14e5-45f8-aeed-c57aca328a52 tempest-AttachVolumeTestJSON-828295401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-073cd789-3c6c-4b05-840c-ba0fd5a97c64 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:38 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-50e9e049-a9e3-47dc-bde8-82e997ea1a8e tempest-CreateVolumesFromSnapshotTest-1357788047 None] Lock "cinder-quobyte-8c539dc1-9533-452b-aecb-ca3c3f5e6fd9" released by "delete_volume" :: held 2.562s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:24:39 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c170f7d0-69fc-4045-8d21-ce5ab15816a3 tempest-VolumesExtendTest-1539744333 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-41e3a3d4-4b8c-42c8-a26d-63cee372e88e" returned: 0 in 0.549s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:39 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-c170f7d0-69fc-4045-8d21-ce5ab15816a3 tempest-VolumesExtendTest-1539744333 None] Lock "cinder-quobyte-41e3a3d4-4b8c-42c8-a26d-63cee372e88e" released by "delete_volume" :: held 3.094s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:24:39 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-50e9e049-a9e3-47dc-bde8-82e997ea1a8e tempest-CreateVolumesFromSnapshotTest-1357788047 None] Created reservations ['97c9a2b2-f5df-4e8a-bc4a-aa809f691089', '793fc613-82d7-4153-a1bc-7398848ef61e', 'e82b60d3-a4e1-46a1-95b2-cb4606ea4923', '11955e36-f944-4711-b7c8-3d0dad523ba5'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:24:39 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-c170f7d0-69fc-4045-8d21-ce5ab15816a3 tempest-VolumesExtendTest-1539744333 None] Created reservations ['adc24f9e-7c52-483f-96d1-fb334847a804', '95cc4519-51e4-45ca-8a8e-00eb9fabfa3a', 'f5b962f2-3ba6-4408-aa36-1975aaca89b8', '14b50eac-afe7-41d0-a626-3c5fc8c89153'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:24:39 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9efbee64-14e5-45f8-aeed-c57aca328a52 tempest-AttachVolumeTestJSON-828295401 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-073cd789-3c6c-4b05-840c-ba0fd5a97c64" returned: 0 in 0.646s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:39 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9efbee64-14e5-45f8-aeed-c57aca328a52 tempest-AttachVolumeTestJSON-828295401 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-073cd789-3c6c-4b05-840c-ba0fd5a97c64 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:39 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-c170f7d0-69fc-4045-8d21-ce5ab15816a3 tempest-VolumesExtendTest-1539744333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:24:39 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-c170f7d0-69fc-4045-8d21-ce5ab15816a3 tempest-VolumesExtendTest-1539744333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.019s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:24:39 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-c170f7d0-69fc-4045-8d21-ce5ab15816a3 tempest-VolumesExtendTest-1539744333 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:24:39 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-c170f7d0-69fc-4045-8d21-ce5ab15816a3 tempest-VolumesExtendTest-1539744333 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:24:39 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-c170f7d0-69fc-4045-8d21-ce5ab15816a3 tempest-VolumesExtendTest-1539744333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:24:39 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c170f7d0-69fc-4045-8d21-ce5ab15816a3 tempest-VolumesExtendTest-1539744333 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:39 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-50e9e049-a9e3-47dc-bde8-82e997ea1a8e tempest-CreateVolumesFromSnapshotTest-1357788047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:24:39 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-50e9e049-a9e3-47dc-bde8-82e997ea1a8e tempest-CreateVolumesFromSnapshotTest-1357788047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.029s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:24:39 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-50e9e049-a9e3-47dc-bde8-82e997ea1a8e tempest-CreateVolumesFromSnapshotTest-1357788047 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:24:39 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-50e9e049-a9e3-47dc-bde8-82e997ea1a8e tempest-CreateVolumesFromSnapshotTest-1357788047 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:24:39 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-50e9e049-a9e3-47dc-bde8-82e997ea1a8e tempest-CreateVolumesFromSnapshotTest-1357788047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:24:39 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-50e9e049-a9e3-47dc-bde8-82e997ea1a8e tempest-CreateVolumesFromSnapshotTest-1357788047 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:40 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9efbee64-14e5-45f8-aeed-c57aca328a52 tempest-AttachVolumeTestJSON-828295401 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-073cd789-3c6c-4b05-840c-ba0fd5a97c64" returned: 0 in 0.677s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:40 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-9efbee64-14e5-45f8-aeed-c57aca328a52 tempest-AttachVolumeTestJSON-828295401 None] Lock "cinder-quobyte-073cd789-3c6c-4b05-840c-ba0fd5a97c64" released by "delete_volume" :: held 1.803s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:24:40 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c170f7d0-69fc-4045-8d21-ce5ab15816a3 tempest-VolumesExtendTest-1539744333 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.726s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:40 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-c170f7d0-69fc-4045-8d21-ce5ab15816a3 tempest-VolumesExtendTest-1539744333 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:24:40 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-c170f7d0-69fc-4045-8d21-ce5ab15816a3 tempest-VolumesExtendTest-1539744333 None] Deleted volume successfully. Sep 10 21:24:40 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-50e9e049-a9e3-47dc-bde8-82e997ea1a8e tempest-CreateVolumesFromSnapshotTest-1357788047 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.706s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:40 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-50e9e049-a9e3-47dc-bde8-82e997ea1a8e tempest-CreateVolumesFromSnapshotTest-1357788047 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:24:40 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-50e9e049-a9e3-47dc-bde8-82e997ea1a8e tempest-CreateVolumesFromSnapshotTest-1357788047 None] Deleted volume successfully. Sep 10 21:24:40 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-50e9e049-a9e3-47dc-bde8-82e997ea1a8e tempest-CreateVolumesFromSnapshotTest-1357788047 None] Lock "cinder-8c539dc1-9533-452b-aecb-ca3c3f5e6fd9-delete_volume" released by "delete_volume" :: held 4.893s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:24:40 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-c170f7d0-69fc-4045-8d21-ce5ab15816a3 tempest-VolumesExtendTest-1539744333 None] Lock "cinder-41e3a3d4-4b8c-42c8-a26d-63cee372e88e-delete_volume" released by "delete_volume" :: held 5.050s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:24:40 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-9efbee64-14e5-45f8-aeed-c57aca328a52 tempest-AttachVolumeTestJSON-828295401 None] Created reservations ['cbf21161-a2ec-4ec4-ac64-b65f6ebd8664', '88f2fe1a-cf09-4899-b1da-df32de393a3a', 'd9a0b785-02ac-477f-b50b-b9099a89819f', '4649d728-e0e3-409f-88bc-472f6c33a7af'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:24:41 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-9efbee64-14e5-45f8-aeed-c57aca328a52 tempest-AttachVolumeTestJSON-828295401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:24:41 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-9efbee64-14e5-45f8-aeed-c57aca328a52 tempest-AttachVolumeTestJSON-828295401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:24:41 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-9efbee64-14e5-45f8-aeed-c57aca328a52 tempest-AttachVolumeTestJSON-828295401 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:24:41 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-9efbee64-14e5-45f8-aeed-c57aca328a52 tempest-AttachVolumeTestJSON-828295401 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:24:41 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-9efbee64-14e5-45f8-aeed-c57aca328a52 tempest-AttachVolumeTestJSON-828295401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:24:41 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9efbee64-14e5-45f8-aeed-c57aca328a52 tempest-AttachVolumeTestJSON-828295401 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:41 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9efbee64-14e5-45f8-aeed-c57aca328a52 tempest-AttachVolumeTestJSON-828295401 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.218s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:41 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-9efbee64-14e5-45f8-aeed-c57aca328a52 tempest-AttachVolumeTestJSON-828295401 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:24:41 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-9efbee64-14e5-45f8-aeed-c57aca328a52 tempest-AttachVolumeTestJSON-828295401 None] Deleted volume successfully. Sep 10 21:24:41 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-9efbee64-14e5-45f8-aeed-c57aca328a52 tempest-AttachVolumeTestJSON-828295401 None] Lock "cinder-073cd789-3c6c-4b05-840c-ba0fd5a97c64-delete_volume" released by "delete_volume" :: held 4.812s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:24:41 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-ce8299d5-416c-4e9b-9e8b-bb46dd91c44c tempest-VolumesExtendTest-1539744333 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:24:41 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce8299d5-416c-4e9b-9e8b-bb46dd91c44c tempest-VolumesExtendTest-1539744333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:24:41 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ce8299d5-416c-4e9b-9e8b-bb46dd91c44c tempest-VolumesExtendTest-1539744333 None] Flow 'volume_create_manager' (4bd4805b-62f6-4904-8741-8425c812b8f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:24:41 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ce8299d5-416c-4e9b-9e8b-bb46dd91c44c tempest-VolumesExtendTest-1539744333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c088fc12-e9be-45b0-ae2c-2e43458521e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:24:42 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ce8299d5-416c-4e9b-9e8b-bb46dd91c44c tempest-VolumesExtendTest-1539744333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c088fc12-e9be-45b0-ae2c-2e43458521e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:24:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-136946279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a35bfddd-36b4-46da-a9ff-ea6f67d73882,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a401cf5fa244e92a22d0b035c6a2949',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:24:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:24:41Z,use_quota=True,user_id='ca6664665d3a4625959836bb3befbe2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:24:42 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ce8299d5-416c-4e9b-9e8b-bb46dd91c44c tempest-VolumesExtendTest-1539744333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0232001d-e3fc-4c6c-ba27-37a816fb687c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:24:42 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ce8299d5-416c-4e9b-9e8b-bb46dd91c44c tempest-VolumesExtendTest-1539744333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0232001d-e3fc-4c6c-ba27-37a816fb687c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:24:42 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ce8299d5-416c-4e9b-9e8b-bb46dd91c44c tempest-VolumesExtendTest-1539744333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (524cb086-fc95-4045-b440-c36ddc87e738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:24:42 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ce8299d5-416c-4e9b-9e8b-bb46dd91c44c tempest-VolumesExtendTest-1539744333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (524cb086-fc95-4045-b440-c36ddc87e738) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a35bfddd-36b4-46da-a9ff-ea6f67d73882', 'volume_name': 'volume-a35bfddd-36b4-46da-a9ff-ea6f67d73882', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:24:42 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ce8299d5-416c-4e9b-9e8b-bb46dd91c44c tempest-VolumesExtendTest-1539744333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78713818-e2e0-45d0-9188-947b3cb157b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:24:42 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ce8299d5-416c-4e9b-9e8b-bb46dd91c44c tempest-VolumesExtendTest-1539744333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78713818-e2e0-45d0-9188-947b3cb157b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:24:42 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ce8299d5-416c-4e9b-9e8b-bb46dd91c44c tempest-VolumesExtendTest-1539744333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c2dfeed-f9be-4d74-971b-1b73c363566c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:24:42 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-ce8299d5-416c-4e9b-9e8b-bb46dd91c44c tempest-VolumesExtendTest-1539744333 None] Volume a35bfddd-36b4-46da-a9ff-ea6f67d73882: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a35bfddd-36b4-46da-a9ff-ea6f67d73882', 'volume_size': 1} Sep 10 21:24:42 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-ce8299d5-416c-4e9b-9e8b-bb46dd91c44c tempest-VolumesExtendTest-1539744333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:24:42 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-ce8299d5-416c-4e9b-9e8b-bb46dd91c44c tempest-VolumesExtendTest-1539744333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:24:42 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-ce8299d5-416c-4e9b-9e8b-bb46dd91c44c tempest-VolumesExtendTest-1539744333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:24:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-136946279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a35bfddd-36b4-46da-a9ff-ea6f67d73882,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a401cf5fa244e92a22d0b035c6a2949',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:24:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:24:41Z,use_quota=True,user_id='ca6664665d3a4625959836bb3befbe2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:24:42 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-ce8299d5-416c-4e9b-9e8b-bb46dd91c44c tempest-VolumesExtendTest-1539744333 None] Creating volume a35bfddd-36b4-46da-a9ff-ea6f67d73882 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:24:42 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-ce8299d5-416c-4e9b-9e8b-bb46dd91c44c tempest-VolumesExtendTest-1539744333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:24:42 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-ce8299d5-416c-4e9b-9e8b-bb46dd91c44c tempest-VolumesExtendTest-1539744333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:24:42 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-ce8299d5-416c-4e9b-9e8b-bb46dd91c44c tempest-VolumesExtendTest-1539744333 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:24:42 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-ce8299d5-416c-4e9b-9e8b-bb46dd91c44c tempest-VolumesExtendTest-1539744333 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:24:42 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-ce8299d5-416c-4e9b-9e8b-bb46dd91c44c tempest-VolumesExtendTest-1539744333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:24:42 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-ce8299d5-416c-4e9b-9e8b-bb46dd91c44c tempest-VolumesExtendTest-1539744333 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:24:42 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-ce8299d5-416c-4e9b-9e8b-bb46dd91c44c tempest-VolumesExtendTest-1539744333 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:24:42 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ce8299d5-416c-4e9b-9e8b-bb46dd91c44c tempest-VolumesExtendTest-1539744333 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a35bfddd-36b4-46da-a9ff-ea6f67d73882 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:42 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=76, name=volume-a35bfddd-36b4-46da-a9ff-ea6f67d73882, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:24:42 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ce8299d5-416c-4e9b-9e8b-bb46dd91c44c tempest-VolumesExtendTest-1539744333 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a35bfddd-36b4-46da-a9ff-ea6f67d73882 1073741824" returned: 0 in 0.539s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:42 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ce8299d5-416c-4e9b-9e8b-bb46dd91c44c tempest-VolumesExtendTest-1539744333 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a35bfddd-36b4-46da-a9ff-ea6f67d73882 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:42 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ce8299d5-416c-4e9b-9e8b-bb46dd91c44c tempest-VolumesExtendTest-1539744333 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a35bfddd-36b4-46da-a9ff-ea6f67d73882" returned: 0 in 0.173s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:42 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-ce8299d5-416c-4e9b-9e8b-bb46dd91c44c tempest-VolumesExtendTest-1539744333 None] <== create_volume: return (844ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:24:42 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-ce8299d5-416c-4e9b-9e8b-bb46dd91c44c tempest-VolumesExtendTest-1539744333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:24:43 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ce8299d5-416c-4e9b-9e8b-bb46dd91c44c tempest-VolumesExtendTest-1539744333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c2dfeed-f9be-4d74-971b-1b73c363566c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a35bfddd-36b4-46da-a9ff-ea6f67d73882', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:24:43 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ce8299d5-416c-4e9b-9e8b-bb46dd91c44c tempest-VolumesExtendTest-1539744333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a060abd5-4e70-4c4e-82a5-3517f5390735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:24:43 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-ce8299d5-416c-4e9b-9e8b-bb46dd91c44c tempest-VolumesExtendTest-1539744333 None] Volume volume-a35bfddd-36b4-46da-a9ff-ea6f67d73882 (a35bfddd-36b4-46da-a9ff-ea6f67d73882): created successfully Sep 10 21:24:43 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ce8299d5-416c-4e9b-9e8b-bb46dd91c44c tempest-VolumesExtendTest-1539744333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a060abd5-4e70-4c4e-82a5-3517f5390735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:24:43 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ce8299d5-416c-4e9b-9e8b-bb46dd91c44c tempest-VolumesExtendTest-1539744333 None] Flow 'volume_create_manager' (4bd4805b-62f6-4904-8741-8425c812b8f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:24:43 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-ce8299d5-416c-4e9b-9e8b-bb46dd91c44c tempest-VolumesExtendTest-1539744333 None] Created volume successfully. Sep 10 21:24:45 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-1adaa7eb-4d04-429d-82d1-70cf0ac14622 tempest-VolumesExtendTest-1539744333 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:24:45 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-1adaa7eb-4d04-429d-82d1-70cf0ac14622 tempest-VolumesExtendTest-1539744333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:24:45 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-1adaa7eb-4d04-429d-82d1-70cf0ac14622 tempest-VolumesExtendTest-1539744333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:24:45 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-1adaa7eb-4d04-429d-82d1-70cf0ac14622 tempest-VolumesExtendTest-1539744333 None] Creating offline snapshot e571b69d-603c-4ba3-b051-b9dcc6f69764 of volume a35bfddd-36b4-46da-a9ff-ea6f67d73882 {{(pid=82780) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 21:24:45 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d365788d-1d5f-47f7-a83b-5adf4936e099]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:24:45 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1adaa7eb-4d04-429d-82d1-70cf0ac14622 tempest-VolumesExtendTest-1539744333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a35bfddd-36b4-46da-a9ff-ea6f67d73882 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:46 devstack quobyte-client[82807]: System call of process 94400 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:24:46 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1adaa7eb-4d04-429d-82d1-70cf0ac14622 tempest-VolumesExtendTest-1539744333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a35bfddd-36b4-46da-a9ff-ea6f67d73882" returned: 0 in 0.855s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:46 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1adaa7eb-4d04-429d-82d1-70cf0ac14622 tempest-VolumesExtendTest-1539744333 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a35bfddd-36b4-46da-a9ff-ea6f67d73882,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a35bfddd-36b4-46da-a9ff-ea6f67d73882.e571b69d-603c-4ba3-b051-b9dcc6f69764 1G {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:46 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=77, name=volume-a35bfddd-36b4-46da-a9ff-ea6f67d73882.e571b69d-603c-4ba3-b051-b9dcc6f69764, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:24:47 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1adaa7eb-4d04-429d-82d1-70cf0ac14622 tempest-VolumesExtendTest-1539744333 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a35bfddd-36b4-46da-a9ff-ea6f67d73882,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a35bfddd-36b4-46da-a9ff-ea6f67d73882.e571b69d-603c-4ba3-b051-b9dcc6f69764 1G" returned: 0 in 0.415s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:47 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1adaa7eb-4d04-429d-82d1-70cf0ac14622 tempest-VolumesExtendTest-1539744333 None] Running cmd (subprocess): qemu-img rebase -u -b volume-a35bfddd-36b4-46da-a9ff-ea6f67d73882 -F qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a35bfddd-36b4-46da-a9ff-ea6f67d73882.e571b69d-603c-4ba3-b051-b9dcc6f69764 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:47 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1adaa7eb-4d04-429d-82d1-70cf0ac14622 tempest-VolumesExtendTest-1539744333 None] CMD "qemu-img rebase -u -b volume-a35bfddd-36b4-46da-a9ff-ea6f67d73882 -F qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a35bfddd-36b4-46da-a9ff-ea6f67d73882.e571b69d-603c-4ba3-b051-b9dcc6f69764" returned: 0 in 0.220s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:47 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-1adaa7eb-4d04-429d-82d1-70cf0ac14622 tempest-VolumesExtendTest-1539744333 None] File path /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a35bfddd-36b4-46da-a9ff-ea6f67d73882.e571b69d-603c-4ba3-b051-b9dcc6f69764 is being set with permissions: 660 {{(pid=82780) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 21:24:47 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1adaa7eb-4d04-429d-82d1-70cf0ac14622 tempest-VolumesExtendTest-1539744333 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a35bfddd-36b4-46da-a9ff-ea6f67d73882.e571b69d-603c-4ba3-b051-b9dcc6f69764 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:47 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1adaa7eb-4d04-429d-82d1-70cf0ac14622 tempest-VolumesExtendTest-1539744333 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a35bfddd-36b4-46da-a9ff-ea6f67d73882.e571b69d-603c-4ba3-b051-b9dcc6f69764" returned: 0 in 0.179s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:47 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-1adaa7eb-4d04-429d-82d1-70cf0ac14622 tempest-VolumesExtendTest-1539744333 None] Setting permissions: /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a35bfddd-36b4-46da-a9ff-ea6f67d73882 -> 1000:1000 {{(pid=82780) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 21:24:47 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1adaa7eb-4d04-429d-82d1-70cf0ac14622 tempest-VolumesExtendTest-1539744333 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a35bfddd-36b4-46da-a9ff-ea6f67d73882 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a35bfddd-36b4-46da-a9ff-ea6f67d73882.e571b69d-603c-4ba3-b051-b9dcc6f69764 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:47 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1adaa7eb-4d04-429d-82d1-70cf0ac14622 tempest-VolumesExtendTest-1539744333 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a35bfddd-36b4-46da-a9ff-ea6f67d73882 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a35bfddd-36b4-46da-a9ff-ea6f67d73882.e571b69d-603c-4ba3-b051-b9dcc6f69764" returned: 0 in 0.144s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:47 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1adaa7eb-4d04-429d-82d1-70cf0ac14622 tempest-VolumesExtendTest-1539744333 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a35bfddd-36b4-46da-a9ff-ea6f67d73882.info {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:48 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1adaa7eb-4d04-429d-82d1-70cf0ac14622 tempest-VolumesExtendTest-1539744333 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a35bfddd-36b4-46da-a9ff-ea6f67d73882.info" returned: 0 in 0.166s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:48 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-1adaa7eb-4d04-429d-82d1-70cf0ac14622 tempest-VolumesExtendTest-1539744333 None] File path /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a35bfddd-36b4-46da-a9ff-ea6f67d73882.info is being set with permissions: 660 {{(pid=82780) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 21:24:48 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1adaa7eb-4d04-429d-82d1-70cf0ac14622 tempest-VolumesExtendTest-1539744333 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a35bfddd-36b4-46da-a9ff-ea6f67d73882.info {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:48 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1adaa7eb-4d04-429d-82d1-70cf0ac14622 tempest-VolumesExtendTest-1539744333 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a35bfddd-36b4-46da-a9ff-ea6f67d73882.info" returned: 0 in 0.165s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:48 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-1adaa7eb-4d04-429d-82d1-70cf0ac14622 tempest-VolumesExtendTest-1539744333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.010s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:24:49 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-1adaa7eb-4d04-429d-82d1-70cf0ac14622 tempest-VolumesExtendTest-1539744333 None] Create snapshot completed successfully Sep 10 21:24:50 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-3ea8be15-03b6-4537-b322-e3d0433629e5 tempest-VolumesExtendTest-1539744333 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:24:50 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-3ea8be15-03b6-4537-b322-e3d0433629e5 tempest-VolumesExtendTest-1539744333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:24:50 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-3ea8be15-03b6-4537-b322-e3d0433629e5 tempest-VolumesExtendTest-1539744333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.006s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:24:50 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b974e9a-a7d5-4932-92bf-18875efd0a39]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:24:50 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-3ea8be15-03b6-4537-b322-e3d0433629e5 tempest-VolumesExtendTest-1539744333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a35bfddd-36b4-46da-a9ff-ea6f67d73882 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:51 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-3ea8be15-03b6-4537-b322-e3d0433629e5 tempest-VolumesExtendTest-1539744333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a35bfddd-36b4-46da-a9ff-ea6f67d73882" returned: 0 in 0.890s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:51 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-3ea8be15-03b6-4537-b322-e3d0433629e5 tempest-VolumesExtendTest-1539744333 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a35bfddd-36b4-46da-a9ff-ea6f67d73882.e571b69d-603c-4ba3-b051-b9dcc6f69764 2G {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:51 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:24:51 devstack quobyte-client[82807]: System call of process 94418 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:24:51 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:24:51 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] Flow 'volume_create_manager' (b9b2b9e4-6a17-4906-8f22-67767d242ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:24:51 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd7d9a71-4bd8-45fb-b839-245efaa6f7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:24:51 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-3ea8be15-03b6-4537-b322-e3d0433629e5 tempest-VolumesExtendTest-1539744333 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a35bfddd-36b4-46da-a9ff-ea6f67d73882.e571b69d-603c-4ba3-b051-b9dcc6f69764 2G" returned: 0 in 0.741s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:51 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd7d9a71-4bd8-45fb-b839-245efaa6f7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:24:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb8c69ab-8d9e-4a90-a282-87cf724b5859,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4de40f52691d49b5acb808939ca89010',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:24:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:24:50Z,use_quota=True,user_id='e30009f78428464e847329e9a818b9b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:24:51 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75015225-86e6-4af8-b1b1-fe7fa2fa1141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:24:51 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75015225-86e6-4af8-b1b1-fe7fa2fa1141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:24:51 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cf16e62-ea59-4edb-b4fc-2a8a5c90ac5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:24:51 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-3ea8be15-03b6-4537-b322-e3d0433629e5 tempest-VolumesExtendTest-1539744333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.904s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:24:52 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-3ea8be15-03b6-4537-b322-e3d0433629e5 tempest-VolumesExtendTest-1539744333 None] Extend volume completed successfully. Sep 10 21:24:52 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cf16e62-ea59-4edb-b4fc-2a8a5c90ac5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cb8c69ab-8d9e-4a90-a282-87cf724b5859', 'volume_name': 'volume-cb8c69ab-8d9e-4a90-a282-87cf724b5859', 'volume_size': 1, 'image_id': '2ce64c1a-2e55-4411-b145-23fefa40cc1d', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'da59cba8a41939eb084eb643cd9eb8f4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4de40f52691d49b5acb808939ca89010', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bcbc3c9d3492cbcd6e1a95d3aeb6b5f710ab0343dc16f6317949db974dec3f5560d4960f5dd2e4432df07d564af704ed37b685bfb23406a5f407fecaf56ada23', 'id': '2ce64c1a-2e55-4411-b145-23fefa40cc1d', 'created_at': datetime.datetime(2025, 9, 10, 19, 24, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 19, 24, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2ce64c1a-2e55-4411-b145-23fefa40cc1d/file', 'properties': {}}, 'image_service': }' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:24:52 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37bb5012-3785-447c-96e6-334d2dbc35da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:24:52 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37bb5012-3785-447c-96e6-334d2dbc35da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:24:52 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e7ee092-ff93-4ef6-85e1-50ff8afcda5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:24:52 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] Volume cb8c69ab-8d9e-4a90-a282-87cf724b5859: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cb8c69ab-8d9e-4a90-a282-87cf724b5859', 'volume_size': 1, 'image_id': '2ce64c1a-2e55-4411-b145-23fefa40cc1d', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'da59cba8a41939eb084eb643cd9eb8f4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4de40f52691d49b5acb808939ca89010', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bcbc3c9d3492cbcd6e1a95d3aeb6b5f710ab0343dc16f6317949db974dec3f5560d4960f5dd2e4432df07d564af704ed37b685bfb23406a5f407fecaf56ada23', 'id': '2ce64c1a-2e55-4411-b145-23fefa40cc1d', 'created_at': datetime.datetime(2025, 9, 10, 19, 24, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 19, 24, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2ce64c1a-2e55-4411-b145-23fefa40cc1d/file', 'properties': {}}, 'image_service': } Sep 10 21:24:52 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] Cloning cb8c69ab-8d9e-4a90-a282-87cf724b5859 from image 2ce64c1a-2e55-4411-b145-23fefa40cc1d at location (None, None). {{(pid=82780) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1083}} Sep 10 21:24:52 devstack cinder-volume[82780]: DEBUG cinder.image.image_utils [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2ce64c1a-2e55-4411-b145-23fefa40cc1d_jk0p_5bidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=82780) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 10 21:24:52 devstack cinder-volume[82780]: INFO cinder.image.image_utils [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] Image download 0.00 MB at 0.00 MB/s Sep 10 21:24:52 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-d808c3da-3830-43af-a0f9-0055863b3f41 tempest-VolumesExtendTest-1539744333 None] Acquiring lock "cinder-e571b69d-603c-4ba3-b051-b9dcc6f69764-delete_snapshot" by "delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:24:52 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[665f4c8c-9730-4388-b82d-fd9f7401ce74]: (4, 'raw') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:24:52 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ce64c1a-2e55-4411-b145-23fefa40cc1d_jk0p_5bidevstack@QuobyteHD {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:53 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-d808c3da-3830-43af-a0f9-0055863b3f41 tempest-VolumesExtendTest-1539744333 None] Lock "cinder-e571b69d-603c-4ba3-b051-b9dcc6f69764-delete_snapshot" acquired by "delete_snapshot" :: waited 0.235s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:24:53 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-d808c3da-3830-43af-a0f9-0055863b3f41 tempest-VolumesExtendTest-1539744333 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:24:53 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-d808c3da-3830-43af-a0f9-0055863b3f41 tempest-VolumesExtendTest-1539744333 None] Acquiring lock "cinder-quobyte-a35bfddd-36b4-46da-a9ff-ea6f67d73882" by "delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:24:53 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-d808c3da-3830-43af-a0f9-0055863b3f41 tempest-VolumesExtendTest-1539744333 None] Lock "cinder-quobyte-a35bfddd-36b4-46da-a9ff-ea6f67d73882" acquired by "delete_snapshot" :: waited 0.089s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:24:53 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-d808c3da-3830-43af-a0f9-0055863b3f41 tempest-VolumesExtendTest-1539744333 None] Acquiring lock "cinder-quobyte-e571b69d-603c-4ba3-b051-b9dcc6f69764" by "_delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:24:53 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-d808c3da-3830-43af-a0f9-0055863b3f41 tempest-VolumesExtendTest-1539744333 None] Lock "cinder-quobyte-e571b69d-603c-4ba3-b051-b9dcc6f69764" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:24:53 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-d808c3da-3830-43af-a0f9-0055863b3f41 tempest-VolumesExtendTest-1539744333 None] Deleting offline snapshot e571b69d-603c-4ba3-b051-b9dcc6f69764 of volume a35bfddd-36b4-46da-a9ff-ea6f67d73882 {{(pid=82780) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 21:24:53 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-d808c3da-3830-43af-a0f9-0055863b3f41 tempest-VolumesExtendTest-1539744333 None] snapshot_file for this snap is: volume-a35bfddd-36b4-46da-a9ff-ea6f67d73882.e571b69d-603c-4ba3-b051-b9dcc6f69764 {{(pid=82780) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 21:24:53 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b863bbaf-8068-4b5c-a6ef-a8898f6fb2f1]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:24:53 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-d808c3da-3830-43af-a0f9-0055863b3f41 tempest-VolumesExtendTest-1539744333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a35bfddd-36b4-46da-a9ff-ea6f67d73882.e571b69d-603c-4ba3-b051-b9dcc6f69764 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:53 devstack sudo[94421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ce64c1a-2e55-4411-b145-23fefa40cc1d_jk0p_5bidevstack@QuobyteHD Sep 10 21:24:53 devstack sudo[94421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 21:24:54 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-d808c3da-3830-43af-a0f9-0055863b3f41 tempest-VolumesExtendTest-1539744333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a35bfddd-36b4-46da-a9ff-ea6f67d73882.e571b69d-603c-4ba3-b051-b9dcc6f69764" returned: 0 in 0.709s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:54 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-d808c3da-3830-43af-a0f9-0055863b3f41 tempest-VolumesExtendTest-1539744333 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a35bfddd-36b4-46da-a9ff-ea6f67d73882(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82780) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 21:24:54 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb269d9-dba9-406f-b327-5b9ad5b68e72]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:24:54 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-d808c3da-3830-43af-a0f9-0055863b3f41 tempest-VolumesExtendTest-1539744333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a35bfddd-36b4-46da-a9ff-ea6f67d73882 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:54 devstack quobyte-client[82807]: System call of process 94426 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:24:55 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-d808c3da-3830-43af-a0f9-0055863b3f41 tempest-VolumesExtendTest-1539744333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a35bfddd-36b4-46da-a9ff-ea6f67d73882" returned: 0 in 0.851s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:55 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-d808c3da-3830-43af-a0f9-0055863b3f41 tempest-VolumesExtendTest-1539744333 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a35bfddd-36b4-46da-a9ff-ea6f67d73882.e571b69d-603c-4ba3-b051-b9dcc6f69764 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:55 devstack quobyte-client[82807]: System call of process 94429 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:24:55 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-d808c3da-3830-43af-a0f9-0055863b3f41 tempest-VolumesExtendTest-1539744333 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a35bfddd-36b4-46da-a9ff-ea6f67d73882.e571b69d-603c-4ba3-b051-b9dcc6f69764" returned: 0 in 0.500s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:55 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-d808c3da-3830-43af-a0f9-0055863b3f41 tempest-VolumesExtendTest-1539744333 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a35bfddd-36b4-46da-a9ff-ea6f67d73882.e571b69d-603c-4ba3-b051-b9dcc6f69764 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:55 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-d808c3da-3830-43af-a0f9-0055863b3f41 tempest-VolumesExtendTest-1539744333 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a35bfddd-36b4-46da-a9ff-ea6f67d73882.e571b69d-603c-4ba3-b051-b9dcc6f69764" returned: 0 in 0.297s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:56 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-d808c3da-3830-43af-a0f9-0055863b3f41 tempest-VolumesExtendTest-1539744333 None] Lock "cinder-quobyte-e571b69d-603c-4ba3-b051-b9dcc6f69764" released by "_delete_snapshot" :: held 2.853s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:24:56 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-d808c3da-3830-43af-a0f9-0055863b3f41 tempest-VolumesExtendTest-1539744333 None] Lock "cinder-quobyte-a35bfddd-36b4-46da-a9ff-ea6f67d73882" released by "delete_snapshot" :: held 2.942s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:24:56 devstack sudo[94421]: pam_unix(sudo:session): session closed for user root Sep 10 21:24:56 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:UPDATE=105,cinder:DELETE=9,cinder:SELECT=80,cinder:INSERT=31 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:24:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ce64c1a-2e55-4411-b145-23fefa40cc1d_jk0p_5bidevstack@QuobyteHD" returned: 0 in 3.624s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ce64c1a-2e55-4411-b145-23fefa40cc1d_jk0p_5bidevstack@QuobyteHD {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:56 devstack cinder-volume[82780]: DEBUG oslo_service.periodic_task [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82780) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 21:24:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:24:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:24:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:24:57 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:24:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:24:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:57 devstack sudo[94437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ce64c1a-2e55-4411-b145-23fefa40cc1d_jk0p_5bidevstack@QuobyteHD Sep 10 21:24:57 devstack sudo[94437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 21:24:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.433s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:57 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:24:57 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-d808c3da-3830-43af-a0f9-0055863b3f41 tempest-VolumesExtendTest-1539744333 None] Created reservations ['6be44a23-6679-4d3b-b71a-759286e8297d', '66ef47ca-8b32-48d2-87b2-1490ed9b4b0c', 'f0a99d54-47eb-4475-96c8-a07c752362e9', '9f742924-bb3d-4280-94f4-6b346f5735bd'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:24:57 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-d808c3da-3830-43af-a0f9-0055863b3f41 tempest-VolumesExtendTest-1539744333 None] Delete snapshot completed successfully. Sep 10 21:24:57 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-d808c3da-3830-43af-a0f9-0055863b3f41 tempest-VolumesExtendTest-1539744333 None] Lock "cinder-e571b69d-603c-4ba3-b051-b9dcc6f69764-delete_snapshot" released by "delete_snapshot" :: held 4.934s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:24:58 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-c830eedb-2db9-47fb-ad96-152bea6bd18c tempest-VolumesExtendTest-1539744333 None] Acquiring lock "cinder-a35bfddd-36b4-46da-a9ff-ea6f67d73882-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:24:58 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-c830eedb-2db9-47fb-ad96-152bea6bd18c tempest-VolumesExtendTest-1539744333 None] Lock "cinder-a35bfddd-36b4-46da-a9ff-ea6f67d73882-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:24:59 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-c830eedb-2db9-47fb-ad96-152bea6bd18c tempest-VolumesExtendTest-1539744333 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:24:59 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-c830eedb-2db9-47fb-ad96-152bea6bd18c tempest-VolumesExtendTest-1539744333 None] Acquiring lock "cinder-quobyte-a35bfddd-36b4-46da-a9ff-ea6f67d73882" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:24:59 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-c830eedb-2db9-47fb-ad96-152bea6bd18c tempest-VolumesExtendTest-1539744333 None] Lock "cinder-quobyte-a35bfddd-36b4-46da-a9ff-ea6f67d73882" acquired by "delete_volume" :: waited 0.026s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:24:59 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f378303-a83a-4793-84d5-06fad3eb1887]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:24:59 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c830eedb-2db9-47fb-ad96-152bea6bd18c tempest-VolumesExtendTest-1539744333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a35bfddd-36b4-46da-a9ff-ea6f67d73882 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:24:59 devstack sudo[94437]: pam_unix(sudo:session): session closed for user root Sep 10 21:24:59 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ce64c1a-2e55-4411-b145-23fefa40cc1d_jk0p_5bidevstack@QuobyteHD" returned: 1 in 3.172s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:59 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ce64c1a-2e55-4411-b145-23fefa40cc1d_jk0p_5bidevstack@QuobyteHD' failed. Not Retrying. {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 21:24:59 devstack cinder-volume[82780]: DEBUG cinder.image.image_utils [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] Temporary image 2ce64c1a-2e55-4411-b145-23fefa40cc1d is fetched for user e30009f78428464e847329e9a818b9b8. {{(pid=82780) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 10 21:24:59 devstack quobyte-client[82807]: System call of process 94449 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:24:59 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c830eedb-2db9-47fb-ad96-152bea6bd18c tempest-VolumesExtendTest-1539744333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a35bfddd-36b4-46da-a9ff-ea6f67d73882" returned: 0 in 0.707s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:24:59 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c830eedb-2db9-47fb-ad96-152bea6bd18c tempest-VolumesExtendTest-1539744333 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a35bfddd-36b4-46da-a9ff-ea6f67d73882 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:25:00 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c830eedb-2db9-47fb-ad96-152bea6bd18c tempest-VolumesExtendTest-1539744333 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-a35bfddd-36b4-46da-a9ff-ea6f67d73882" returned: 0 in 0.284s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:25:00 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-c830eedb-2db9-47fb-ad96-152bea6bd18c tempest-VolumesExtendTest-1539744333 None] Lock "cinder-quobyte-a35bfddd-36b4-46da-a9ff-ea6f67d73882" released by "delete_volume" :: held 1.161s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:25:00 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ffdaaa4-60c1-4a82-bb91-93edc5933a07]: (4, 'raw') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:25:00 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ce64c1a-2e55-4411-b145-23fefa40cc1d_jk0p_5bidevstack@QuobyteHD {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:25:00 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-c830eedb-2db9-47fb-ad96-152bea6bd18c tempest-VolumesExtendTest-1539744333 None] Created reservations ['614bb45f-6153-4448-9a6c-466f6c113214', '197f1110-60f2-43d3-878d-159aa5b7c50e', '1c35642a-c1cb-4dc3-96ab-c567179b7a14', '0d02cf82-86d7-49ad-9b4c-7a83c942b42f'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:25:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-c830eedb-2db9-47fb-ad96-152bea6bd18c tempest-VolumesExtendTest-1539744333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:25:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-c830eedb-2db9-47fb-ad96-152bea6bd18c tempest-VolumesExtendTest-1539744333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:25:01 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-c830eedb-2db9-47fb-ad96-152bea6bd18c tempest-VolumesExtendTest-1539744333 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:25:01 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-c830eedb-2db9-47fb-ad96-152bea6bd18c tempest-VolumesExtendTest-1539744333 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:25:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-c830eedb-2db9-47fb-ad96-152bea6bd18c tempest-VolumesExtendTest-1539744333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:25:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c830eedb-2db9-47fb-ad96-152bea6bd18c tempest-VolumesExtendTest-1539744333 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:25:01 devstack sudo[94453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ce64c1a-2e55-4411-b145-23fefa40cc1d_jk0p_5bidevstack@QuobyteHD Sep 10 21:25:01 devstack sudo[94453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 21:25:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c830eedb-2db9-47fb-ad96-152bea6bd18c tempest-VolumesExtendTest-1539744333 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.185s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:25:01 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-c830eedb-2db9-47fb-ad96-152bea6bd18c tempest-VolumesExtendTest-1539744333 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:25:01 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-c830eedb-2db9-47fb-ad96-152bea6bd18c tempest-VolumesExtendTest-1539744333 None] Deleted volume successfully. Sep 10 21:25:02 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-c830eedb-2db9-47fb-ad96-152bea6bd18c tempest-VolumesExtendTest-1539744333 None] Lock "cinder-a35bfddd-36b4-46da-a9ff-ea6f67d73882-delete_volume" released by "delete_volume" :: held 3.208s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:25:04 devstack sudo[94453]: pam_unix(sudo:session): session closed for user root Sep 10 21:25:04 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ce64c1a-2e55-4411-b145-23fefa40cc1d_jk0p_5bidevstack@QuobyteHD" returned: 0 in 3.322s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:25:04 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ce64c1a-2e55-4411-b145-23fefa40cc1d_jk0p_5bidevstack@QuobyteHD {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:25:04 devstack sudo[94458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ce64c1a-2e55-4411-b145-23fefa40cc1d_jk0p_5bidevstack@QuobyteHD Sep 10 21:25:04 devstack sudo[94458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 21:25:06 devstack sudo[94458]: pam_unix(sudo:session): session closed for user root Sep 10 21:25:06 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ce64c1a-2e55-4411-b145-23fefa40cc1d_jk0p_5bidevstack@QuobyteHD" returned: 1 in 2.667s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:25:06 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ce64c1a-2e55-4411-b145-23fefa40cc1d_jk0p_5bidevstack@QuobyteHD' failed. Not Retrying. {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 21:25:06 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:25:06 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:25:06 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:24:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb8c69ab-8d9e-4a90-a282-87cf724b5859,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4de40f52691d49b5acb808939ca89010',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:24:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:24:50Z,use_quota=True,user_id='e30009f78428464e847329e9a818b9b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:25:06 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] Creating volume cb8c69ab-8d9e-4a90-a282-87cf724b5859 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:25:06 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:25:06 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:25:06 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:25:06 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:25:06 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:25:06 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:25:06 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:25:06 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-cb8c69ab-8d9e-4a90-a282-87cf724b5859 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:25:07 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=79, name=volume-cb8c69ab-8d9e-4a90-a282-87cf724b5859, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:25:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-cb8c69ab-8d9e-4a90-a282-87cf724b5859 1073741824" returned: 0 in 0.592s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:25:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-cb8c69ab-8d9e-4a90-a282-87cf724b5859 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:25:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-cb8c69ab-8d9e-4a90-a282-87cf724b5859" returned: 0 in 0.187s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:25:07 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] <== create_volume: return (953ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:25:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:25:08 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=84,cinder:UPDATE=127,cinder:DELETE=12,cinder:INSERT=26 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:25:08 devstack cinder-volume[82780]: DEBUG cinder.volume.volume_utils [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] Attempting download of 2ce64c1a-2e55-4411-b145-23fefa40cc1d ((None, None)) to volume cb8c69ab-8d9e-4a90-a282-87cf724b5859. {{(pid=82780) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 10 21:25:08 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[282ac20d-cccf-4f0b-94a8-c5455f390a04]: (4, 'raw') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:25:08 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2ce64c1a-2e55-4411-b145-23fefa40cc1d_v3ag0yhq {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:25:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2ce64c1a-2e55-4411-b145-23fefa40cc1d_v3ag0yhq" returned: 0 in 1.098s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:25:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2ce64c1a-2e55-4411-b145-23fefa40cc1d_v3ag0yhq {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:25:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2ce64c1a-2e55-4411-b145-23fefa40cc1d_v3ag0yhq" returned: 1 in 0.626s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:25:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2ce64c1a-2e55-4411-b145-23fefa40cc1d_v3ag0yhq' failed. Not Retrying. {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 21:25:10 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe8f0dc-aa79-449f-90ce-97c07b60b86a]: (4, 'raw') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:25:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ce64c1a-2e55-4411-b145-23fefa40cc1d_jk0p_5bidevstack@QuobyteHD {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:25:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ce64c1a-2e55-4411-b145-23fefa40cc1d_jk0p_5bidevstack@QuobyteHD" returned: 0 in 0.533s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:25:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ce64c1a-2e55-4411-b145-23fefa40cc1d_jk0p_5bidevstack@QuobyteHD {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:25:11 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ce64c1a-2e55-4411-b145-23fefa40cc1d_jk0p_5bidevstack@QuobyteHD" returned: 1 in 0.839s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:25:11 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ce64c1a-2e55-4411-b145-23fefa40cc1d_jk0p_5bidevstack@QuobyteHD' failed. Not Retrying. {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 21:25:11 devstack cinder-volume[82780]: DEBUG cinder.image.image_utils [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] 2ce64c1a-2e55-4411-b145-23fefa40cc1d was raw, converting to raw {{(pid=82780) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 10 21:25:11 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] Running cmd (subprocess): qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_2ce64c1a-2e55-4411-b145-23fefa40cc1d_jk0p_5bidevstack@QuobyteHD /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-cb8c69ab-8d9e-4a90-a282-87cf724b5859 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:25:12 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=79, name=volume-cb8c69ab-8d9e-4a90-a282-87cf724b5859, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:25:12 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] CMD "qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_2ce64c1a-2e55-4411-b145-23fefa40cc1d_jk0p_5bidevstack@QuobyteHD /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-cb8c69ab-8d9e-4a90-a282-87cf724b5859" returned: 0 in 0.281s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:25:12 devstack cinder-volume[82780]: DEBUG cinder.image.image_utils [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2ce64c1a-2e55-4411-b145-23fefa40cc1d_jk0p_5bidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-cb8c69ab-8d9e-4a90-a282-87cf724b5859 {{(pid=82780) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 10 21:25:12 devstack cinder-volume[82780]: INFO cinder.image.image_utils [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] Converted 0.00 MB image at 0.00 MB/s Sep 10 21:25:12 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-cb8c69ab-8d9e-4a90-a282-87cf724b5859 1G {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:25:12 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-cb8c69ab-8d9e-4a90-a282-87cf724b5859 1G" returned: 0 in 0.509s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:25:13 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd623eb-5fc6-43dd-955e-4d68cd6a9516]: (4, 'raw') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:25:13 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-cb8c69ab-8d9e-4a90-a282-87cf724b5859 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:25:13 devstack quobyte-client[82807]: System call of process 94693 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:25:13 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-cb8c69ab-8d9e-4a90-a282-87cf724b5859" returned: 0 in 0.886s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:25:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-cb8c69ab-8d9e-4a90-a282-87cf724b5859 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:25:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-cb8c69ab-8d9e-4a90-a282-87cf724b5859" returned: 1 in 0.948s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:25:15 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-cb8c69ab-8d9e-4a90-a282-87cf724b5859' failed. Not Retrying. {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 21:25:15 devstack cinder-volume[82780]: DEBUG cinder.volume.volume_utils [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] Downloaded image 2ce64c1a-2e55-4411-b145-23fefa40cc1d ((None, None)) to volume cb8c69ab-8d9e-4a90-a282-87cf724b5859 successfully. {{(pid=82780) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 10 21:25:15 devstack cinder-volume[82780]: DEBUG cinder.image.image_utils [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] Temporary image 2ce64c1a-2e55-4411-b145-23fefa40cc1d for user e30009f78428464e847329e9a818b9b8 is deleted. {{(pid=82780) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 10 21:25:15 devstack cinder-volume[82780]: DEBUG cinder.volume.volume_utils [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] Marking volume cb8c69ab-8d9e-4a90-a282-87cf724b5859 as bootable. {{(pid=82780) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 10 21:25:15 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] Copying metadata from image 2ce64c1a-2e55-4411-b145-23fefa40cc1d to cb8c69ab-8d9e-4a90-a282-87cf724b5859. {{(pid=82780) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 10 21:25:15 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] Creating volume glance metadata for volume cb8c69ab-8d9e-4a90-a282-87cf724b5859 backed by image 2ce64c1a-2e55-4411-b145-23fefa40cc1d with: {'image_id': '2ce64c1a-2e55-4411-b145-23fefa40cc1d', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'da59cba8a41939eb084eb643cd9eb8f4', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=82780) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 10 21:25:15 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-4ea22bde-b1c8-4269-8bd9-b3d4b3f7ce36 tempest-VolumesListTestJSON-656810188 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:25:15 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ea22bde-b1c8-4269-8bd9-b3d4b3f7ce36 tempest-VolumesListTestJSON-656810188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:25:15 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4ea22bde-b1c8-4269-8bd9-b3d4b3f7ce36 tempest-VolumesListTestJSON-656810188 None] Flow 'volume_create_manager' (085839f2-5495-4b40-b92f-9da2a6f0dde8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:25:15 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4ea22bde-b1c8-4269-8bd9-b3d4b3f7ce36 tempest-VolumesListTestJSON-656810188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97f3df68-0df9-43a1-b62a-3412c7aa59c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:25:16 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e7ee092-ff93-4ef6-85e1-50ff8afcda5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb8c69ab-8d9e-4a90-a282-87cf724b5859', 'volume_size': 1, 'image_id': '2ce64c1a-2e55-4411-b145-23fefa40cc1d', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'da59cba8a41939eb084eb643cd9eb8f4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4de40f52691d49b5acb808939ca89010', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bcbc3c9d3492cbcd6e1a95d3aeb6b5f710ab0343dc16f6317949db974dec3f5560d4960f5dd2e4432df07d564af704ed37b685bfb23406a5f407fecaf56ada23', 'id': '2ce64c1a-2e55-4411-b145-23fefa40cc1d', 'created_at': datetime.datetime(2025, 9, 10, 19, 24, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 19, 24, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2ce64c1a-2e55-4411-b145-23fefa40cc1d/file', 'properties': {}}, 'image_service': }' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:25:16 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e03363b-1898-494a-b17d-835f8c465134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:25:16 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4ea22bde-b1c8-4269-8bd9-b3d4b3f7ce36 tempest-VolumesListTestJSON-656810188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97f3df68-0df9-43a1-b62a-3412c7aa59c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:25:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-41735812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7af1190b-84c0-4cc3-98d0-f039225564b2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ac96842c16a74564a5e0b8c1bbf8c4cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:25:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:25:15Z,use_quota=True,user_id='11cccbe913b948a6b4405bd7dce2eccb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:25:16 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4ea22bde-b1c8-4269-8bd9-b3d4b3f7ce36 tempest-VolumesListTestJSON-656810188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ed16e2a-ac9e-475c-a46f-a393d938f5df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:25:16 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4ea22bde-b1c8-4269-8bd9-b3d4b3f7ce36 tempest-VolumesListTestJSON-656810188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ed16e2a-ac9e-475c-a46f-a393d938f5df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:25:16 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4ea22bde-b1c8-4269-8bd9-b3d4b3f7ce36 tempest-VolumesListTestJSON-656810188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3ddbdc8-9d08-4fa4-8049-dbfc9393f60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:25:16 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4ea22bde-b1c8-4269-8bd9-b3d4b3f7ce36 tempest-VolumesListTestJSON-656810188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3ddbdc8-9d08-4fa4-8049-dbfc9393f60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7af1190b-84c0-4cc3-98d0-f039225564b2', 'volume_name': 'volume-7af1190b-84c0-4cc3-98d0-f039225564b2', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:25:16 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4ea22bde-b1c8-4269-8bd9-b3d4b3f7ce36 tempest-VolumesListTestJSON-656810188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (157e4409-5faf-4fa1-b921-37bdeb244576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:25:16 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4ea22bde-b1c8-4269-8bd9-b3d4b3f7ce36 tempest-VolumesListTestJSON-656810188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (157e4409-5faf-4fa1-b921-37bdeb244576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:25:16 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4ea22bde-b1c8-4269-8bd9-b3d4b3f7ce36 tempest-VolumesListTestJSON-656810188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d99a447b-0255-446a-a161-325e49f7fb8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:25:16 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-4ea22bde-b1c8-4269-8bd9-b3d4b3f7ce36 tempest-VolumesListTestJSON-656810188 None] Volume 7af1190b-84c0-4cc3-98d0-f039225564b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7af1190b-84c0-4cc3-98d0-f039225564b2', 'volume_size': 1} Sep 10 21:25:16 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-4ea22bde-b1c8-4269-8bd9-b3d4b3f7ce36 tempest-VolumesListTestJSON-656810188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:25:16 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-4ea22bde-b1c8-4269-8bd9-b3d4b3f7ce36 tempest-VolumesListTestJSON-656810188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.018s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:25:16 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-4ea22bde-b1c8-4269-8bd9-b3d4b3f7ce36 tempest-VolumesListTestJSON-656810188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:25:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-41735812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7af1190b-84c0-4cc3-98d0-f039225564b2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ac96842c16a74564a5e0b8c1bbf8c4cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:25:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:25:15Z,use_quota=True,user_id='11cccbe913b948a6b4405bd7dce2eccb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:25:16 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-4ea22bde-b1c8-4269-8bd9-b3d4b3f7ce36 tempest-VolumesListTestJSON-656810188 None] Creating volume 7af1190b-84c0-4cc3-98d0-f039225564b2 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:25:16 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-4ea22bde-b1c8-4269-8bd9-b3d4b3f7ce36 tempest-VolumesListTestJSON-656810188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:25:16 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-4ea22bde-b1c8-4269-8bd9-b3d4b3f7ce36 tempest-VolumesListTestJSON-656810188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:25:16 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-4ea22bde-b1c8-4269-8bd9-b3d4b3f7ce36 tempest-VolumesListTestJSON-656810188 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:25:16 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-4ea22bde-b1c8-4269-8bd9-b3d4b3f7ce36 tempest-VolumesListTestJSON-656810188 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:25:16 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-4ea22bde-b1c8-4269-8bd9-b3d4b3f7ce36 tempest-VolumesListTestJSON-656810188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:25:16 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-4ea22bde-b1c8-4269-8bd9-b3d4b3f7ce36 tempest-VolumesListTestJSON-656810188 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:25:16 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-4ea22bde-b1c8-4269-8bd9-b3d4b3f7ce36 tempest-VolumesListTestJSON-656810188 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:25:16 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4ea22bde-b1c8-4269-8bd9-b3d4b3f7ce36 tempest-VolumesListTestJSON-656810188 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-7af1190b-84c0-4cc3-98d0-f039225564b2 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:25:16 devstack quobyte-client[82807]: System call of process 94714 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:25:16 devstack quobyte-client[82807]: System call of process 94714 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:25:16 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=80, name=volume-7af1190b-84c0-4cc3-98d0-f039225564b2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:25:16 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] Volume volume-cb8c69ab-8d9e-4a90-a282-87cf724b5859 (cb8c69ab-8d9e-4a90-a282-87cf724b5859): created successfully Sep 10 21:25:16 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e03363b-1898-494a-b17d-835f8c465134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:25:16 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] Flow 'volume_create_manager' (b9b2b9e4-6a17-4906-8f22-67767d242ccb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:25:16 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-ff509ee5-104c-49cb-8f73-5befbbd73b53 tempest-VolumeImageDependencyTests-869697788 None] Created volume successfully. Sep 10 21:25:16 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4ea22bde-b1c8-4269-8bd9-b3d4b3f7ce36 tempest-VolumesListTestJSON-656810188 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-7af1190b-84c0-4cc3-98d0-f039225564b2 1073741824" returned: 0 in 0.806s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:25:16 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4ea22bde-b1c8-4269-8bd9-b3d4b3f7ce36 tempest-VolumesListTestJSON-656810188 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-7af1190b-84c0-4cc3-98d0-f039225564b2 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:25:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4ea22bde-b1c8-4269-8bd9-b3d4b3f7ce36 tempest-VolumesListTestJSON-656810188 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-7af1190b-84c0-4cc3-98d0-f039225564b2" returned: 0 in 0.218s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:25:17 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-4ea22bde-b1c8-4269-8bd9-b3d4b3f7ce36 tempest-VolumesListTestJSON-656810188 None] <== create_volume: return (1074ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:25:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-4ea22bde-b1c8-4269-8bd9-b3d4b3f7ce36 tempest-VolumesListTestJSON-656810188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:25:17 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4ea22bde-b1c8-4269-8bd9-b3d4b3f7ce36 tempest-VolumesListTestJSON-656810188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d99a447b-0255-446a-a161-325e49f7fb8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7af1190b-84c0-4cc3-98d0-f039225564b2', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:25:17 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4ea22bde-b1c8-4269-8bd9-b3d4b3f7ce36 tempest-VolumesListTestJSON-656810188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dec2ceaf-2d61-4e64-97b9-5f764a89657c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:25:17 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-4a6b7c6e-e1e0-4566-b7cf-3b5676e10813 tempest-VolumeImageDependencyTests-869697788 None] Acquiring lock "cinder-cb8c69ab-8d9e-4a90-a282-87cf724b5859-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:25:17 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-4a6b7c6e-e1e0-4566-b7cf-3b5676e10813 tempest-VolumeImageDependencyTests-869697788 None] Lock "cinder-cb8c69ab-8d9e-4a90-a282-87cf724b5859-delete_volume" acquired by "delete_volume" :: waited 0.098s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:25:17 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-4ea22bde-b1c8-4269-8bd9-b3d4b3f7ce36 tempest-VolumesListTestJSON-656810188 None] Volume volume-7af1190b-84c0-4cc3-98d0-f039225564b2 (7af1190b-84c0-4cc3-98d0-f039225564b2): created successfully Sep 10 21:25:17 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4ea22bde-b1c8-4269-8bd9-b3d4b3f7ce36 tempest-VolumesListTestJSON-656810188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dec2ceaf-2d61-4e64-97b9-5f764a89657c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:25:17 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4ea22bde-b1c8-4269-8bd9-b3d4b3f7ce36 tempest-VolumesListTestJSON-656810188 None] Flow 'volume_create_manager' (085839f2-5495-4b40-b92f-9da2a6f0dde8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:25:17 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-4a6b7c6e-e1e0-4566-b7cf-3b5676e10813 tempest-VolumeImageDependencyTests-869697788 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:25:17 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-4a6b7c6e-e1e0-4566-b7cf-3b5676e10813 tempest-VolumeImageDependencyTests-869697788 None] Acquiring lock "cinder-quobyte-cb8c69ab-8d9e-4a90-a282-87cf724b5859" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:25:17 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-4ea22bde-b1c8-4269-8bd9-b3d4b3f7ce36 tempest-VolumesListTestJSON-656810188 None] Created volume successfully. Sep 10 21:25:17 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-4a6b7c6e-e1e0-4566-b7cf-3b5676e10813 tempest-VolumeImageDependencyTests-869697788 None] Lock "cinder-quobyte-cb8c69ab-8d9e-4a90-a282-87cf724b5859" acquired by "delete_volume" :: waited 0.053s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:25:17 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[c833f8f1-90ae-4529-b6f6-f356f5af727d]: (4, 'raw') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:25:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4a6b7c6e-e1e0-4566-b7cf-3b5676e10813 tempest-VolumeImageDependencyTests-869697788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-cb8c69ab-8d9e-4a90-a282-87cf724b5859 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:25:18 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4a6b7c6e-e1e0-4566-b7cf-3b5676e10813 tempest-VolumeImageDependencyTests-869697788 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-cb8c69ab-8d9e-4a90-a282-87cf724b5859" returned: 0 in 0.558s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:25:18 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4a6b7c6e-e1e0-4566-b7cf-3b5676e10813 tempest-VolumeImageDependencyTests-869697788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-cb8c69ab-8d9e-4a90-a282-87cf724b5859 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:25:19 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4a6b7c6e-e1e0-4566-b7cf-3b5676e10813 tempest-VolumeImageDependencyTests-869697788 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-cb8c69ab-8d9e-4a90-a282-87cf724b5859" returned: 1 in 0.803s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:25:19 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4a6b7c6e-e1e0-4566-b7cf-3b5676e10813 tempest-VolumeImageDependencyTests-869697788 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-cb8c69ab-8d9e-4a90-a282-87cf724b5859' failed. Not Retrying. {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 21:25:19 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4a6b7c6e-e1e0-4566-b7cf-3b5676e10813 tempest-VolumeImageDependencyTests-869697788 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-cb8c69ab-8d9e-4a90-a282-87cf724b5859 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:25:19 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-d4af808c-e268-4a3f-b4c6-85e79bd39423 tempest-VolumesListTestJSON-656810188 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:25:19 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4af808c-e268-4a3f-b4c6-85e79bd39423 tempest-VolumesListTestJSON-656810188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:25:19 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-d4af808c-e268-4a3f-b4c6-85e79bd39423 tempest-VolumesListTestJSON-656810188 None] Flow 'volume_create_manager' (c3bbd529-304a-4cef-b619-69d3135788f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:25:19 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-d4af808c-e268-4a3f-b4c6-85e79bd39423 tempest-VolumesListTestJSON-656810188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a722e5cf-1a4b-4498-af46-682194e724d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:25:19 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4a6b7c6e-e1e0-4566-b7cf-3b5676e10813 tempest-VolumeImageDependencyTests-869697788 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-cb8c69ab-8d9e-4a90-a282-87cf724b5859" returned: 0 in 0.549s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:25:20 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-d4af808c-e268-4a3f-b4c6-85e79bd39423 tempest-VolumesListTestJSON-656810188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a722e5cf-1a4b-4498-af46-682194e724d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:25:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-21895584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=affa6670-8f78-46de-a075-cf1bf2849bf5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ac96842c16a74564a5e0b8c1bbf8c4cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:25:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:25:19Z,use_quota=True,user_id='11cccbe913b948a6b4405bd7dce2eccb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:25:20 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-d4af808c-e268-4a3f-b4c6-85e79bd39423 tempest-VolumesListTestJSON-656810188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5b98648-0d4c-4567-8491-5464ecef2dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:25:20 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-d4af808c-e268-4a3f-b4c6-85e79bd39423 tempest-VolumesListTestJSON-656810188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5b98648-0d4c-4567-8491-5464ecef2dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:25:20 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-d4af808c-e268-4a3f-b4c6-85e79bd39423 tempest-VolumesListTestJSON-656810188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f26241d-0ea1-4afd-b2c8-39f528d3c239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:25:20 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-d4af808c-e268-4a3f-b4c6-85e79bd39423 tempest-VolumesListTestJSON-656810188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f26241d-0ea1-4afd-b2c8-39f528d3c239) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'affa6670-8f78-46de-a075-cf1bf2849bf5', 'volume_name': 'volume-affa6670-8f78-46de-a075-cf1bf2849bf5', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:25:20 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-d4af808c-e268-4a3f-b4c6-85e79bd39423 tempest-VolumesListTestJSON-656810188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (416ac0e2-7ee6-4682-9ae8-e7639f16d3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:25:20 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-d4af808c-e268-4a3f-b4c6-85e79bd39423 tempest-VolumesListTestJSON-656810188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (416ac0e2-7ee6-4682-9ae8-e7639f16d3d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:25:20 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-d4af808c-e268-4a3f-b4c6-85e79bd39423 tempest-VolumesListTestJSON-656810188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c62e4ebd-0af5-45c3-b6c9-06fbd6d21844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:25:20 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-d4af808c-e268-4a3f-b4c6-85e79bd39423 tempest-VolumesListTestJSON-656810188 None] Volume affa6670-8f78-46de-a075-cf1bf2849bf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-affa6670-8f78-46de-a075-cf1bf2849bf5', 'volume_size': 1} Sep 10 21:25:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-d4af808c-e268-4a3f-b4c6-85e79bd39423 tempest-VolumesListTestJSON-656810188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:25:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-d4af808c-e268-4a3f-b4c6-85e79bd39423 tempest-VolumesListTestJSON-656810188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:25:20 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-d4af808c-e268-4a3f-b4c6-85e79bd39423 tempest-VolumesListTestJSON-656810188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:25:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-21895584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=affa6670-8f78-46de-a075-cf1bf2849bf5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ac96842c16a74564a5e0b8c1bbf8c4cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:25:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:25:19Z,use_quota=True,user_id='11cccbe913b948a6b4405bd7dce2eccb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:25:20 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-d4af808c-e268-4a3f-b4c6-85e79bd39423 tempest-VolumesListTestJSON-656810188 None] Creating volume affa6670-8f78-46de-a075-cf1bf2849bf5 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:25:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-d4af808c-e268-4a3f-b4c6-85e79bd39423 tempest-VolumesListTestJSON-656810188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:25:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-d4af808c-e268-4a3f-b4c6-85e79bd39423 tempest-VolumesListTestJSON-656810188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:25:20 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-d4af808c-e268-4a3f-b4c6-85e79bd39423 tempest-VolumesListTestJSON-656810188 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:25:20 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-d4af808c-e268-4a3f-b4c6-85e79bd39423 tempest-VolumesListTestJSON-656810188 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:25:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-d4af808c-e268-4a3f-b4c6-85e79bd39423 tempest-VolumesListTestJSON-656810188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:25:20 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-d4af808c-e268-4a3f-b4c6-85e79bd39423 tempest-VolumesListTestJSON-656810188 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:25:20 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-d4af808c-e268-4a3f-b4c6-85e79bd39423 tempest-VolumesListTestJSON-656810188 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:25:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-d4af808c-e268-4a3f-b4c6-85e79bd39423 tempest-VolumesListTestJSON-656810188 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-affa6670-8f78-46de-a075-cf1bf2849bf5 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:25:20 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-4a6b7c6e-e1e0-4566-b7cf-3b5676e10813 tempest-VolumeImageDependencyTests-869697788 None] Lock "cinder-quobyte-cb8c69ab-8d9e-4a90-a282-87cf724b5859" released by "delete_volume" :: held 2.444s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:25:20 devstack quobyte-client[82807]: System call of process 94725 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:25:20 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=81, name=volume-affa6670-8f78-46de-a075-cf1bf2849bf5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:25:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-d4af808c-e268-4a3f-b4c6-85e79bd39423 tempest-VolumesListTestJSON-656810188 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-affa6670-8f78-46de-a075-cf1bf2849bf5 1073741824" returned: 0 in 0.622s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:25:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-d4af808c-e268-4a3f-b4c6-85e79bd39423 tempest-VolumesListTestJSON-656810188 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-affa6670-8f78-46de-a075-cf1bf2849bf5 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:25:20 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-4a6b7c6e-e1e0-4566-b7cf-3b5676e10813 tempest-VolumeImageDependencyTests-869697788 None] Created reservations ['7acffbfb-fd83-41b8-b2f5-99d20e77dbf9', '029cff4a-2b35-4310-b4ee-d99ad77c9922', '354bd3fd-2510-44b0-898b-05b13fe62d82', '4a987526-9a0f-4809-b10d-3c3d9a6e9161'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:25:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-d4af808c-e268-4a3f-b4c6-85e79bd39423 tempest-VolumesListTestJSON-656810188 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-affa6670-8f78-46de-a075-cf1bf2849bf5" returned: 0 in 0.434s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:25:21 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-d4af808c-e268-4a3f-b4c6-85e79bd39423 tempest-VolumesListTestJSON-656810188 None] <== create_volume: return (1081ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:25:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-d4af808c-e268-4a3f-b4c6-85e79bd39423 tempest-VolumesListTestJSON-656810188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:25:21 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-d4af808c-e268-4a3f-b4c6-85e79bd39423 tempest-VolumesListTestJSON-656810188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c62e4ebd-0af5-45c3-b6c9-06fbd6d21844) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-affa6670-8f78-46de-a075-cf1bf2849bf5', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:25:21 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-d4af808c-e268-4a3f-b4c6-85e79bd39423 tempest-VolumesListTestJSON-656810188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad74f2e3-0b92-4eae-8a1a-8defb63a18f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:25:21 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-d4af808c-e268-4a3f-b4c6-85e79bd39423 tempest-VolumesListTestJSON-656810188 None] Volume volume-affa6670-8f78-46de-a075-cf1bf2849bf5 (affa6670-8f78-46de-a075-cf1bf2849bf5): created successfully Sep 10 21:25:21 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-d4af808c-e268-4a3f-b4c6-85e79bd39423 tempest-VolumesListTestJSON-656810188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad74f2e3-0b92-4eae-8a1a-8defb63a18f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:25:21 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-d4af808c-e268-4a3f-b4c6-85e79bd39423 tempest-VolumesListTestJSON-656810188 None] Flow 'volume_create_manager' (c3bbd529-304a-4cef-b619-69d3135788f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:25:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-4a6b7c6e-e1e0-4566-b7cf-3b5676e10813 tempest-VolumeImageDependencyTests-869697788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:25:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-4a6b7c6e-e1e0-4566-b7cf-3b5676e10813 tempest-VolumeImageDependencyTests-869697788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:25:21 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-4a6b7c6e-e1e0-4566-b7cf-3b5676e10813 tempest-VolumeImageDependencyTests-869697788 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:25:21 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-4a6b7c6e-e1e0-4566-b7cf-3b5676e10813 tempest-VolumeImageDependencyTests-869697788 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:25:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-4a6b7c6e-e1e0-4566-b7cf-3b5676e10813 tempest-VolumeImageDependencyTests-869697788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:25:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4a6b7c6e-e1e0-4566-b7cf-3b5676e10813 tempest-VolumeImageDependencyTests-869697788 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:25:21 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-d4af808c-e268-4a3f-b4c6-85e79bd39423 tempest-VolumesListTestJSON-656810188 None] Created volume successfully. Sep 10 21:25:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4a6b7c6e-e1e0-4566-b7cf-3b5676e10813 tempest-VolumeImageDependencyTests-869697788 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.360s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:25:21 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-4a6b7c6e-e1e0-4566-b7cf-3b5676e10813 tempest-VolumeImageDependencyTests-869697788 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:25:22 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-4a6b7c6e-e1e0-4566-b7cf-3b5676e10813 tempest-VolumeImageDependencyTests-869697788 None] Deleted volume successfully. Sep 10 21:25:22 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-4a6b7c6e-e1e0-4566-b7cf-3b5676e10813 tempest-VolumeImageDependencyTests-869697788 None] Lock "cinder-cb8c69ab-8d9e-4a90-a282-87cf724b5859-delete_volume" released by "delete_volume" :: held 4.773s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:25:23 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-56b032fc-66c9-48c9-8297-0cd44c1b2eb1 tempest-VolumesListTestJSON-656810188 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:25:23 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-56b032fc-66c9-48c9-8297-0cd44c1b2eb1 tempest-VolumesListTestJSON-656810188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:25:23 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-56b032fc-66c9-48c9-8297-0cd44c1b2eb1 tempest-VolumesListTestJSON-656810188 None] Flow 'volume_create_manager' (f9be2183-821a-485d-b56e-e9aac6d5f622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:25:23 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-56b032fc-66c9-48c9-8297-0cd44c1b2eb1 tempest-VolumesListTestJSON-656810188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c17e0c9-7059-42a9-8057-2de3ef5aeb01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:25:23 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-56b032fc-66c9-48c9-8297-0cd44c1b2eb1 tempest-VolumesListTestJSON-656810188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c17e0c9-7059-42a9-8057-2de3ef5aeb01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:25:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-456687382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0031f290-8847-471a-87d7-dea865e09763,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ac96842c16a74564a5e0b8c1bbf8c4cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:25:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:25:23Z,use_quota=True,user_id='11cccbe913b948a6b4405bd7dce2eccb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:25:23 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-56b032fc-66c9-48c9-8297-0cd44c1b2eb1 tempest-VolumesListTestJSON-656810188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b564227b-49d2-4d61-934d-0c70cedefde0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:25:23 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-56b032fc-66c9-48c9-8297-0cd44c1b2eb1 tempest-VolumesListTestJSON-656810188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b564227b-49d2-4d61-934d-0c70cedefde0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:25:23 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-56b032fc-66c9-48c9-8297-0cd44c1b2eb1 tempest-VolumesListTestJSON-656810188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (885608c1-aec5-4061-9891-e2200745caf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:25:23 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-56b032fc-66c9-48c9-8297-0cd44c1b2eb1 tempest-VolumesListTestJSON-656810188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (885608c1-aec5-4061-9891-e2200745caf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0031f290-8847-471a-87d7-dea865e09763', 'volume_name': 'volume-0031f290-8847-471a-87d7-dea865e09763', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:25:23 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-56b032fc-66c9-48c9-8297-0cd44c1b2eb1 tempest-VolumesListTestJSON-656810188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99500109-9d59-4ea7-80f9-563c980fb98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:25:23 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-56b032fc-66c9-48c9-8297-0cd44c1b2eb1 tempest-VolumesListTestJSON-656810188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99500109-9d59-4ea7-80f9-563c980fb98a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:25:24 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-56b032fc-66c9-48c9-8297-0cd44c1b2eb1 tempest-VolumesListTestJSON-656810188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf1963f3-2134-413b-9c34-2122d96d73b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:25:24 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-56b032fc-66c9-48c9-8297-0cd44c1b2eb1 tempest-VolumesListTestJSON-656810188 None] Volume 0031f290-8847-471a-87d7-dea865e09763: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0031f290-8847-471a-87d7-dea865e09763', 'volume_size': 1} Sep 10 21:25:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-56b032fc-66c9-48c9-8297-0cd44c1b2eb1 tempest-VolumesListTestJSON-656810188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:25:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-56b032fc-66c9-48c9-8297-0cd44c1b2eb1 tempest-VolumesListTestJSON-656810188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:25:24 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-56b032fc-66c9-48c9-8297-0cd44c1b2eb1 tempest-VolumesListTestJSON-656810188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:25:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-456687382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0031f290-8847-471a-87d7-dea865e09763,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ac96842c16a74564a5e0b8c1bbf8c4cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:25:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:25:23Z,use_quota=True,user_id='11cccbe913b948a6b4405bd7dce2eccb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:25:24 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-56b032fc-66c9-48c9-8297-0cd44c1b2eb1 tempest-VolumesListTestJSON-656810188 None] Creating volume 0031f290-8847-471a-87d7-dea865e09763 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:25:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-56b032fc-66c9-48c9-8297-0cd44c1b2eb1 tempest-VolumesListTestJSON-656810188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:25:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-56b032fc-66c9-48c9-8297-0cd44c1b2eb1 tempest-VolumesListTestJSON-656810188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:25:24 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-56b032fc-66c9-48c9-8297-0cd44c1b2eb1 tempest-VolumesListTestJSON-656810188 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:25:24 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-56b032fc-66c9-48c9-8297-0cd44c1b2eb1 tempest-VolumesListTestJSON-656810188 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:25:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-56b032fc-66c9-48c9-8297-0cd44c1b2eb1 tempest-VolumesListTestJSON-656810188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:25:24 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-56b032fc-66c9-48c9-8297-0cd44c1b2eb1 tempest-VolumesListTestJSON-656810188 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:25:24 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-56b032fc-66c9-48c9-8297-0cd44c1b2eb1 tempest-VolumesListTestJSON-656810188 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:25:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-56b032fc-66c9-48c9-8297-0cd44c1b2eb1 tempest-VolumesListTestJSON-656810188 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-0031f290-8847-471a-87d7-dea865e09763 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:25:24 devstack quobyte-client[82807]: System call of process 94730 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:25:24 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=82, name=volume-0031f290-8847-471a-87d7-dea865e09763, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:25:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-56b032fc-66c9-48c9-8297-0cd44c1b2eb1 tempest-VolumesListTestJSON-656810188 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-0031f290-8847-471a-87d7-dea865e09763 1073741824" returned: 0 in 0.621s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:25:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-56b032fc-66c9-48c9-8297-0cd44c1b2eb1 tempest-VolumesListTestJSON-656810188 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-0031f290-8847-471a-87d7-dea865e09763 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:25:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-56b032fc-66c9-48c9-8297-0cd44c1b2eb1 tempest-VolumesListTestJSON-656810188 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-0031f290-8847-471a-87d7-dea865e09763" returned: 0 in 0.142s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:25:24 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-56b032fc-66c9-48c9-8297-0cd44c1b2eb1 tempest-VolumesListTestJSON-656810188 None] <== create_volume: return (865ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:25:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-56b032fc-66c9-48c9-8297-0cd44c1b2eb1 tempest-VolumesListTestJSON-656810188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:25:25 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-56b032fc-66c9-48c9-8297-0cd44c1b2eb1 tempest-VolumesListTestJSON-656810188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf1963f3-2134-413b-9c34-2122d96d73b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0031f290-8847-471a-87d7-dea865e09763', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:25:25 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-56b032fc-66c9-48c9-8297-0cd44c1b2eb1 tempest-VolumesListTestJSON-656810188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (272b20dc-ba3f-48ec-a53e-9ed235c9b669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:25:25 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-56b032fc-66c9-48c9-8297-0cd44c1b2eb1 tempest-VolumesListTestJSON-656810188 None] Volume volume-0031f290-8847-471a-87d7-dea865e09763 (0031f290-8847-471a-87d7-dea865e09763): created successfully Sep 10 21:25:25 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-56b032fc-66c9-48c9-8297-0cd44c1b2eb1 tempest-VolumesListTestJSON-656810188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (272b20dc-ba3f-48ec-a53e-9ed235c9b669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:25:25 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-56b032fc-66c9-48c9-8297-0cd44c1b2eb1 tempest-VolumesListTestJSON-656810188 None] Flow 'volume_create_manager' (f9be2183-821a-485d-b56e-e9aac6d5f622) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:25:25 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-56b032fc-66c9-48c9-8297-0cd44c1b2eb1 tempest-VolumesListTestJSON-656810188 None] Created volume successfully. Sep 10 21:25:29 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-84d2a9aa-ce00-4640-9633-434761b9e8b0 tempest-VolumesListTestJSON-656810188 None] Acquiring lock "cinder-0031f290-8847-471a-87d7-dea865e09763-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:25:29 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-84d2a9aa-ce00-4640-9633-434761b9e8b0 tempest-VolumesListTestJSON-656810188 None] Lock "cinder-0031f290-8847-471a-87d7-dea865e09763-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:25:29 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-84d2a9aa-ce00-4640-9633-434761b9e8b0 tempest-VolumesListTestJSON-656810188 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:25:29 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-84d2a9aa-ce00-4640-9633-434761b9e8b0 tempest-VolumesListTestJSON-656810188 None] Acquiring lock "cinder-quobyte-0031f290-8847-471a-87d7-dea865e09763" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:25:29 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-84d2a9aa-ce00-4640-9633-434761b9e8b0 tempest-VolumesListTestJSON-656810188 None] Lock "cinder-quobyte-0031f290-8847-471a-87d7-dea865e09763" acquired by "delete_volume" :: waited 0.012s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:25:29 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[641b6f41-ed32-495e-aae6-ff7660757d8f]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:25:29 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-84d2a9aa-ce00-4640-9633-434761b9e8b0 tempest-VolumesListTestJSON-656810188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-0031f290-8847-471a-87d7-dea865e09763 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:25:30 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-84d2a9aa-ce00-4640-9633-434761b9e8b0 tempest-VolumesListTestJSON-656810188 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-0031f290-8847-471a-87d7-dea865e09763" returned: 0 in 0.466s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:25:30 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-84d2a9aa-ce00-4640-9633-434761b9e8b0 tempest-VolumesListTestJSON-656810188 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-0031f290-8847-471a-87d7-dea865e09763 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:25:30 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-84d2a9aa-ce00-4640-9633-434761b9e8b0 tempest-VolumesListTestJSON-656810188 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-0031f290-8847-471a-87d7-dea865e09763" returned: 0 in 0.089s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:25:30 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-84d2a9aa-ce00-4640-9633-434761b9e8b0 tempest-VolumesListTestJSON-656810188 None] Lock "cinder-quobyte-0031f290-8847-471a-87d7-dea865e09763" released by "delete_volume" :: held 0.717s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:25:30 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-84d2a9aa-ce00-4640-9633-434761b9e8b0 tempest-VolumesListTestJSON-656810188 None] Created reservations ['d93588de-f7b9-462d-b50c-089eb9b727c5', 'bdffc050-9544-46a1-990f-6abd0ca88a78', '587befaf-7548-41ac-b9be-867c4577e1ae', 'e9f7def3-1d13-4afd-9c06-4e557606b8aa'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:25:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-84d2a9aa-ce00-4640-9633-434761b9e8b0 tempest-VolumesListTestJSON-656810188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:25:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-84d2a9aa-ce00-4640-9633-434761b9e8b0 tempest-VolumesListTestJSON-656810188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:25:31 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-84d2a9aa-ce00-4640-9633-434761b9e8b0 tempest-VolumesListTestJSON-656810188 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:25:31 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-84d2a9aa-ce00-4640-9633-434761b9e8b0 tempest-VolumesListTestJSON-656810188 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:25:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-84d2a9aa-ce00-4640-9633-434761b9e8b0 tempest-VolumesListTestJSON-656810188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:25:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-84d2a9aa-ce00-4640-9633-434761b9e8b0 tempest-VolumesListTestJSON-656810188 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:25:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-84d2a9aa-ce00-4640-9633-434761b9e8b0 tempest-VolumesListTestJSON-656810188 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.093s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:25:31 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-84d2a9aa-ce00-4640-9633-434761b9e8b0 tempest-VolumesListTestJSON-656810188 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:25:31 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-84d2a9aa-ce00-4640-9633-434761b9e8b0 tempest-VolumesListTestJSON-656810188 None] Deleted volume successfully. Sep 10 21:25:31 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-84d2a9aa-ce00-4640-9633-434761b9e8b0 tempest-VolumesListTestJSON-656810188 None] Lock "cinder-0031f290-8847-471a-87d7-dea865e09763-delete_volume" released by "delete_volume" :: held 1.731s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:25:32 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-1ee21991-3515-486b-8d7e-88a91637bfb4 tempest-VolumesListTestJSON-656810188 None] Acquiring lock "cinder-affa6670-8f78-46de-a075-cf1bf2849bf5-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:25:32 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-1ee21991-3515-486b-8d7e-88a91637bfb4 tempest-VolumesListTestJSON-656810188 None] Lock "cinder-affa6670-8f78-46de-a075-cf1bf2849bf5-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:25:32 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-1ee21991-3515-486b-8d7e-88a91637bfb4 tempest-VolumesListTestJSON-656810188 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:25:32 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-1ee21991-3515-486b-8d7e-88a91637bfb4 tempest-VolumesListTestJSON-656810188 None] Acquiring lock "cinder-quobyte-affa6670-8f78-46de-a075-cf1bf2849bf5" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:25:32 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-1ee21991-3515-486b-8d7e-88a91637bfb4 tempest-VolumesListTestJSON-656810188 None] Lock "cinder-quobyte-affa6670-8f78-46de-a075-cf1bf2849bf5" acquired by "delete_volume" :: waited 0.015s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:25:32 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[c837bfd4-1d18-4570-b13d-7884a4405a1d]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:25:32 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1ee21991-3515-486b-8d7e-88a91637bfb4 tempest-VolumesListTestJSON-656810188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-affa6670-8f78-46de-a075-cf1bf2849bf5 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:25:33 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1ee21991-3515-486b-8d7e-88a91637bfb4 tempest-VolumesListTestJSON-656810188 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-affa6670-8f78-46de-a075-cf1bf2849bf5" returned: 0 in 0.623s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:25:33 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1ee21991-3515-486b-8d7e-88a91637bfb4 tempest-VolumesListTestJSON-656810188 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-affa6670-8f78-46de-a075-cf1bf2849bf5 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:25:33 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1ee21991-3515-486b-8d7e-88a91637bfb4 tempest-VolumesListTestJSON-656810188 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-affa6670-8f78-46de-a075-cf1bf2849bf5" returned: 0 in 0.171s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:25:33 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-1ee21991-3515-486b-8d7e-88a91637bfb4 tempest-VolumesListTestJSON-656810188 None] Lock "cinder-quobyte-affa6670-8f78-46de-a075-cf1bf2849bf5" released by "delete_volume" :: held 1.067s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:25:33 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-1ee21991-3515-486b-8d7e-88a91637bfb4 tempest-VolumesListTestJSON-656810188 None] Created reservations ['765f4fe8-843f-4419-95fe-f35f3546d71d', '6584509a-7ce2-4c04-80bc-df188c5d6843', '790088eb-8374-47d9-85ac-6c34a26656a0', 'e4ef02a6-d7a8-4c78-b417-24ffa32797ee'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:25:34 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-1ee21991-3515-486b-8d7e-88a91637bfb4 tempest-VolumesListTestJSON-656810188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:25:34 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-1ee21991-3515-486b-8d7e-88a91637bfb4 tempest-VolumesListTestJSON-656810188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:25:34 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-1ee21991-3515-486b-8d7e-88a91637bfb4 tempest-VolumesListTestJSON-656810188 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:25:34 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-1ee21991-3515-486b-8d7e-88a91637bfb4 tempest-VolumesListTestJSON-656810188 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:25:34 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-1ee21991-3515-486b-8d7e-88a91637bfb4 tempest-VolumesListTestJSON-656810188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:25:34 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1ee21991-3515-486b-8d7e-88a91637bfb4 tempest-VolumesListTestJSON-656810188 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:25:34 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1ee21991-3515-486b-8d7e-88a91637bfb4 tempest-VolumesListTestJSON-656810188 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.161s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:25:34 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-1ee21991-3515-486b-8d7e-88a91637bfb4 tempest-VolumesListTestJSON-656810188 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:25:34 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-1ee21991-3515-486b-8d7e-88a91637bfb4 tempest-VolumesListTestJSON-656810188 None] Deleted volume successfully. Sep 10 21:25:35 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-fa2fa8fb-20ea-4ad2-a83d-ea83d99a2cf0 tempest-VolumesListTestJSON-656810188 None] Acquiring lock "cinder-7af1190b-84c0-4cc3-98d0-f039225564b2-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:25:35 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-1ee21991-3515-486b-8d7e-88a91637bfb4 tempest-VolumesListTestJSON-656810188 None] Lock "cinder-affa6670-8f78-46de-a075-cf1bf2849bf5-delete_volume" released by "delete_volume" :: held 2.754s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:25:35 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-fa2fa8fb-20ea-4ad2-a83d-ea83d99a2cf0 tempest-VolumesListTestJSON-656810188 None] Lock "cinder-7af1190b-84c0-4cc3-98d0-f039225564b2-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:25:35 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-fa2fa8fb-20ea-4ad2-a83d-ea83d99a2cf0 tempest-VolumesListTestJSON-656810188 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:25:35 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-fa2fa8fb-20ea-4ad2-a83d-ea83d99a2cf0 tempest-VolumesListTestJSON-656810188 None] Acquiring lock "cinder-quobyte-7af1190b-84c0-4cc3-98d0-f039225564b2" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:25:35 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-fa2fa8fb-20ea-4ad2-a83d-ea83d99a2cf0 tempest-VolumesListTestJSON-656810188 None] Lock "cinder-quobyte-7af1190b-84c0-4cc3-98d0-f039225564b2" acquired by "delete_volume" :: waited 0.027s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:25:35 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88c38a8-eb54-42d8-a14d-4bc1dc44d317]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:25:35 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-fa2fa8fb-20ea-4ad2-a83d-ea83d99a2cf0 tempest-VolumesListTestJSON-656810188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-7af1190b-84c0-4cc3-98d0-f039225564b2 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:25:36 devstack quobyte-client[82807]: System call of process 94751 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:25:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-fa2fa8fb-20ea-4ad2-a83d-ea83d99a2cf0 tempest-VolumesListTestJSON-656810188 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-7af1190b-84c0-4cc3-98d0-f039225564b2" returned: 0 in 0.789s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:25:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-fa2fa8fb-20ea-4ad2-a83d-ea83d99a2cf0 tempest-VolumesListTestJSON-656810188 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-7af1190b-84c0-4cc3-98d0-f039225564b2 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:25:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-fa2fa8fb-20ea-4ad2-a83d-ea83d99a2cf0 tempest-VolumesListTestJSON-656810188 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-7af1190b-84c0-4cc3-98d0-f039225564b2" returned: 0 in 0.184s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:25:36 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-fa2fa8fb-20ea-4ad2-a83d-ea83d99a2cf0 tempest-VolumesListTestJSON-656810188 None] Lock "cinder-quobyte-7af1190b-84c0-4cc3-98d0-f039225564b2" released by "delete_volume" :: held 1.270s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:25:37 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-fa2fa8fb-20ea-4ad2-a83d-ea83d99a2cf0 tempest-VolumesListTestJSON-656810188 None] Created reservations ['36f73e79-e23f-498d-812d-6a026b8628b2', '4ea53155-3616-49c9-9a8d-f82ecd6cdfc5', '660cbce0-11e9-4dfd-9219-b1a15b97d210', '22b5f556-ad03-4c36-b2f7-a0cde730726e'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:25:37 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-fa2fa8fb-20ea-4ad2-a83d-ea83d99a2cf0 tempest-VolumesListTestJSON-656810188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:25:37 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-fa2fa8fb-20ea-4ad2-a83d-ea83d99a2cf0 tempest-VolumesListTestJSON-656810188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:25:37 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-fa2fa8fb-20ea-4ad2-a83d-ea83d99a2cf0 tempest-VolumesListTestJSON-656810188 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:25:37 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-fa2fa8fb-20ea-4ad2-a83d-ea83d99a2cf0 tempest-VolumesListTestJSON-656810188 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:25:37 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-fa2fa8fb-20ea-4ad2-a83d-ea83d99a2cf0 tempest-VolumesListTestJSON-656810188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:25:37 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-fa2fa8fb-20ea-4ad2-a83d-ea83d99a2cf0 tempest-VolumesListTestJSON-656810188 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:25:37 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-fa2fa8fb-20ea-4ad2-a83d-ea83d99a2cf0 tempest-VolumesListTestJSON-656810188 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.172s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:25:37 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-fa2fa8fb-20ea-4ad2-a83d-ea83d99a2cf0 tempest-VolumesListTestJSON-656810188 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:25:37 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-fa2fa8fb-20ea-4ad2-a83d-ea83d99a2cf0 tempest-VolumesListTestJSON-656810188 None] Deleted volume successfully. Sep 10 21:25:37 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-fa2fa8fb-20ea-4ad2-a83d-ea83d99a2cf0 tempest-VolumesListTestJSON-656810188 None] Lock "cinder-7af1190b-84c0-4cc3-98d0-f039225564b2-delete_volume" released by "delete_volume" :: held 2.796s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:25:47 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=36,cinder:INSERT=14,cinder:UPDATE=49,cinder:DELETE=4 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:25:47 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=28,cinder:INSERT=19,cinder:UPDATE=45,cinder:DELETE=4 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:25:56 devstack cinder-volume[82780]: DEBUG oslo_service.periodic_task [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82780) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 21:25:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:25:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:25:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:25:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:25:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:25:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:25:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.335s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:25:57 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:25:59 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=1 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:25:59 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:UPDATE=1 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:26:56 devstack cinder-volume[82780]: DEBUG oslo_service.periodic_task [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82780) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 21:26:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:26:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:26:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:26:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:26:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:26:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:26:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.196s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:26:57 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:27:01 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-0fe3a3bf-4fc0-4416-a791-5ee9f2a708c8 tempest-AttachVolumeNegativeTest-1522791108 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:27:01 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fe3a3bf-4fc0-4416-a791-5ee9f2a708c8 tempest-AttachVolumeNegativeTest-1522791108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:27:01 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0fe3a3bf-4fc0-4416-a791-5ee9f2a708c8 tempest-AttachVolumeNegativeTest-1522791108 None] Flow 'volume_create_manager' (c014128f-9999-41cb-9373-45d096202e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:27:01 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0fe3a3bf-4fc0-4416-a791-5ee9f2a708c8 tempest-AttachVolumeNegativeTest-1522791108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60764e2d-df02-423c-918d-12d028b98e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:27:01 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0fe3a3bf-4fc0-4416-a791-5ee9f2a708c8 tempest-AttachVolumeNegativeTest-1522791108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60764e2d-df02-423c-918d-12d028b98e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:27:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1728785626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bac9b53d-8552-4be9-82ed-ea0e06b3192a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f67174e596c41dbac7e525df5ef97ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:27:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:27:01Z,use_quota=True,user_id='db7d668e133e470890da0b1221b0b710',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:27:01 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0fe3a3bf-4fc0-4416-a791-5ee9f2a708c8 tempest-AttachVolumeNegativeTest-1522791108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa7c9f18-0b22-48fc-8e1c-fbb6c7c220d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:27:01 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0fe3a3bf-4fc0-4416-a791-5ee9f2a708c8 tempest-AttachVolumeNegativeTest-1522791108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa7c9f18-0b22-48fc-8e1c-fbb6c7c220d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:27:01 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0fe3a3bf-4fc0-4416-a791-5ee9f2a708c8 tempest-AttachVolumeNegativeTest-1522791108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (173ab585-954d-4e7a-9c9e-5b7d23077421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:27:01 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0fe3a3bf-4fc0-4416-a791-5ee9f2a708c8 tempest-AttachVolumeNegativeTest-1522791108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (173ab585-954d-4e7a-9c9e-5b7d23077421) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bac9b53d-8552-4be9-82ed-ea0e06b3192a', 'volume_name': 'volume-bac9b53d-8552-4be9-82ed-ea0e06b3192a', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:27:01 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0fe3a3bf-4fc0-4416-a791-5ee9f2a708c8 tempest-AttachVolumeNegativeTest-1522791108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90ca23f7-bbf0-404f-9824-3dd0e14371e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:27:01 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0fe3a3bf-4fc0-4416-a791-5ee9f2a708c8 tempest-AttachVolumeNegativeTest-1522791108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90ca23f7-bbf0-404f-9824-3dd0e14371e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:27:01 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0fe3a3bf-4fc0-4416-a791-5ee9f2a708c8 tempest-AttachVolumeNegativeTest-1522791108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f49c2260-1ede-4636-b129-8b9dd10216fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:27:01 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-0fe3a3bf-4fc0-4416-a791-5ee9f2a708c8 tempest-AttachVolumeNegativeTest-1522791108 None] Volume bac9b53d-8552-4be9-82ed-ea0e06b3192a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bac9b53d-8552-4be9-82ed-ea0e06b3192a', 'volume_size': 1} Sep 10 21:27:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-0fe3a3bf-4fc0-4416-a791-5ee9f2a708c8 tempest-AttachVolumeNegativeTest-1522791108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:27:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-0fe3a3bf-4fc0-4416-a791-5ee9f2a708c8 tempest-AttachVolumeNegativeTest-1522791108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:27:01 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-0fe3a3bf-4fc0-4416-a791-5ee9f2a708c8 tempest-AttachVolumeNegativeTest-1522791108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:27:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1728785626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bac9b53d-8552-4be9-82ed-ea0e06b3192a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f67174e596c41dbac7e525df5ef97ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:27:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:27:01Z,use_quota=True,user_id='db7d668e133e470890da0b1221b0b710',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:27:01 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-0fe3a3bf-4fc0-4416-a791-5ee9f2a708c8 tempest-AttachVolumeNegativeTest-1522791108 None] Creating volume bac9b53d-8552-4be9-82ed-ea0e06b3192a {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:27:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-0fe3a3bf-4fc0-4416-a791-5ee9f2a708c8 tempest-AttachVolumeNegativeTest-1522791108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:27:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-0fe3a3bf-4fc0-4416-a791-5ee9f2a708c8 tempest-AttachVolumeNegativeTest-1522791108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:27:01 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-0fe3a3bf-4fc0-4416-a791-5ee9f2a708c8 tempest-AttachVolumeNegativeTest-1522791108 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:27:01 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-0fe3a3bf-4fc0-4416-a791-5ee9f2a708c8 tempest-AttachVolumeNegativeTest-1522791108 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:27:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-0fe3a3bf-4fc0-4416-a791-5ee9f2a708c8 tempest-AttachVolumeNegativeTest-1522791108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:27:01 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-0fe3a3bf-4fc0-4416-a791-5ee9f2a708c8 tempest-AttachVolumeNegativeTest-1522791108 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:27:01 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-0fe3a3bf-4fc0-4416-a791-5ee9f2a708c8 tempest-AttachVolumeNegativeTest-1522791108 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:27:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0fe3a3bf-4fc0-4416-a791-5ee9f2a708c8 tempest-AttachVolumeNegativeTest-1522791108 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-bac9b53d-8552-4be9-82ed-ea0e06b3192a 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:27:01 devstack quobyte-client[82807]: System call of process 95098 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:27:01 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=83, name=volume-bac9b53d-8552-4be9-82ed-ea0e06b3192a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:27:02 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0fe3a3bf-4fc0-4416-a791-5ee9f2a708c8 tempest-AttachVolumeNegativeTest-1522791108 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-bac9b53d-8552-4be9-82ed-ea0e06b3192a 1073741824" returned: 0 in 0.488s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:27:02 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0fe3a3bf-4fc0-4416-a791-5ee9f2a708c8 tempest-AttachVolumeNegativeTest-1522791108 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-bac9b53d-8552-4be9-82ed-ea0e06b3192a {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:27:02 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0fe3a3bf-4fc0-4416-a791-5ee9f2a708c8 tempest-AttachVolumeNegativeTest-1522791108 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-bac9b53d-8552-4be9-82ed-ea0e06b3192a" returned: 0 in 0.142s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:27:02 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-0fe3a3bf-4fc0-4416-a791-5ee9f2a708c8 tempest-AttachVolumeNegativeTest-1522791108 None] <== create_volume: return (699ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:27:02 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-0fe3a3bf-4fc0-4416-a791-5ee9f2a708c8 tempest-AttachVolumeNegativeTest-1522791108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:27:02 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0fe3a3bf-4fc0-4416-a791-5ee9f2a708c8 tempest-AttachVolumeNegativeTest-1522791108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f49c2260-1ede-4636-b129-8b9dd10216fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bac9b53d-8552-4be9-82ed-ea0e06b3192a', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:27:02 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0fe3a3bf-4fc0-4416-a791-5ee9f2a708c8 tempest-AttachVolumeNegativeTest-1522791108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b34b7d6e-b13d-42e1-a342-ad66b21b904b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:27:02 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-0fe3a3bf-4fc0-4416-a791-5ee9f2a708c8 tempest-AttachVolumeNegativeTest-1522791108 None] Volume volume-bac9b53d-8552-4be9-82ed-ea0e06b3192a (bac9b53d-8552-4be9-82ed-ea0e06b3192a): created successfully Sep 10 21:27:02 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0fe3a3bf-4fc0-4416-a791-5ee9f2a708c8 tempest-AttachVolumeNegativeTest-1522791108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b34b7d6e-b13d-42e1-a342-ad66b21b904b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:27:02 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0fe3a3bf-4fc0-4416-a791-5ee9f2a708c8 tempest-AttachVolumeNegativeTest-1522791108 None] Flow 'volume_create_manager' (c014128f-9999-41cb-9373-45d096202e99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:27:02 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-0fe3a3bf-4fc0-4416-a791-5ee9f2a708c8 tempest-AttachVolumeNegativeTest-1522791108 None] Created volume successfully. Sep 10 21:27:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-86f065b1-ae84-4bc5-b2d2-0ffa5b8f6f5b req-4b5e152a-3fa6-44f0-ae5f-7f0dea33eaca tempest-AttachVolumeNegativeTest-1522791108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:27:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-86f065b1-ae84-4bc5-b2d2-0ffa5b8f6f5b req-4b5e152a-3fa6-44f0-ae5f-7f0dea33eaca tempest-AttachVolumeNegativeTest-1522791108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:27:07 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4f7e66-7763-4611-bc49-749594416073]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:27:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-86f065b1-ae84-4bc5-b2d2-0ffa5b8f6f5b req-4b5e152a-3fa6-44f0-ae5f-7f0dea33eaca tempest-AttachVolumeNegativeTest-1522791108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-bac9b53d-8552-4be9-82ed-ea0e06b3192a {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:27:08 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-86f065b1-ae84-4bc5-b2d2-0ffa5b8f6f5b req-4b5e152a-3fa6-44f0-ae5f-7f0dea33eaca tempest-AttachVolumeNegativeTest-1522791108 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-bac9b53d-8552-4be9-82ed-ea0e06b3192a" returned: 0 in 0.531s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:27:08 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-86f065b1-ae84-4bc5-b2d2-0ffa5b8f6f5b req-4b5e152a-3fa6-44f0-ae5f-7f0dea33eaca tempest-AttachVolumeNegativeTest-1522791108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.636s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:27:08 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-86f065b1-ae84-4bc5-b2d2-0ffa5b8f6f5b req-4b5e152a-3fa6-44f0-ae5f-7f0dea33eaca tempest-AttachVolumeNegativeTest-1522791108 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b', 'name': 'volume-bac9b53d-8552-4be9-82ed-ea0e06b3192a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bda6d483-409d-459e-b2bc-33310614f666', 'enforce_multipath': True} {{(pid=82780) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 21:27:08 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-86f065b1-ae84-4bc5-b2d2-0ffa5b8f6f5b req-4b5e152a-3fa6-44f0-ae5f-7f0dea33eaca tempest-AttachVolumeNegativeTest-1522791108 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:27:08 devstack cinder-volume[82780]: INFO cinder.volume.manager [req-86f065b1-ae84-4bc5-b2d2-0ffa5b8f6f5b req-4b5e152a-3fa6-44f0-ae5f-7f0dea33eaca tempest-AttachVolumeNegativeTest-1522791108 None] attachment_update completed successfully. Sep 10 21:27:18 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:27:18 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:UPDATE=4,cinder:SELECT=5 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:27:56 devstack cinder-volume[82780]: DEBUG oslo_service.periodic_task [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82780) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 21:27:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:27:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:27:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:27:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:27:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:27:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:27:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.206s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:27:57 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:27:59 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:28:01 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-1007b6aa-06f0-4aa2-8b91-ad4ff86fe560 tempest-TestServerVolumeAttachScenarioOldVersion-459186462 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:28:01 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-1007b6aa-06f0-4aa2-8b91-ad4ff86fe560 tempest-TestServerVolumeAttachScenarioOldVersion-459186462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:28:01 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1007b6aa-06f0-4aa2-8b91-ad4ff86fe560 tempest-TestServerVolumeAttachScenarioOldVersion-459186462 None] Flow 'volume_create_manager' (c29f54ec-3f14-4db1-8cea-625483bb90c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:28:01 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1007b6aa-06f0-4aa2-8b91-ad4ff86fe560 tempest-TestServerVolumeAttachScenarioOldVersion-459186462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56c00cd4-cc73-42aa-ba0f-08aaa179bef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:28:01 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1007b6aa-06f0-4aa2-8b91-ad4ff86fe560 tempest-TestServerVolumeAttachScenarioOldVersion-459186462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56c00cd4-cc73-42aa-ba0f-08aaa179bef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:28:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-457724030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=342189fd-3857-49b8-af6e-7bcbbb1cd402,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b4276c3af3e4de0b4661e2b9068553c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:28:01Z,use_quota=True,user_id='55ed61e1a8584b4d9318e0384743822e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:28:01 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1007b6aa-06f0-4aa2-8b91-ad4ff86fe560 tempest-TestServerVolumeAttachScenarioOldVersion-459186462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb5da929-068a-48b5-979c-9917e36368b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:28:01 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1007b6aa-06f0-4aa2-8b91-ad4ff86fe560 tempest-TestServerVolumeAttachScenarioOldVersion-459186462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb5da929-068a-48b5-979c-9917e36368b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:28:01 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1007b6aa-06f0-4aa2-8b91-ad4ff86fe560 tempest-TestServerVolumeAttachScenarioOldVersion-459186462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bd70f5c-7015-4ce2-a5cb-d8d680ab769d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:28:01 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1007b6aa-06f0-4aa2-8b91-ad4ff86fe560 tempest-TestServerVolumeAttachScenarioOldVersion-459186462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bd70f5c-7015-4ce2-a5cb-d8d680ab769d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '342189fd-3857-49b8-af6e-7bcbbb1cd402', 'volume_name': 'volume-342189fd-3857-49b8-af6e-7bcbbb1cd402', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:28:01 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1007b6aa-06f0-4aa2-8b91-ad4ff86fe560 tempest-TestServerVolumeAttachScenarioOldVersion-459186462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f60bd007-cdcc-4291-b09d-bcad2d59ddf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:28:01 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1007b6aa-06f0-4aa2-8b91-ad4ff86fe560 tempest-TestServerVolumeAttachScenarioOldVersion-459186462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f60bd007-cdcc-4291-b09d-bcad2d59ddf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:28:01 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1007b6aa-06f0-4aa2-8b91-ad4ff86fe560 tempest-TestServerVolumeAttachScenarioOldVersion-459186462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09d39eba-cd07-4c02-b81c-1f415b3632d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:28:01 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-1007b6aa-06f0-4aa2-8b91-ad4ff86fe560 tempest-TestServerVolumeAttachScenarioOldVersion-459186462 None] Volume 342189fd-3857-49b8-af6e-7bcbbb1cd402: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-342189fd-3857-49b8-af6e-7bcbbb1cd402', 'volume_size': 1} Sep 10 21:28:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-1007b6aa-06f0-4aa2-8b91-ad4ff86fe560 tempest-TestServerVolumeAttachScenarioOldVersion-459186462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:28:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-1007b6aa-06f0-4aa2-8b91-ad4ff86fe560 tempest-TestServerVolumeAttachScenarioOldVersion-459186462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:28:01 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-1007b6aa-06f0-4aa2-8b91-ad4ff86fe560 tempest-TestServerVolumeAttachScenarioOldVersion-459186462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:28:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-457724030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=342189fd-3857-49b8-af6e-7bcbbb1cd402,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b4276c3af3e4de0b4661e2b9068553c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:28:01Z,use_quota=True,user_id='55ed61e1a8584b4d9318e0384743822e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:28:01 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-1007b6aa-06f0-4aa2-8b91-ad4ff86fe560 tempest-TestServerVolumeAttachScenarioOldVersion-459186462 None] Creating volume 342189fd-3857-49b8-af6e-7bcbbb1cd402 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:28:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-1007b6aa-06f0-4aa2-8b91-ad4ff86fe560 tempest-TestServerVolumeAttachScenarioOldVersion-459186462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:28:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-1007b6aa-06f0-4aa2-8b91-ad4ff86fe560 tempest-TestServerVolumeAttachScenarioOldVersion-459186462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:28:01 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-1007b6aa-06f0-4aa2-8b91-ad4ff86fe560 tempest-TestServerVolumeAttachScenarioOldVersion-459186462 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:28:01 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-1007b6aa-06f0-4aa2-8b91-ad4ff86fe560 tempest-TestServerVolumeAttachScenarioOldVersion-459186462 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:28:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-1007b6aa-06f0-4aa2-8b91-ad4ff86fe560 tempest-TestServerVolumeAttachScenarioOldVersion-459186462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:28:01 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-1007b6aa-06f0-4aa2-8b91-ad4ff86fe560 tempest-TestServerVolumeAttachScenarioOldVersion-459186462 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:28:01 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-1007b6aa-06f0-4aa2-8b91-ad4ff86fe560 tempest-TestServerVolumeAttachScenarioOldVersion-459186462 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:28:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1007b6aa-06f0-4aa2-8b91-ad4ff86fe560 tempest-TestServerVolumeAttachScenarioOldVersion-459186462 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-342189fd-3857-49b8-af6e-7bcbbb1cd402 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:28:01 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=84, name=volume-342189fd-3857-49b8-af6e-7bcbbb1cd402, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:28:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1007b6aa-06f0-4aa2-8b91-ad4ff86fe560 tempest-TestServerVolumeAttachScenarioOldVersion-459186462 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-342189fd-3857-49b8-af6e-7bcbbb1cd402 1073741824" returned: 0 in 0.529s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:28:02 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1007b6aa-06f0-4aa2-8b91-ad4ff86fe560 tempest-TestServerVolumeAttachScenarioOldVersion-459186462 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-342189fd-3857-49b8-af6e-7bcbbb1cd402 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:28:02 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1007b6aa-06f0-4aa2-8b91-ad4ff86fe560 tempest-TestServerVolumeAttachScenarioOldVersion-459186462 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-342189fd-3857-49b8-af6e-7bcbbb1cd402" returned: 0 in 0.145s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:28:02 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-1007b6aa-06f0-4aa2-8b91-ad4ff86fe560 tempest-TestServerVolumeAttachScenarioOldVersion-459186462 None] <== create_volume: return (739ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:28:02 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-1007b6aa-06f0-4aa2-8b91-ad4ff86fe560 tempest-TestServerVolumeAttachScenarioOldVersion-459186462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:28:02 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1007b6aa-06f0-4aa2-8b91-ad4ff86fe560 tempest-TestServerVolumeAttachScenarioOldVersion-459186462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09d39eba-cd07-4c02-b81c-1f415b3632d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-342189fd-3857-49b8-af6e-7bcbbb1cd402', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:28:02 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1007b6aa-06f0-4aa2-8b91-ad4ff86fe560 tempest-TestServerVolumeAttachScenarioOldVersion-459186462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c47d2e4-6dfa-4238-b9c1-9f3e0c8e3152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:28:02 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-1007b6aa-06f0-4aa2-8b91-ad4ff86fe560 tempest-TestServerVolumeAttachScenarioOldVersion-459186462 None] Volume volume-342189fd-3857-49b8-af6e-7bcbbb1cd402 (342189fd-3857-49b8-af6e-7bcbbb1cd402): created successfully Sep 10 21:28:02 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1007b6aa-06f0-4aa2-8b91-ad4ff86fe560 tempest-TestServerVolumeAttachScenarioOldVersion-459186462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c47d2e4-6dfa-4238-b9c1-9f3e0c8e3152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:28:02 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1007b6aa-06f0-4aa2-8b91-ad4ff86fe560 tempest-TestServerVolumeAttachScenarioOldVersion-459186462 None] Flow 'volume_create_manager' (c29f54ec-3f14-4db1-8cea-625483bb90c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:28:02 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-1007b6aa-06f0-4aa2-8b91-ad4ff86fe560 tempest-TestServerVolumeAttachScenarioOldVersion-459186462 None] Created volume successfully. Sep 10 21:28:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-b81adec2-aab8-412e-b8e1-0a7d554394ab req-1b0f175a-8d3f-4d2d-aeef-5ef3433d29cb tempest-TestServerVolumeAttachScenarioOldVersion-459186462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:28:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-b81adec2-aab8-412e-b8e1-0a7d554394ab req-1b0f175a-8d3f-4d2d-aeef-5ef3433d29cb tempest-TestServerVolumeAttachScenarioOldVersion-459186462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.011s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:28:07 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[46969f5a-f4ee-4b85-a6f3-57f8607792e9]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:28:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-b81adec2-aab8-412e-b8e1-0a7d554394ab req-1b0f175a-8d3f-4d2d-aeef-5ef3433d29cb tempest-TestServerVolumeAttachScenarioOldVersion-459186462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-342189fd-3857-49b8-af6e-7bcbbb1cd402 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:28:08 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-b81adec2-aab8-412e-b8e1-0a7d554394ab req-1b0f175a-8d3f-4d2d-aeef-5ef3433d29cb tempest-TestServerVolumeAttachScenarioOldVersion-459186462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-342189fd-3857-49b8-af6e-7bcbbb1cd402" returned: 0 in 0.778s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:28:08 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-b81adec2-aab8-412e-b8e1-0a7d554394ab req-1b0f175a-8d3f-4d2d-aeef-5ef3433d29cb tempest-TestServerVolumeAttachScenarioOldVersion-459186462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.907s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:28:08 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-b81adec2-aab8-412e-b8e1-0a7d554394ab req-1b0f175a-8d3f-4d2d-aeef-5ef3433d29cb tempest-TestServerVolumeAttachScenarioOldVersion-459186462 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b', 'name': 'volume-342189fd-3857-49b8-af6e-7bcbbb1cd402', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6569e441-5e91-401f-a126-26102ae03558', 'enforce_multipath': True} {{(pid=82780) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 21:28:08 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-b81adec2-aab8-412e-b8e1-0a7d554394ab req-1b0f175a-8d3f-4d2d-aeef-5ef3433d29cb tempest-TestServerVolumeAttachScenarioOldVersion-459186462 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:28:09 devstack cinder-volume[82780]: INFO cinder.volume.manager [req-b81adec2-aab8-412e-b8e1-0a7d554394ab req-1b0f175a-8d3f-4d2d-aeef-5ef3433d29cb tempest-TestServerVolumeAttachScenarioOldVersion-459186462 None] attachment_update completed successfully. Sep 10 21:28:19 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:28:19 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:UPDATE=5,cinder:DELETE=1,cinder:SELECT=6 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:28:38 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-b4e8fafa-6f81-4d25-9e1f-bfafe9f7f622 req-126bc453-2c36-4c53-9265-8a8e761a3509 tempest-TestServerVolumeAttachScenarioOldVersion-459186462 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:28:39 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-b4e8fafa-6f81-4d25-9e1f-bfafe9f7f622 req-126bc453-2c36-4c53-9265-8a8e761a3509 tempest-TestServerVolumeAttachScenarioOldVersion-459186462 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:28:39 devstack cinder-volume[82780]: INFO cinder.volume.manager [req-b4e8fafa-6f81-4d25-9e1f-bfafe9f7f622 req-126bc453-2c36-4c53-9265-8a8e761a3509 tempest-TestServerVolumeAttachScenarioOldVersion-459186462 None] Terminate volume connection completed successfully. Sep 10 21:28:39 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-b4e8fafa-6f81-4d25-9e1f-bfafe9f7f622 req-126bc453-2c36-4c53-9265-8a8e761a3509 tempest-TestServerVolumeAttachScenarioOldVersion-459186462 None] Deleting attachment 6569e441-5e91-401f-a126-26102ae03558. {{(pid=82780) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 21:28:41 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-4e72e4d9-a429-4ee1-afd4-02dfbcce66d7 tempest-TestServerVolumeAttachScenarioOldVersion-459186462 None] Acquiring lock "cinder-342189fd-3857-49b8-af6e-7bcbbb1cd402-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:28:41 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-4e72e4d9-a429-4ee1-afd4-02dfbcce66d7 tempest-TestServerVolumeAttachScenarioOldVersion-459186462 None] Lock "cinder-342189fd-3857-49b8-af6e-7bcbbb1cd402-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:28:41 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-4e72e4d9-a429-4ee1-afd4-02dfbcce66d7 tempest-TestServerVolumeAttachScenarioOldVersion-459186462 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:28:41 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-4e72e4d9-a429-4ee1-afd4-02dfbcce66d7 tempest-TestServerVolumeAttachScenarioOldVersion-459186462 None] Acquiring lock "cinder-quobyte-342189fd-3857-49b8-af6e-7bcbbb1cd402" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:28:41 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-4e72e4d9-a429-4ee1-afd4-02dfbcce66d7 tempest-TestServerVolumeAttachScenarioOldVersion-459186462 None] Lock "cinder-quobyte-342189fd-3857-49b8-af6e-7bcbbb1cd402" acquired by "delete_volume" :: waited 0.020s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:28:41 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[588550e7-f90b-4018-a1f7-fe519e394721]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:28:41 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4e72e4d9-a429-4ee1-afd4-02dfbcce66d7 tempest-TestServerVolumeAttachScenarioOldVersion-459186462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-342189fd-3857-49b8-af6e-7bcbbb1cd402 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:28:41 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4e72e4d9-a429-4ee1-afd4-02dfbcce66d7 tempest-TestServerVolumeAttachScenarioOldVersion-459186462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-342189fd-3857-49b8-af6e-7bcbbb1cd402" returned: 0 in 0.523s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:28:41 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4e72e4d9-a429-4ee1-afd4-02dfbcce66d7 tempest-TestServerVolumeAttachScenarioOldVersion-459186462 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-342189fd-3857-49b8-af6e-7bcbbb1cd402 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:28:41 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4e72e4d9-a429-4ee1-afd4-02dfbcce66d7 tempest-TestServerVolumeAttachScenarioOldVersion-459186462 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-342189fd-3857-49b8-af6e-7bcbbb1cd402" returned: 0 in 0.101s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:28:42 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-4e72e4d9-a429-4ee1-afd4-02dfbcce66d7 tempest-TestServerVolumeAttachScenarioOldVersion-459186462 None] Lock "cinder-quobyte-342189fd-3857-49b8-af6e-7bcbbb1cd402" released by "delete_volume" :: held 0.815s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:28:42 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-4e72e4d9-a429-4ee1-afd4-02dfbcce66d7 tempest-TestServerVolumeAttachScenarioOldVersion-459186462 None] Created reservations ['5ac94c3e-606c-4a01-b88d-b296b29ee46c', '50e862a2-1451-48fc-84b8-b9f18adfebd5', '7636bd5f-ee20-4f39-ac36-4fbb321e129d', '9667d548-55f9-4287-b609-a219e796d86f'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:28:42 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-4e72e4d9-a429-4ee1-afd4-02dfbcce66d7 tempest-TestServerVolumeAttachScenarioOldVersion-459186462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:28:42 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-4e72e4d9-a429-4ee1-afd4-02dfbcce66d7 tempest-TestServerVolumeAttachScenarioOldVersion-459186462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:28:42 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-4e72e4d9-a429-4ee1-afd4-02dfbcce66d7 tempest-TestServerVolumeAttachScenarioOldVersion-459186462 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:28:42 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-4e72e4d9-a429-4ee1-afd4-02dfbcce66d7 tempest-TestServerVolumeAttachScenarioOldVersion-459186462 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:28:42 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-4e72e4d9-a429-4ee1-afd4-02dfbcce66d7 tempest-TestServerVolumeAttachScenarioOldVersion-459186462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:28:42 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4e72e4d9-a429-4ee1-afd4-02dfbcce66d7 tempest-TestServerVolumeAttachScenarioOldVersion-459186462 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:28:42 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4e72e4d9-a429-4ee1-afd4-02dfbcce66d7 tempest-TestServerVolumeAttachScenarioOldVersion-459186462 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.103s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:28:42 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-4e72e4d9-a429-4ee1-afd4-02dfbcce66d7 tempest-TestServerVolumeAttachScenarioOldVersion-459186462 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:28:42 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-4e72e4d9-a429-4ee1-afd4-02dfbcce66d7 tempest-TestServerVolumeAttachScenarioOldVersion-459186462 None] Deleted volume successfully. Sep 10 21:28:42 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-4e72e4d9-a429-4ee1-afd4-02dfbcce66d7 tempest-TestServerVolumeAttachScenarioOldVersion-459186462 None] Lock "cinder-342189fd-3857-49b8-af6e-7bcbbb1cd402-delete_volume" released by "delete_volume" :: held 1.861s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:28:52 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=4,cinder:INSERT=1,cinder:UPDATE=6 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:28:52 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=8,cinder:UPDATE=10,cinder:INSERT=3,cinder:DELETE=1 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:28:56 devstack cinder-volume[82780]: DEBUG oslo_service.periodic_task [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82780) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 21:28:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:28:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:28:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:28:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:28:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:28:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:28:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.217s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:28:57 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:29:27 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-29452cf3-90b3-49d2-99d2-d4f90e193b95 req-93de70db-2ad7-43d9-b753-14c6e426ffa6 tempest-AttachVolumeNegativeTest-1522791108 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:29:27 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-29452cf3-90b3-49d2-99d2-d4f90e193b95 req-93de70db-2ad7-43d9-b753-14c6e426ffa6 tempest-AttachVolumeNegativeTest-1522791108 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:29:27 devstack cinder-volume[82780]: INFO cinder.volume.manager [req-29452cf3-90b3-49d2-99d2-d4f90e193b95 req-93de70db-2ad7-43d9-b753-14c6e426ffa6 tempest-AttachVolumeNegativeTest-1522791108 None] Terminate volume connection completed successfully. Sep 10 21:29:27 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-29452cf3-90b3-49d2-99d2-d4f90e193b95 req-93de70db-2ad7-43d9-b753-14c6e426ffa6 tempest-AttachVolumeNegativeTest-1522791108 None] Deleting attachment bda6d483-409d-459e-b2bc-33310614f666. {{(pid=82780) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 21:29:37 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=1 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:29:37 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=1 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:29:48 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-6c57b9b1-24f4-4f31-b65c-829f77b32675 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:29:48 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c57b9b1-24f4-4f31-b65c-829f77b32675 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:29:48 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-6c57b9b1-24f4-4f31-b65c-829f77b32675 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Flow 'volume_create_manager' (fd076605-a441-4b97-bcdf-a7e87206ab61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:29:48 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-6c57b9b1-24f4-4f31-b65c-829f77b32675 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4326ee40-3620-4be0-a6f3-3d973959b6c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:29:48 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-6c57b9b1-24f4-4f31-b65c-829f77b32675 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4326ee40-3620-4be0-a6f3-3d973959b6c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:29:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-928276896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=239b579d-2e5f-4b1c-bc73-d527af4eab46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b497184abf24858ae59c1efc62cd84f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:29:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:29:48Z,use_quota=True,user_id='278575583e434d53b303a4a68c387350',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:29:48 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-6c57b9b1-24f4-4f31-b65c-829f77b32675 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ad05a0c-60e4-4d8f-8c6e-038f9f793611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:29:48 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-6c57b9b1-24f4-4f31-b65c-829f77b32675 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ad05a0c-60e4-4d8f-8c6e-038f9f793611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:29:48 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-6c57b9b1-24f4-4f31-b65c-829f77b32675 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc0cb2de-2a1e-461d-88a6-169f5fdf24ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:29:48 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-6c57b9b1-24f4-4f31-b65c-829f77b32675 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc0cb2de-2a1e-461d-88a6-169f5fdf24ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '239b579d-2e5f-4b1c-bc73-d527af4eab46', 'volume_name': 'volume-239b579d-2e5f-4b1c-bc73-d527af4eab46', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:29:48 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-6c57b9b1-24f4-4f31-b65c-829f77b32675 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6028670-0159-40f2-9467-28e62f2de52c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:29:48 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-6c57b9b1-24f4-4f31-b65c-829f77b32675 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6028670-0159-40f2-9467-28e62f2de52c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:29:48 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-6c57b9b1-24f4-4f31-b65c-829f77b32675 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d620fedf-d536-4385-bfe6-e054ac133e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:29:48 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-6c57b9b1-24f4-4f31-b65c-829f77b32675 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Volume 239b579d-2e5f-4b1c-bc73-d527af4eab46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-239b579d-2e5f-4b1c-bc73-d527af4eab46', 'volume_size': 1} Sep 10 21:29:48 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-6c57b9b1-24f4-4f31-b65c-829f77b32675 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:29:48 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-6c57b9b1-24f4-4f31-b65c-829f77b32675 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:29:48 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-6c57b9b1-24f4-4f31-b65c-829f77b32675 tempest-TestServerVolumeAttachmentScenario-2014899274 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:29:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-928276896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=239b579d-2e5f-4b1c-bc73-d527af4eab46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b497184abf24858ae59c1efc62cd84f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:29:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:29:48Z,use_quota=True,user_id='278575583e434d53b303a4a68c387350',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:29:48 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-6c57b9b1-24f4-4f31-b65c-829f77b32675 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Creating volume 239b579d-2e5f-4b1c-bc73-d527af4eab46 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:29:48 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-6c57b9b1-24f4-4f31-b65c-829f77b32675 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:29:48 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-6c57b9b1-24f4-4f31-b65c-829f77b32675 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:29:48 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-6c57b9b1-24f4-4f31-b65c-829f77b32675 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:29:48 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-6c57b9b1-24f4-4f31-b65c-829f77b32675 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:29:48 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-6c57b9b1-24f4-4f31-b65c-829f77b32675 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:29:48 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-6c57b9b1-24f4-4f31-b65c-829f77b32675 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:29:48 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-6c57b9b1-24f4-4f31-b65c-829f77b32675 tempest-TestServerVolumeAttachmentScenario-2014899274 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:29:48 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-6c57b9b1-24f4-4f31-b65c-829f77b32675 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-239b579d-2e5f-4b1c-bc73-d527af4eab46 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:29:49 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=85, name=volume-239b579d-2e5f-4b1c-bc73-d527af4eab46, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:29:49 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-0b5a4a19-263b-406a-9d55-c79c60832f1f tempest-TestServerVolumeAttachmentScenario-2014899274 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:29:49 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b5a4a19-263b-406a-9d55-c79c60832f1f tempest-TestServerVolumeAttachmentScenario-2014899274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:29:49 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0b5a4a19-263b-406a-9d55-c79c60832f1f tempest-TestServerVolumeAttachmentScenario-2014899274 None] Flow 'volume_create_manager' (cb217ed0-c8b3-4fa8-9b9a-27e6bc646e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:29:49 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0b5a4a19-263b-406a-9d55-c79c60832f1f tempest-TestServerVolumeAttachmentScenario-2014899274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d23dc20b-92d1-4e04-bad3-4c58750397f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:29:49 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-6c57b9b1-24f4-4f31-b65c-829f77b32675 tempest-TestServerVolumeAttachmentScenario-2014899274 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-239b579d-2e5f-4b1c-bc73-d527af4eab46 1073741824" returned: 0 in 1.041s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:29:49 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-6c57b9b1-24f4-4f31-b65c-829f77b32675 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-239b579d-2e5f-4b1c-bc73-d527af4eab46 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:29:50 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0b5a4a19-263b-406a-9d55-c79c60832f1f tempest-TestServerVolumeAttachmentScenario-2014899274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d23dc20b-92d1-4e04-bad3-4c58750397f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:29:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-688028971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71a050d1-d18d-446c-ab24-a51ba86e6ec0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b497184abf24858ae59c1efc62cd84f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:29:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:29:49Z,use_quota=True,user_id='278575583e434d53b303a4a68c387350',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:29:50 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0b5a4a19-263b-406a-9d55-c79c60832f1f tempest-TestServerVolumeAttachmentScenario-2014899274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (843590d2-1a90-4723-9880-7329bd181fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:29:50 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0b5a4a19-263b-406a-9d55-c79c60832f1f tempest-TestServerVolumeAttachmentScenario-2014899274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (843590d2-1a90-4723-9880-7329bd181fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:29:50 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0b5a4a19-263b-406a-9d55-c79c60832f1f tempest-TestServerVolumeAttachmentScenario-2014899274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a54fd20-9fd4-4f28-9643-62654cb68d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:29:50 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0b5a4a19-263b-406a-9d55-c79c60832f1f tempest-TestServerVolumeAttachmentScenario-2014899274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a54fd20-9fd4-4f28-9643-62654cb68d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71a050d1-d18d-446c-ab24-a51ba86e6ec0', 'volume_name': 'volume-71a050d1-d18d-446c-ab24-a51ba86e6ec0', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:29:50 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0b5a4a19-263b-406a-9d55-c79c60832f1f tempest-TestServerVolumeAttachmentScenario-2014899274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95daa1ba-14c3-4d07-a4cd-2f11712cdeef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:29:50 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0b5a4a19-263b-406a-9d55-c79c60832f1f tempest-TestServerVolumeAttachmentScenario-2014899274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95daa1ba-14c3-4d07-a4cd-2f11712cdeef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:29:50 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0b5a4a19-263b-406a-9d55-c79c60832f1f tempest-TestServerVolumeAttachmentScenario-2014899274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae74a216-3d08-4e86-8de0-8f2beef5f7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:29:50 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-0b5a4a19-263b-406a-9d55-c79c60832f1f tempest-TestServerVolumeAttachmentScenario-2014899274 None] Volume 71a050d1-d18d-446c-ab24-a51ba86e6ec0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71a050d1-d18d-446c-ab24-a51ba86e6ec0', 'volume_size': 1} Sep 10 21:29:50 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-0b5a4a19-263b-406a-9d55-c79c60832f1f tempest-TestServerVolumeAttachmentScenario-2014899274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:29:50 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-6c57b9b1-24f4-4f31-b65c-829f77b32675 tempest-TestServerVolumeAttachmentScenario-2014899274 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-239b579d-2e5f-4b1c-bc73-d527af4eab46" returned: 0 in 0.773s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:29:50 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-6c57b9b1-24f4-4f31-b65c-829f77b32675 tempest-TestServerVolumeAttachmentScenario-2014899274 None] <== create_volume: return (1837ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:29:50 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-6c57b9b1-24f4-4f31-b65c-829f77b32675 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.846s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:29:50 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-0b5a4a19-263b-406a-9d55-c79c60832f1f tempest-TestServerVolumeAttachmentScenario-2014899274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.051s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:29:50 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-0b5a4a19-263b-406a-9d55-c79c60832f1f tempest-TestServerVolumeAttachmentScenario-2014899274 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:29:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-688028971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71a050d1-d18d-446c-ab24-a51ba86e6ec0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b497184abf24858ae59c1efc62cd84f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:29:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:29:49Z,use_quota=True,user_id='278575583e434d53b303a4a68c387350',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:29:50 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-0b5a4a19-263b-406a-9d55-c79c60832f1f tempest-TestServerVolumeAttachmentScenario-2014899274 None] Creating volume 71a050d1-d18d-446c-ab24-a51ba86e6ec0 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:29:50 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-0b5a4a19-263b-406a-9d55-c79c60832f1f tempest-TestServerVolumeAttachmentScenario-2014899274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:29:50 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-0b5a4a19-263b-406a-9d55-c79c60832f1f tempest-TestServerVolumeAttachmentScenario-2014899274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:29:50 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-0b5a4a19-263b-406a-9d55-c79c60832f1f tempest-TestServerVolumeAttachmentScenario-2014899274 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:29:50 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-0b5a4a19-263b-406a-9d55-c79c60832f1f tempest-TestServerVolumeAttachmentScenario-2014899274 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:29:50 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-0b5a4a19-263b-406a-9d55-c79c60832f1f tempest-TestServerVolumeAttachmentScenario-2014899274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:29:50 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-0b5a4a19-263b-406a-9d55-c79c60832f1f tempest-TestServerVolumeAttachmentScenario-2014899274 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:29:50 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-0b5a4a19-263b-406a-9d55-c79c60832f1f tempest-TestServerVolumeAttachmentScenario-2014899274 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:29:50 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0b5a4a19-263b-406a-9d55-c79c60832f1f tempest-TestServerVolumeAttachmentScenario-2014899274 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-71a050d1-d18d-446c-ab24-a51ba86e6ec0 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:29:50 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=86, name=volume-71a050d1-d18d-446c-ab24-a51ba86e6ec0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:29:51 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-6c57b9b1-24f4-4f31-b65c-829f77b32675 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d620fedf-d536-4385-bfe6-e054ac133e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-239b579d-2e5f-4b1c-bc73-d527af4eab46', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:29:51 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-6c57b9b1-24f4-4f31-b65c-829f77b32675 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1781bfe-8ac9-4a5e-bb75-2914e27eb550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:29:51 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-6c57b9b1-24f4-4f31-b65c-829f77b32675 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Volume volume-239b579d-2e5f-4b1c-bc73-d527af4eab46 (239b579d-2e5f-4b1c-bc73-d527af4eab46): created successfully Sep 10 21:29:51 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-6c57b9b1-24f4-4f31-b65c-829f77b32675 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1781bfe-8ac9-4a5e-bb75-2914e27eb550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:29:51 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-6c57b9b1-24f4-4f31-b65c-829f77b32675 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Flow 'volume_create_manager' (fd076605-a441-4b97-bcdf-a7e87206ab61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:29:51 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0b5a4a19-263b-406a-9d55-c79c60832f1f tempest-TestServerVolumeAttachmentScenario-2014899274 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-71a050d1-d18d-446c-ab24-a51ba86e6ec0 1073741824" returned: 0 in 0.765s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:29:51 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0b5a4a19-263b-406a-9d55-c79c60832f1f tempest-TestServerVolumeAttachmentScenario-2014899274 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-71a050d1-d18d-446c-ab24-a51ba86e6ec0 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:29:51 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-6c57b9b1-24f4-4f31-b65c-829f77b32675 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Created volume successfully. Sep 10 21:29:51 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-0b5a4a19-263b-406a-9d55-c79c60832f1f tempest-TestServerVolumeAttachmentScenario-2014899274 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-71a050d1-d18d-446c-ab24-a51ba86e6ec0" returned: 0 in 0.364s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:29:51 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-0b5a4a19-263b-406a-9d55-c79c60832f1f tempest-TestServerVolumeAttachmentScenario-2014899274 None] <== create_volume: return (1159ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:29:51 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-0b5a4a19-263b-406a-9d55-c79c60832f1f tempest-TestServerVolumeAttachmentScenario-2014899274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.175s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:29:51 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0b5a4a19-263b-406a-9d55-c79c60832f1f tempest-TestServerVolumeAttachmentScenario-2014899274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae74a216-3d08-4e86-8de0-8f2beef5f7c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71a050d1-d18d-446c-ab24-a51ba86e6ec0', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:29:51 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0b5a4a19-263b-406a-9d55-c79c60832f1f tempest-TestServerVolumeAttachmentScenario-2014899274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90fe40b9-168c-4c8c-9214-22d34e263123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:29:51 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-0b5a4a19-263b-406a-9d55-c79c60832f1f tempest-TestServerVolumeAttachmentScenario-2014899274 None] Volume volume-71a050d1-d18d-446c-ab24-a51ba86e6ec0 (71a050d1-d18d-446c-ab24-a51ba86e6ec0): created successfully Sep 10 21:29:51 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0b5a4a19-263b-406a-9d55-c79c60832f1f tempest-TestServerVolumeAttachmentScenario-2014899274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90fe40b9-168c-4c8c-9214-22d34e263123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:29:51 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-0b5a4a19-263b-406a-9d55-c79c60832f1f tempest-TestServerVolumeAttachmentScenario-2014899274 None] Flow 'volume_create_manager' (cb217ed0-c8b3-4fa8-9b9a-27e6bc646e1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:29:51 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-0b5a4a19-263b-406a-9d55-c79c60832f1f tempest-TestServerVolumeAttachmentScenario-2014899274 None] Created volume successfully. Sep 10 21:29:56 devstack cinder-volume[82780]: DEBUG oslo_service.periodic_task [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82780) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 21:29:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:29:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:29:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:29:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:29:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:29:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:29:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.101s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:29:57 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:30:01 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=3,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:30:02 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:30:56 devstack cinder-volume[82780]: DEBUG oslo_service.periodic_task [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82780) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 21:30:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:30:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:30:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:30:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:30:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:30:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:30:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.128s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:30:57 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:31:16 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-f679fc36-99cb-4a02-8c2f-8d8e02bc19da tempest-AttachVolumeNegativeTest-1522791108 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:31:16 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-f679fc36-99cb-4a02-8c2f-8d8e02bc19da tempest-AttachVolumeNegativeTest-1522791108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:31:16 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-f679fc36-99cb-4a02-8c2f-8d8e02bc19da tempest-AttachVolumeNegativeTest-1522791108 None] Flow 'volume_create_manager' (801f75bd-266a-45e1-93ad-a9eab6c3371e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:31:16 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-f679fc36-99cb-4a02-8c2f-8d8e02bc19da tempest-AttachVolumeNegativeTest-1522791108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f8de2f2-bab1-4eb1-acde-2e937c008800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:31:17 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-f679fc36-99cb-4a02-8c2f-8d8e02bc19da tempest-AttachVolumeNegativeTest-1522791108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f8de2f2-bab1-4eb1-acde-2e937c008800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:31:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-216396803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98fe3568-9e06-4eba-b006-c2d73e94af6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f67174e596c41dbac7e525df5ef97ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:31:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:31:17Z,use_quota=True,user_id='db7d668e133e470890da0b1221b0b710',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:31:17 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-f679fc36-99cb-4a02-8c2f-8d8e02bc19da tempest-AttachVolumeNegativeTest-1522791108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcadcc2a-354e-4a07-bafa-ac970800d843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:31:17 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-f679fc36-99cb-4a02-8c2f-8d8e02bc19da tempest-AttachVolumeNegativeTest-1522791108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcadcc2a-354e-4a07-bafa-ac970800d843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:31:17 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-f679fc36-99cb-4a02-8c2f-8d8e02bc19da tempest-AttachVolumeNegativeTest-1522791108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a324c878-0cd6-4f08-9ecf-dab4a1a65832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:31:17 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-f679fc36-99cb-4a02-8c2f-8d8e02bc19da tempest-AttachVolumeNegativeTest-1522791108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a324c878-0cd6-4f08-9ecf-dab4a1a65832) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98fe3568-9e06-4eba-b006-c2d73e94af6e', 'volume_name': 'volume-98fe3568-9e06-4eba-b006-c2d73e94af6e', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:31:17 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-f679fc36-99cb-4a02-8c2f-8d8e02bc19da tempest-AttachVolumeNegativeTest-1522791108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a62516f-82c1-49c1-83af-281b591f411f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:31:17 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-f679fc36-99cb-4a02-8c2f-8d8e02bc19da tempest-AttachVolumeNegativeTest-1522791108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a62516f-82c1-49c1-83af-281b591f411f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:31:17 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-f679fc36-99cb-4a02-8c2f-8d8e02bc19da tempest-AttachVolumeNegativeTest-1522791108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aa57172-b3af-4f3e-92da-1cfe7b66b193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:31:17 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-f679fc36-99cb-4a02-8c2f-8d8e02bc19da tempest-AttachVolumeNegativeTest-1522791108 None] Volume 98fe3568-9e06-4eba-b006-c2d73e94af6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98fe3568-9e06-4eba-b006-c2d73e94af6e', 'volume_size': 1} Sep 10 21:31:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-f679fc36-99cb-4a02-8c2f-8d8e02bc19da tempest-AttachVolumeNegativeTest-1522791108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:31:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-f679fc36-99cb-4a02-8c2f-8d8e02bc19da tempest-AttachVolumeNegativeTest-1522791108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:31:17 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-f679fc36-99cb-4a02-8c2f-8d8e02bc19da tempest-AttachVolumeNegativeTest-1522791108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:31:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-216396803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98fe3568-9e06-4eba-b006-c2d73e94af6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f67174e596c41dbac7e525df5ef97ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:31:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:31:17Z,use_quota=True,user_id='db7d668e133e470890da0b1221b0b710',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:31:17 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-f679fc36-99cb-4a02-8c2f-8d8e02bc19da tempest-AttachVolumeNegativeTest-1522791108 None] Creating volume 98fe3568-9e06-4eba-b006-c2d73e94af6e {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:31:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-f679fc36-99cb-4a02-8c2f-8d8e02bc19da tempest-AttachVolumeNegativeTest-1522791108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:31:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-f679fc36-99cb-4a02-8c2f-8d8e02bc19da tempest-AttachVolumeNegativeTest-1522791108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:31:17 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-f679fc36-99cb-4a02-8c2f-8d8e02bc19da tempest-AttachVolumeNegativeTest-1522791108 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:31:17 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-f679fc36-99cb-4a02-8c2f-8d8e02bc19da tempest-AttachVolumeNegativeTest-1522791108 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:31:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-f679fc36-99cb-4a02-8c2f-8d8e02bc19da tempest-AttachVolumeNegativeTest-1522791108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:31:17 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-f679fc36-99cb-4a02-8c2f-8d8e02bc19da tempest-AttachVolumeNegativeTest-1522791108 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:31:17 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-f679fc36-99cb-4a02-8c2f-8d8e02bc19da tempest-AttachVolumeNegativeTest-1522791108 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:31:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f679fc36-99cb-4a02-8c2f-8d8e02bc19da tempest-AttachVolumeNegativeTest-1522791108 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-98fe3568-9e06-4eba-b006-c2d73e94af6e 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:31:17 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=87, name=volume-98fe3568-9e06-4eba-b006-c2d73e94af6e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:31:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f679fc36-99cb-4a02-8c2f-8d8e02bc19da tempest-AttachVolumeNegativeTest-1522791108 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-98fe3568-9e06-4eba-b006-c2d73e94af6e 1073741824" returned: 0 in 0.611s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:31:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f679fc36-99cb-4a02-8c2f-8d8e02bc19da tempest-AttachVolumeNegativeTest-1522791108 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-98fe3568-9e06-4eba-b006-c2d73e94af6e {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:31:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f679fc36-99cb-4a02-8c2f-8d8e02bc19da tempest-AttachVolumeNegativeTest-1522791108 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-98fe3568-9e06-4eba-b006-c2d73e94af6e" returned: 0 in 0.127s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:31:17 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-f679fc36-99cb-4a02-8c2f-8d8e02bc19da tempest-AttachVolumeNegativeTest-1522791108 None] <== create_volume: return (826ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:31:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-f679fc36-99cb-4a02-8c2f-8d8e02bc19da tempest-AttachVolumeNegativeTest-1522791108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:31:18 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-f679fc36-99cb-4a02-8c2f-8d8e02bc19da tempest-AttachVolumeNegativeTest-1522791108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aa57172-b3af-4f3e-92da-1cfe7b66b193) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98fe3568-9e06-4eba-b006-c2d73e94af6e', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:31:18 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-f679fc36-99cb-4a02-8c2f-8d8e02bc19da tempest-AttachVolumeNegativeTest-1522791108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b23a60c-ea4b-4f26-a172-6dd55f0624a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:31:18 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-f679fc36-99cb-4a02-8c2f-8d8e02bc19da tempest-AttachVolumeNegativeTest-1522791108 None] Volume volume-98fe3568-9e06-4eba-b006-c2d73e94af6e (98fe3568-9e06-4eba-b006-c2d73e94af6e): created successfully Sep 10 21:31:18 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-f679fc36-99cb-4a02-8c2f-8d8e02bc19da tempest-AttachVolumeNegativeTest-1522791108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b23a60c-ea4b-4f26-a172-6dd55f0624a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:31:18 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-f679fc36-99cb-4a02-8c2f-8d8e02bc19da tempest-AttachVolumeNegativeTest-1522791108 None] Flow 'volume_create_manager' (801f75bd-266a-45e1-93ad-a9eab6c3371e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:31:18 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-f679fc36-99cb-4a02-8c2f-8d8e02bc19da tempest-AttachVolumeNegativeTest-1522791108 None] Created volume successfully. Sep 10 21:31:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-6b7198bb-a8a3-4be0-b8ed-f467d98ae521 req-88dda886-be38-43d0-b663-1df99dedbf06 tempest-AttachVolumeNegativeTest-1522791108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:31:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-6b7198bb-a8a3-4be0-b8ed-f467d98ae521 req-88dda886-be38-43d0-b663-1df99dedbf06 tempest-AttachVolumeNegativeTest-1522791108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:31:24 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[5326c05f-d60f-47d4-b328-a188ec790dc9]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:31:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-6b7198bb-a8a3-4be0-b8ed-f467d98ae521 req-88dda886-be38-43d0-b663-1df99dedbf06 tempest-AttachVolumeNegativeTest-1522791108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-98fe3568-9e06-4eba-b006-c2d73e94af6e {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:31:25 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-6b7198bb-a8a3-4be0-b8ed-f467d98ae521 req-88dda886-be38-43d0-b663-1df99dedbf06 tempest-AttachVolumeNegativeTest-1522791108 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-98fe3568-9e06-4eba-b006-c2d73e94af6e" returned: 0 in 0.520s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:31:25 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-6b7198bb-a8a3-4be0-b8ed-f467d98ae521 req-88dda886-be38-43d0-b663-1df99dedbf06 tempest-AttachVolumeNegativeTest-1522791108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.590s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:31:25 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-6b7198bb-a8a3-4be0-b8ed-f467d98ae521 req-88dda886-be38-43d0-b663-1df99dedbf06 tempest-AttachVolumeNegativeTest-1522791108 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b', 'name': 'volume-98fe3568-9e06-4eba-b006-c2d73e94af6e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '51f4aab2-1d47-4cfa-b3ff-8b3a3c992cc7', 'enforce_multipath': True} {{(pid=82780) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 21:31:25 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-6b7198bb-a8a3-4be0-b8ed-f467d98ae521 req-88dda886-be38-43d0-b663-1df99dedbf06 tempest-AttachVolumeNegativeTest-1522791108 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:31:25 devstack cinder-volume[82780]: INFO cinder.volume.manager [req-6b7198bb-a8a3-4be0-b8ed-f467d98ae521 req-88dda886-be38-43d0-b663-1df99dedbf06 tempest-AttachVolumeNegativeTest-1522791108 None] attachment_update completed successfully. Sep 10 21:31:35 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=5,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:31:35 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:UPDATE=3,cinder:SELECT=8 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:31:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-e53e79e7-b8bf-4eea-8a22-30e15e3766cc req-a8322481-23eb-4544-8765-33bcac6578e6 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:31:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-e53e79e7-b8bf-4eea-8a22-30e15e3766cc req-a8322481-23eb-4544-8765-33bcac6578e6 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:31:36 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[58205a49-3c27-4d25-965d-bf85b7e10990]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:31:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-e53e79e7-b8bf-4eea-8a22-30e15e3766cc req-a8322481-23eb-4544-8765-33bcac6578e6 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-239b579d-2e5f-4b1c-bc73-d527af4eab46 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:31:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-e53e79e7-b8bf-4eea-8a22-30e15e3766cc req-a8322481-23eb-4544-8765-33bcac6578e6 tempest-TestServerVolumeAttachmentScenario-2014899274 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-239b579d-2e5f-4b1c-bc73-d527af4eab46" returned: 0 in 0.431s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:31:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-e53e79e7-b8bf-4eea-8a22-30e15e3766cc req-a8322481-23eb-4544-8765-33bcac6578e6 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.503s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:31:37 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-e53e79e7-b8bf-4eea-8a22-30e15e3766cc req-a8322481-23eb-4544-8765-33bcac6578e6 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b', 'name': 'volume-239b579d-2e5f-4b1c-bc73-d527af4eab46', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1ed20861-38f6-4868-856a-270d2331c0c3', 'enforce_multipath': True} {{(pid=82780) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 21:31:37 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-e53e79e7-b8bf-4eea-8a22-30e15e3766cc req-a8322481-23eb-4544-8765-33bcac6578e6 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:31:37 devstack cinder-volume[82780]: INFO cinder.volume.manager [req-e53e79e7-b8bf-4eea-8a22-30e15e3766cc req-a8322481-23eb-4544-8765-33bcac6578e6 tempest-TestServerVolumeAttachmentScenario-2014899274 None] attachment_update completed successfully. Sep 10 21:31:47 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:31:47 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:31:48 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-982744d0-1cfb-439c-abac-37d684deaa56 req-77bcefc3-afe2-4975-b3bf-fc31973a2099 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:31:48 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-982744d0-1cfb-439c-abac-37d684deaa56 req-77bcefc3-afe2-4975-b3bf-fc31973a2099 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:31:48 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[91cc78ea-771a-4345-9e85-f36cd927f218]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:31:48 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-982744d0-1cfb-439c-abac-37d684deaa56 req-77bcefc3-afe2-4975-b3bf-fc31973a2099 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-71a050d1-d18d-446c-ab24-a51ba86e6ec0 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:31:49 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-982744d0-1cfb-439c-abac-37d684deaa56 req-77bcefc3-afe2-4975-b3bf-fc31973a2099 tempest-TestServerVolumeAttachmentScenario-2014899274 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-71a050d1-d18d-446c-ab24-a51ba86e6ec0" returned: 0 in 0.438s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:31:49 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-982744d0-1cfb-439c-abac-37d684deaa56 req-77bcefc3-afe2-4975-b3bf-fc31973a2099 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.491s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:31:49 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-982744d0-1cfb-439c-abac-37d684deaa56 req-77bcefc3-afe2-4975-b3bf-fc31973a2099 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b', 'name': 'volume-71a050d1-d18d-446c-ab24-a51ba86e6ec0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'aceb2a2d-7d03-4844-a203-f20041ab7bf4', 'enforce_multipath': True} {{(pid=82780) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 21:31:49 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-982744d0-1cfb-439c-abac-37d684deaa56 req-77bcefc3-afe2-4975-b3bf-fc31973a2099 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:31:49 devstack cinder-volume[82780]: INFO cinder.volume.manager [req-982744d0-1cfb-439c-abac-37d684deaa56 req-77bcefc3-afe2-4975-b3bf-fc31973a2099 tempest-TestServerVolumeAttachmentScenario-2014899274 None] attachment_update completed successfully. Sep 10 21:31:54 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-e18a9404-cb54-44e2-b971-8d49c669eb86 req-a4aeef22-849e-4949-bc0c-e08aa029dbef tempest-AttachVolumeNegativeTest-1522791108 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:31:54 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-e18a9404-cb54-44e2-b971-8d49c669eb86 req-a4aeef22-849e-4949-bc0c-e08aa029dbef tempest-AttachVolumeNegativeTest-1522791108 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:31:54 devstack cinder-volume[82780]: INFO cinder.volume.manager [req-e18a9404-cb54-44e2-b971-8d49c669eb86 req-a4aeef22-849e-4949-bc0c-e08aa029dbef tempest-AttachVolumeNegativeTest-1522791108 None] Terminate volume connection completed successfully. Sep 10 21:31:54 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-e18a9404-cb54-44e2-b971-8d49c669eb86 req-a4aeef22-849e-4949-bc0c-e08aa029dbef tempest-AttachVolumeNegativeTest-1522791108 None] Deleting attachment 51f4aab2-1d47-4cfa-b3ff-8b3a3c992cc7. {{(pid=82780) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 21:31:56 devstack cinder-volume[82780]: DEBUG oslo_service.periodic_task [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82780) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 21:31:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:31:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:31:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:31:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:31:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:31:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:31:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.224s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:31:57 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:32:04 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:32:04 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:32:18 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-81769ffc-6e89-414f-a2a1-de65e035fd2d req-a5392527-0f51-4d4e-ad3b-a7f6039603cf tempest-TestServerVolumeAttachmentScenario-2014899274 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:32:18 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-81769ffc-6e89-414f-a2a1-de65e035fd2d req-a5392527-0f51-4d4e-ad3b-a7f6039603cf tempest-TestServerVolumeAttachmentScenario-2014899274 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:32:18 devstack cinder-volume[82780]: INFO cinder.volume.manager [req-81769ffc-6e89-414f-a2a1-de65e035fd2d req-a5392527-0f51-4d4e-ad3b-a7f6039603cf tempest-TestServerVolumeAttachmentScenario-2014899274 None] Terminate volume connection completed successfully. Sep 10 21:32:18 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-81769ffc-6e89-414f-a2a1-de65e035fd2d req-a5392527-0f51-4d4e-ad3b-a7f6039603cf tempest-TestServerVolumeAttachmentScenario-2014899274 None] Deleting attachment aceb2a2d-7d03-4844-a203-f20041ab7bf4. {{(pid=82780) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 21:32:28 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=1 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:32:28 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=1 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:32:43 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-43be053d-4d53-4861-a147-f23ebbbda1ad req-31914770-f500-4ded-a586-68de1a8f8b2f tempest-TestServerVolumeAttachmentScenario-2014899274 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:32:43 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-43be053d-4d53-4861-a147-f23ebbbda1ad req-31914770-f500-4ded-a586-68de1a8f8b2f tempest-TestServerVolumeAttachmentScenario-2014899274 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:32:43 devstack cinder-volume[82780]: INFO cinder.volume.manager [req-43be053d-4d53-4861-a147-f23ebbbda1ad req-31914770-f500-4ded-a586-68de1a8f8b2f tempest-TestServerVolumeAttachmentScenario-2014899274 None] Terminate volume connection completed successfully. Sep 10 21:32:43 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-43be053d-4d53-4861-a147-f23ebbbda1ad req-31914770-f500-4ded-a586-68de1a8f8b2f tempest-TestServerVolumeAttachmentScenario-2014899274 None] Deleting attachment 1ed20861-38f6-4868-856a-270d2331c0c3. {{(pid=82780) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 21:32:53 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=2 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:32:56 devstack cinder-volume[82780]: DEBUG oslo_service.periodic_task [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82780) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 21:32:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:32:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:32:57 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:32:57 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:32:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:32:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:32:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.512s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:32:57 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:33:05 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-02df686b-d5b4-4eef-926c-46f2b0aa73e3 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Acquiring lock "cinder-71a050d1-d18d-446c-ab24-a51ba86e6ec0-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:33:05 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-02df686b-d5b4-4eef-926c-46f2b0aa73e3 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Lock "cinder-71a050d1-d18d-446c-ab24-a51ba86e6ec0-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:33:06 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-02df686b-d5b4-4eef-926c-46f2b0aa73e3 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:33:06 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-02df686b-d5b4-4eef-926c-46f2b0aa73e3 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Acquiring lock "cinder-quobyte-71a050d1-d18d-446c-ab24-a51ba86e6ec0" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:33:06 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-02df686b-d5b4-4eef-926c-46f2b0aa73e3 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Lock "cinder-quobyte-71a050d1-d18d-446c-ab24-a51ba86e6ec0" acquired by "delete_volume" :: waited 0.013s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:33:06 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0741ad-aad6-4691-93c0-8a603039abf6]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:33:06 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-02df686b-d5b4-4eef-926c-46f2b0aa73e3 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-71a050d1-d18d-446c-ab24-a51ba86e6ec0 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:33:06 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-02df686b-d5b4-4eef-926c-46f2b0aa73e3 tempest-TestServerVolumeAttachmentScenario-2014899274 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-71a050d1-d18d-446c-ab24-a51ba86e6ec0" returned: 0 in 0.455s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:33:06 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-02df686b-d5b4-4eef-926c-46f2b0aa73e3 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-71a050d1-d18d-446c-ab24-a51ba86e6ec0 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:33:06 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-02df686b-d5b4-4eef-926c-46f2b0aa73e3 tempest-TestServerVolumeAttachmentScenario-2014899274 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-71a050d1-d18d-446c-ab24-a51ba86e6ec0" returned: 0 in 0.098s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:33:06 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-02df686b-d5b4-4eef-926c-46f2b0aa73e3 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Lock "cinder-quobyte-71a050d1-d18d-446c-ab24-a51ba86e6ec0" released by "delete_volume" :: held 0.737s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:33:07 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-02df686b-d5b4-4eef-926c-46f2b0aa73e3 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Created reservations ['e41a8ca7-8e25-4b46-a21c-9498061a51e7', 'b28c9fe6-6b6a-4826-b51a-377fdda18aaa', 'b653c62d-96c0-4e6f-beac-5399e9c93795', '1fbbd3bd-069c-45ae-8491-f415e3b00998'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:33:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-02df686b-d5b4-4eef-926c-46f2b0aa73e3 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:33:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-02df686b-d5b4-4eef-926c-46f2b0aa73e3 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:33:07 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-02df686b-d5b4-4eef-926c-46f2b0aa73e3 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:33:07 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-02df686b-d5b4-4eef-926c-46f2b0aa73e3 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:33:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-02df686b-d5b4-4eef-926c-46f2b0aa73e3 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:33:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-02df686b-d5b4-4eef-926c-46f2b0aa73e3 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:33:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-02df686b-d5b4-4eef-926c-46f2b0aa73e3 tempest-TestServerVolumeAttachmentScenario-2014899274 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.151s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:33:07 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-02df686b-d5b4-4eef-926c-46f2b0aa73e3 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:33:07 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-02df686b-d5b4-4eef-926c-46f2b0aa73e3 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Deleted volume successfully. Sep 10 21:33:07 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-02df686b-d5b4-4eef-926c-46f2b0aa73e3 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Lock "cinder-71a050d1-d18d-446c-ab24-a51ba86e6ec0-delete_volume" released by "delete_volume" :: held 1.983s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:33:08 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-41448804-51bb-4922-b0a2-d10a13e23ce4 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Acquiring lock "cinder-239b579d-2e5f-4b1c-bc73-d527af4eab46-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:33:08 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-41448804-51bb-4922-b0a2-d10a13e23ce4 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Lock "cinder-239b579d-2e5f-4b1c-bc73-d527af4eab46-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:33:08 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-41448804-51bb-4922-b0a2-d10a13e23ce4 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:33:08 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-41448804-51bb-4922-b0a2-d10a13e23ce4 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Acquiring lock "cinder-quobyte-239b579d-2e5f-4b1c-bc73-d527af4eab46" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:33:08 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-41448804-51bb-4922-b0a2-d10a13e23ce4 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Lock "cinder-quobyte-239b579d-2e5f-4b1c-bc73-d527af4eab46" acquired by "delete_volume" :: waited 0.017s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:33:08 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[89630f4a-528b-4851-b490-4316d3afbe66]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:33:08 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-41448804-51bb-4922-b0a2-d10a13e23ce4 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-239b579d-2e5f-4b1c-bc73-d527af4eab46 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:33:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-41448804-51bb-4922-b0a2-d10a13e23ce4 tempest-TestServerVolumeAttachmentScenario-2014899274 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-239b579d-2e5f-4b1c-bc73-d527af4eab46" returned: 0 in 0.682s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:33:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-41448804-51bb-4922-b0a2-d10a13e23ce4 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-239b579d-2e5f-4b1c-bc73-d527af4eab46 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:33:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-41448804-51bb-4922-b0a2-d10a13e23ce4 tempest-TestServerVolumeAttachmentScenario-2014899274 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-239b579d-2e5f-4b1c-bc73-d527af4eab46" returned: 0 in 0.172s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:33:09 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-41448804-51bb-4922-b0a2-d10a13e23ce4 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Lock "cinder-quobyte-239b579d-2e5f-4b1c-bc73-d527af4eab46" released by "delete_volume" :: held 1.081s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:33:09 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-41448804-51bb-4922-b0a2-d10a13e23ce4 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Created reservations ['2641c6ee-9f77-4e21-baf2-5fc9515643cf', '2c60ed52-7415-4030-a10b-1d81a527b61a', '758ab152-b8c9-44e7-b293-fddd65b3aca9', 'fc298610-c188-4c92-8452-d3b78b421752'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:33:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-41448804-51bb-4922-b0a2-d10a13e23ce4 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:33:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-41448804-51bb-4922-b0a2-d10a13e23ce4 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:33:10 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-41448804-51bb-4922-b0a2-d10a13e23ce4 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:33:10 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-41448804-51bb-4922-b0a2-d10a13e23ce4 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:33:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-41448804-51bb-4922-b0a2-d10a13e23ce4 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:33:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-41448804-51bb-4922-b0a2-d10a13e23ce4 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:33:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-41448804-51bb-4922-b0a2-d10a13e23ce4 tempest-TestServerVolumeAttachmentScenario-2014899274 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.140s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:33:10 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-41448804-51bb-4922-b0a2-d10a13e23ce4 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:33:10 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-41448804-51bb-4922-b0a2-d10a13e23ce4 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Deleted volume successfully. Sep 10 21:33:10 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-41448804-51bb-4922-b0a2-d10a13e23ce4 tempest-TestServerVolumeAttachmentScenario-2014899274 None] Lock "cinder-239b579d-2e5f-4b1c-bc73-d527af4eab46-delete_volume" released by "delete_volume" :: held 2.389s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:33:19 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=10,cinder:UPDATE=12,cinder:INSERT=4,cinder:DELETE=1 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:33:20 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=10,cinder:UPDATE=20,cinder:INSERT=4,cinder:DELETE=1 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:33:42 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-ed555245-2609-4ce3-aee7-d09306a5f7d1 tempest-AttachVolumeNegativeTest-1522791108 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:33:42 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed555245-2609-4ce3-aee7-d09306a5f7d1 tempest-AttachVolumeNegativeTest-1522791108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:33:42 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ed555245-2609-4ce3-aee7-d09306a5f7d1 tempest-AttachVolumeNegativeTest-1522791108 None] Flow 'volume_create_manager' (170b5fa0-bb3c-4225-a446-b82b441269c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:33:42 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ed555245-2609-4ce3-aee7-d09306a5f7d1 tempest-AttachVolumeNegativeTest-1522791108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c22b84df-f1c0-4e66-a082-b0b218676880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:33:42 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ed555245-2609-4ce3-aee7-d09306a5f7d1 tempest-AttachVolumeNegativeTest-1522791108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c22b84df-f1c0-4e66-a082-b0b218676880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1488692545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdce569e-70b0-4515-a7f0-f3bd2457aecb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f67174e596c41dbac7e525df5ef97ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:33:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:33:42Z,use_quota=True,user_id='db7d668e133e470890da0b1221b0b710',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:33:42 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ed555245-2609-4ce3-aee7-d09306a5f7d1 tempest-AttachVolumeNegativeTest-1522791108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a923d0fb-11a4-4619-b3aa-61d74dd1b874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:33:42 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ed555245-2609-4ce3-aee7-d09306a5f7d1 tempest-AttachVolumeNegativeTest-1522791108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a923d0fb-11a4-4619-b3aa-61d74dd1b874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:33:42 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ed555245-2609-4ce3-aee7-d09306a5f7d1 tempest-AttachVolumeNegativeTest-1522791108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df3f8cb8-9c0f-4fb1-a604-fb2d3e018cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:33:42 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ed555245-2609-4ce3-aee7-d09306a5f7d1 tempest-AttachVolumeNegativeTest-1522791108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df3f8cb8-9c0f-4fb1-a604-fb2d3e018cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdce569e-70b0-4515-a7f0-f3bd2457aecb', 'volume_name': 'volume-bdce569e-70b0-4515-a7f0-f3bd2457aecb', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:33:42 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ed555245-2609-4ce3-aee7-d09306a5f7d1 tempest-AttachVolumeNegativeTest-1522791108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (786a8c1a-9448-487d-b4dc-58d4469a0e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:33:42 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ed555245-2609-4ce3-aee7-d09306a5f7d1 tempest-AttachVolumeNegativeTest-1522791108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (786a8c1a-9448-487d-b4dc-58d4469a0e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:33:42 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ed555245-2609-4ce3-aee7-d09306a5f7d1 tempest-AttachVolumeNegativeTest-1522791108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cce8bdda-ceea-4bbb-8c1f-a95698e816d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:33:42 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-ed555245-2609-4ce3-aee7-d09306a5f7d1 tempest-AttachVolumeNegativeTest-1522791108 None] Volume bdce569e-70b0-4515-a7f0-f3bd2457aecb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdce569e-70b0-4515-a7f0-f3bd2457aecb', 'volume_size': 1} Sep 10 21:33:42 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-ed555245-2609-4ce3-aee7-d09306a5f7d1 tempest-AttachVolumeNegativeTest-1522791108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:33:42 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-ed555245-2609-4ce3-aee7-d09306a5f7d1 tempest-AttachVolumeNegativeTest-1522791108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:33:42 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-ed555245-2609-4ce3-aee7-d09306a5f7d1 tempest-AttachVolumeNegativeTest-1522791108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1488692545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdce569e-70b0-4515-a7f0-f3bd2457aecb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f67174e596c41dbac7e525df5ef97ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:33:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:33:42Z,use_quota=True,user_id='db7d668e133e470890da0b1221b0b710',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:33:42 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-ed555245-2609-4ce3-aee7-d09306a5f7d1 tempest-AttachVolumeNegativeTest-1522791108 None] Creating volume bdce569e-70b0-4515-a7f0-f3bd2457aecb {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:33:42 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-ed555245-2609-4ce3-aee7-d09306a5f7d1 tempest-AttachVolumeNegativeTest-1522791108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:33:42 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-ed555245-2609-4ce3-aee7-d09306a5f7d1 tempest-AttachVolumeNegativeTest-1522791108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:33:42 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-ed555245-2609-4ce3-aee7-d09306a5f7d1 tempest-AttachVolumeNegativeTest-1522791108 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:33:42 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-ed555245-2609-4ce3-aee7-d09306a5f7d1 tempest-AttachVolumeNegativeTest-1522791108 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:33:42 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-ed555245-2609-4ce3-aee7-d09306a5f7d1 tempest-AttachVolumeNegativeTest-1522791108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:33:42 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-ed555245-2609-4ce3-aee7-d09306a5f7d1 tempest-AttachVolumeNegativeTest-1522791108 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:33:42 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-ed555245-2609-4ce3-aee7-d09306a5f7d1 tempest-AttachVolumeNegativeTest-1522791108 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:33:42 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ed555245-2609-4ce3-aee7-d09306a5f7d1 tempest-AttachVolumeNegativeTest-1522791108 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-bdce569e-70b0-4515-a7f0-f3bd2457aecb 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:33:42 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=88, name=volume-bdce569e-70b0-4515-a7f0-f3bd2457aecb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:33:43 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ed555245-2609-4ce3-aee7-d09306a5f7d1 tempest-AttachVolumeNegativeTest-1522791108 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-bdce569e-70b0-4515-a7f0-f3bd2457aecb 1073741824" returned: 0 in 0.639s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:33:43 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ed555245-2609-4ce3-aee7-d09306a5f7d1 tempest-AttachVolumeNegativeTest-1522791108 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-bdce569e-70b0-4515-a7f0-f3bd2457aecb {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:33:43 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ed555245-2609-4ce3-aee7-d09306a5f7d1 tempest-AttachVolumeNegativeTest-1522791108 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-bdce569e-70b0-4515-a7f0-f3bd2457aecb" returned: 0 in 0.105s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:33:43 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-ed555245-2609-4ce3-aee7-d09306a5f7d1 tempest-AttachVolumeNegativeTest-1522791108 None] <== create_volume: return (840ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:33:43 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-ed555245-2609-4ce3-aee7-d09306a5f7d1 tempest-AttachVolumeNegativeTest-1522791108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:33:43 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ed555245-2609-4ce3-aee7-d09306a5f7d1 tempest-AttachVolumeNegativeTest-1522791108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cce8bdda-ceea-4bbb-8c1f-a95698e816d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdce569e-70b0-4515-a7f0-f3bd2457aecb', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:33:43 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ed555245-2609-4ce3-aee7-d09306a5f7d1 tempest-AttachVolumeNegativeTest-1522791108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8aec679f-d3ce-47dc-99ff-a2b87e59d075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:33:43 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-ed555245-2609-4ce3-aee7-d09306a5f7d1 tempest-AttachVolumeNegativeTest-1522791108 None] Volume volume-bdce569e-70b0-4515-a7f0-f3bd2457aecb (bdce569e-70b0-4515-a7f0-f3bd2457aecb): created successfully Sep 10 21:33:43 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ed555245-2609-4ce3-aee7-d09306a5f7d1 tempest-AttachVolumeNegativeTest-1522791108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8aec679f-d3ce-47dc-99ff-a2b87e59d075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:33:43 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ed555245-2609-4ce3-aee7-d09306a5f7d1 tempest-AttachVolumeNegativeTest-1522791108 None] Flow 'volume_create_manager' (170b5fa0-bb3c-4225-a446-b82b441269c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:33:43 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-ed555245-2609-4ce3-aee7-d09306a5f7d1 tempest-AttachVolumeNegativeTest-1522791108 None] Created volume successfully. Sep 10 21:33:48 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-b43b3278-7f91-4f16-8775-5cd8580ab699 req-ca8d04db-96ff-4fb7-b190-38439b6eed5d tempest-AttachVolumeNegativeTest-1522791108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:33:48 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-b43b3278-7f91-4f16-8775-5cd8580ab699 req-ca8d04db-96ff-4fb7-b190-38439b6eed5d tempest-AttachVolumeNegativeTest-1522791108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:33:48 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[8691c1a9-ebbc-4dca-9d9b-9d03d2eb61a8]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:33:48 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-b43b3278-7f91-4f16-8775-5cd8580ab699 req-ca8d04db-96ff-4fb7-b190-38439b6eed5d tempest-AttachVolumeNegativeTest-1522791108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-bdce569e-70b0-4515-a7f0-f3bd2457aecb {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:33:48 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-b43b3278-7f91-4f16-8775-5cd8580ab699 req-ca8d04db-96ff-4fb7-b190-38439b6eed5d tempest-AttachVolumeNegativeTest-1522791108 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-bdce569e-70b0-4515-a7f0-f3bd2457aecb" returned: 0 in 0.585s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:33:49 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-b43b3278-7f91-4f16-8775-5cd8580ab699 req-ca8d04db-96ff-4fb7-b190-38439b6eed5d tempest-AttachVolumeNegativeTest-1522791108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.725s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:33:49 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-b43b3278-7f91-4f16-8775-5cd8580ab699 req-ca8d04db-96ff-4fb7-b190-38439b6eed5d tempest-AttachVolumeNegativeTest-1522791108 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b', 'name': 'volume-bdce569e-70b0-4515-a7f0-f3bd2457aecb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9930ce80-af70-49d3-8b5f-546ca65bdda0', 'enforce_multipath': True} {{(pid=82780) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 21:33:49 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-b43b3278-7f91-4f16-8775-5cd8580ab699 req-ca8d04db-96ff-4fb7-b190-38439b6eed5d tempest-AttachVolumeNegativeTest-1522791108 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:33:49 devstack cinder-volume[82780]: INFO cinder.volume.manager [req-b43b3278-7f91-4f16-8775-5cd8580ab699 req-ca8d04db-96ff-4fb7-b190-38439b6eed5d tempest-AttachVolumeNegativeTest-1522791108 None] attachment_update completed successfully. Sep 10 21:33:56 devstack cinder-volume[82780]: DEBUG oslo_service.periodic_task [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82780) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 21:33:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:33:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:33:57 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:33:57 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:33:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:33:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:33:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.167s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:33:57 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:33:59 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:UPDATE=5,cinder:DELETE=1,cinder:SELECT=5 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:33:59 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:34:03 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-74d2d199-88eb-494e-8bbc-8add75b8d7c6 tempest-TestShelveInstance-1183991641 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:34:03 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-74d2d199-88eb-494e-8bbc-8add75b8d7c6 tempest-TestShelveInstance-1183991641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:34:03 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-74d2d199-88eb-494e-8bbc-8add75b8d7c6 tempest-TestShelveInstance-1183991641 None] Flow 'volume_create_manager' (08d7ed2f-c314-4659-871a-0453421fa97a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:34:03 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-74d2d199-88eb-494e-8bbc-8add75b8d7c6 tempest-TestShelveInstance-1183991641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2afe984-cf81-4fa3-a25b-3b45f1593e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:34:03 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-74d2d199-88eb-494e-8bbc-8add75b8d7c6 tempest-TestShelveInstance-1183991641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2afe984-cf81-4fa3-a25b-3b45f1593e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:34:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-24143491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4981e10c-be5f-49d8-9abb-009ee0cac6b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a31b1564e3747f9b852e0737ab34313',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:34:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:34:03Z,use_quota=True,user_id='006ad10bccd7488ba556f9f07f98be67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:34:03 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-74d2d199-88eb-494e-8bbc-8add75b8d7c6 tempest-TestShelveInstance-1183991641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (579474b3-e94e-4d7a-b571-a781781c7af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:34:03 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-74d2d199-88eb-494e-8bbc-8add75b8d7c6 tempest-TestShelveInstance-1183991641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (579474b3-e94e-4d7a-b571-a781781c7af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:34:03 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-74d2d199-88eb-494e-8bbc-8add75b8d7c6 tempest-TestShelveInstance-1183991641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f473a9b-3db2-4066-8bcd-c9378746e340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:34:03 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-74d2d199-88eb-494e-8bbc-8add75b8d7c6 tempest-TestShelveInstance-1183991641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f473a9b-3db2-4066-8bcd-c9378746e340) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4981e10c-be5f-49d8-9abb-009ee0cac6b6', 'volume_name': 'volume-4981e10c-be5f-49d8-9abb-009ee0cac6b6', 'volume_size': 1, 'image_id': '844acb65-e174-4c79-a335-b56b5bb82298', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2bf6d32ea4d94e048fb27411155cf2e9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '844acb65-e174-4c79-a335-b56b5bb82298', 'created_at': datetime.datetime(2025, 9, 10, 18, 53, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 18, 53, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/844acb65-e174-4c79-a335-b56b5bb82298/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:34:03 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-74d2d199-88eb-494e-8bbc-8add75b8d7c6 tempest-TestShelveInstance-1183991641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44b4e9b6-521e-4273-a338-d399a0c8240c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:34:03 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-74d2d199-88eb-494e-8bbc-8add75b8d7c6 tempest-TestShelveInstance-1183991641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44b4e9b6-521e-4273-a338-d399a0c8240c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:34:03 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-74d2d199-88eb-494e-8bbc-8add75b8d7c6 tempest-TestShelveInstance-1183991641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (844fd635-9214-44aa-9bb5-a3032bfd0894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:34:03 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-74d2d199-88eb-494e-8bbc-8add75b8d7c6 tempest-TestShelveInstance-1183991641 None] Volume 4981e10c-be5f-49d8-9abb-009ee0cac6b6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4981e10c-be5f-49d8-9abb-009ee0cac6b6', 'volume_size': 1, 'image_id': '844acb65-e174-4c79-a335-b56b5bb82298', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2bf6d32ea4d94e048fb27411155cf2e9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '844acb65-e174-4c79-a335-b56b5bb82298', 'created_at': datetime.datetime(2025, 9, 10, 18, 53, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 18, 53, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/844acb65-e174-4c79-a335-b56b5bb82298/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 10 21:34:03 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-74d2d199-88eb-494e-8bbc-8add75b8d7c6 tempest-TestShelveInstance-1183991641 None] Cloning 4981e10c-be5f-49d8-9abb-009ee0cac6b6 from image 844acb65-e174-4c79-a335-b56b5bb82298 at location (None, None). {{(pid=82780) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1083}} Sep 10 21:34:04 devstack cinder-volume[82780]: DEBUG cinder.image.image_utils [None req-74d2d199-88eb-494e-8bbc-8add75b8d7c6 tempest-TestShelveInstance-1183991641 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_844acb65-e174-4c79-a335-b56b5bb82298_7wg5dli_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82780) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 10 21:34:04 devstack cinder-volume[82780]: INFO cinder.image.image_utils [None req-74d2d199-88eb-494e-8bbc-8add75b8d7c6 tempest-TestShelveInstance-1183991641 None] Image download 20.69 MB at 20.69 MB/s Sep 10 21:34:04 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d17fb9-6a3d-4999-99d1-594d6c3b2131]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:34:04 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-74d2d199-88eb-494e-8bbc-8add75b8d7c6 tempest-TestShelveInstance-1183991641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_844acb65-e174-4c79-a335-b56b5bb82298_7wg5dli_devstack@QuobyteHD {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:34:04 devstack sudo[97763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_844acb65-e174-4c79-a335-b56b5bb82298_7wg5dli_devstack@QuobyteHD Sep 10 21:34:04 devstack sudo[97763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 21:34:06 devstack sudo[97763]: pam_unix(sudo:session): session closed for user root Sep 10 21:34:06 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-74d2d199-88eb-494e-8bbc-8add75b8d7c6 tempest-TestShelveInstance-1183991641 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_844acb65-e174-4c79-a335-b56b5bb82298_7wg5dli_devstack@QuobyteHD" returned: 0 in 2.003s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:34:06 devstack cinder-volume[82780]: DEBUG cinder.image.image_utils [None req-74d2d199-88eb-494e-8bbc-8add75b8d7c6 tempest-TestShelveInstance-1183991641 None] Temporary image 844acb65-e174-4c79-a335-b56b5bb82298 is fetched for user 006ad10bccd7488ba556f9f07f98be67. {{(pid=82780) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 10 21:34:06 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3b391f-f64f-4e7e-bed1-54c9376d40fd]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:34:06 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-74d2d199-88eb-494e-8bbc-8add75b8d7c6 tempest-TestShelveInstance-1183991641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_844acb65-e174-4c79-a335-b56b5bb82298_7wg5dli_devstack@QuobyteHD {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:34:07 devstack sudo[97768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_844acb65-e174-4c79-a335-b56b5bb82298_7wg5dli_devstack@QuobyteHD Sep 10 21:34:07 devstack sudo[97768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 21:34:08 devstack sudo[97768]: pam_unix(sudo:session): session closed for user root Sep 10 21:34:08 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-74d2d199-88eb-494e-8bbc-8add75b8d7c6 tempest-TestShelveInstance-1183991641 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_844acb65-e174-4c79-a335-b56b5bb82298_7wg5dli_devstack@QuobyteHD" returned: 0 in 1.998s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:34:08 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-74d2d199-88eb-494e-8bbc-8add75b8d7c6 tempest-TestShelveInstance-1183991641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:34:08 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-74d2d199-88eb-494e-8bbc-8add75b8d7c6 tempest-TestShelveInstance-1183991641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:34:08 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-74d2d199-88eb-494e-8bbc-8add75b8d7c6 tempest-TestShelveInstance-1183991641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:34:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-24143491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4981e10c-be5f-49d8-9abb-009ee0cac6b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a31b1564e3747f9b852e0737ab34313',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:34:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:34:03Z,use_quota=True,user_id='006ad10bccd7488ba556f9f07f98be67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:34:08 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-74d2d199-88eb-494e-8bbc-8add75b8d7c6 tempest-TestShelveInstance-1183991641 None] Creating volume 4981e10c-be5f-49d8-9abb-009ee0cac6b6 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:34:08 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-74d2d199-88eb-494e-8bbc-8add75b8d7c6 tempest-TestShelveInstance-1183991641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:34:08 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-74d2d199-88eb-494e-8bbc-8add75b8d7c6 tempest-TestShelveInstance-1183991641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:34:08 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-74d2d199-88eb-494e-8bbc-8add75b8d7c6 tempest-TestShelveInstance-1183991641 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:34:08 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-74d2d199-88eb-494e-8bbc-8add75b8d7c6 tempest-TestShelveInstance-1183991641 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:34:08 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-74d2d199-88eb-494e-8bbc-8add75b8d7c6 tempest-TestShelveInstance-1183991641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:34:08 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-74d2d199-88eb-494e-8bbc-8add75b8d7c6 tempest-TestShelveInstance-1183991641 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:34:08 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-74d2d199-88eb-494e-8bbc-8add75b8d7c6 tempest-TestShelveInstance-1183991641 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:34:08 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-74d2d199-88eb-494e-8bbc-8add75b8d7c6 tempest-TestShelveInstance-1183991641 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-4981e10c-be5f-49d8-9abb-009ee0cac6b6 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:34:09 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=89, name=volume-4981e10c-be5f-49d8-9abb-009ee0cac6b6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:34:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-74d2d199-88eb-494e-8bbc-8add75b8d7c6 tempest-TestShelveInstance-1183991641 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-4981e10c-be5f-49d8-9abb-009ee0cac6b6 1073741824" returned: 0 in 0.360s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:34:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-74d2d199-88eb-494e-8bbc-8add75b8d7c6 tempest-TestShelveInstance-1183991641 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-4981e10c-be5f-49d8-9abb-009ee0cac6b6 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:34:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-74d2d199-88eb-494e-8bbc-8add75b8d7c6 tempest-TestShelveInstance-1183991641 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-4981e10c-be5f-49d8-9abb-009ee0cac6b6" returned: 0 in 0.098s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:34:09 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-74d2d199-88eb-494e-8bbc-8add75b8d7c6 tempest-TestShelveInstance-1183991641 None] <== create_volume: return (553ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:34:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-74d2d199-88eb-494e-8bbc-8add75b8d7c6 tempest-TestShelveInstance-1183991641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.596s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:34:09 devstack cinder-volume[82780]: DEBUG cinder.volume.volume_utils [None req-74d2d199-88eb-494e-8bbc-8add75b8d7c6 tempest-TestShelveInstance-1183991641 None] Attempting download of 844acb65-e174-4c79-a335-b56b5bb82298 ((None, None)) to volume 4981e10c-be5f-49d8-9abb-009ee0cac6b6. {{(pid=82780) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 10 21:34:09 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b47b958-2d36-45a3-91bb-ac94f2552c96]: (4, 'raw') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:34:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-74d2d199-88eb-494e-8bbc-8add75b8d7c6 tempest-TestShelveInstance-1183991641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_844acb65-e174-4c79-a335-b56b5bb82298_vhpg19cn {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:34:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-74d2d199-88eb-494e-8bbc-8add75b8d7c6 tempest-TestShelveInstance-1183991641 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_844acb65-e174-4c79-a335-b56b5bb82298_vhpg19cn" returned: 0 in 0.365s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:34:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-74d2d199-88eb-494e-8bbc-8add75b8d7c6 tempest-TestShelveInstance-1183991641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_844acb65-e174-4c79-a335-b56b5bb82298_vhpg19cn {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:34:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-74d2d199-88eb-494e-8bbc-8add75b8d7c6 tempest-TestShelveInstance-1183991641 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_844acb65-e174-4c79-a335-b56b5bb82298_vhpg19cn" returned: 1 in 0.352s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:34:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-74d2d199-88eb-494e-8bbc-8add75b8d7c6 tempest-TestShelveInstance-1183991641 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_844acb65-e174-4c79-a335-b56b5bb82298_vhpg19cn' failed. Not Retrying. {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 21:34:10 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aac66f1-5740-47bb-b664-3f63f19d4382]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:34:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-74d2d199-88eb-494e-8bbc-8add75b8d7c6 tempest-TestShelveInstance-1183991641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_844acb65-e174-4c79-a335-b56b5bb82298_7wg5dli_devstack@QuobyteHD {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:34:11 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-74d2d199-88eb-494e-8bbc-8add75b8d7c6 tempest-TestShelveInstance-1183991641 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_844acb65-e174-4c79-a335-b56b5bb82298_7wg5dli_devstack@QuobyteHD" returned: 0 in 0.336s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:34:11 devstack cinder-volume[82780]: DEBUG cinder.image.image_utils [None req-74d2d199-88eb-494e-8bbc-8add75b8d7c6 tempest-TestShelveInstance-1183991641 None] 844acb65-e174-4c79-a335-b56b5bb82298 was qcow2, converting to raw {{(pid=82780) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 10 21:34:11 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-74d2d199-88eb-494e-8bbc-8add75b8d7c6 tempest-TestShelveInstance-1183991641 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_844acb65-e174-4c79-a335-b56b5bb82298_7wg5dli_devstack@QuobyteHD /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-4981e10c-be5f-49d8-9abb-009ee0cac6b6 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:34:11 devstack quobyte-client[82807]: System call of process 97809 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:34:11 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=89, name=volume-4981e10c-be5f-49d8-9abb-009ee0cac6b6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:34:12 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-74d2d199-88eb-494e-8bbc-8add75b8d7c6 tempest-TestShelveInstance-1183991641 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_844acb65-e174-4c79-a335-b56b5bb82298_7wg5dli_devstack@QuobyteHD /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-4981e10c-be5f-49d8-9abb-009ee0cac6b6" returned: 0 in 1.204s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:34:12 devstack cinder-volume[82780]: DEBUG cinder.image.image_utils [None req-74d2d199-88eb-494e-8bbc-8add75b8d7c6 tempest-TestShelveInstance-1183991641 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_844acb65-e174-4c79-a335-b56b5bb82298_7wg5dli_devstack@QuobyteHD, size 112.00 MB, duration 1.23 sec, destination /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-4981e10c-be5f-49d8-9abb-009ee0cac6b6 {{(pid=82780) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 10 21:34:12 devstack cinder-volume[82780]: INFO cinder.image.image_utils [None req-74d2d199-88eb-494e-8bbc-8add75b8d7c6 tempest-TestShelveInstance-1183991641 None] Converted 112.00 MB image at 91.40 MB/s Sep 10 21:34:12 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-74d2d199-88eb-494e-8bbc-8add75b8d7c6 tempest-TestShelveInstance-1183991641 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-4981e10c-be5f-49d8-9abb-009ee0cac6b6 1G {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:34:12 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-74d2d199-88eb-494e-8bbc-8add75b8d7c6 tempest-TestShelveInstance-1183991641 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-4981e10c-be5f-49d8-9abb-009ee0cac6b6 1G" returned: 0 in 0.125s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:34:12 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3b26b2-0659-49d9-a217-1fb56471d7bc]: (4, 'raw') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:34:12 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-74d2d199-88eb-494e-8bbc-8add75b8d7c6 tempest-TestShelveInstance-1183991641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-4981e10c-be5f-49d8-9abb-009ee0cac6b6 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:34:12 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-74d2d199-88eb-494e-8bbc-8add75b8d7c6 tempest-TestShelveInstance-1183991641 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-4981e10c-be5f-49d8-9abb-009ee0cac6b6" returned: 0 in 0.400s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:34:12 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-74d2d199-88eb-494e-8bbc-8add75b8d7c6 tempest-TestShelveInstance-1183991641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-4981e10c-be5f-49d8-9abb-009ee0cac6b6 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:34:13 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-74d2d199-88eb-494e-8bbc-8add75b8d7c6 tempest-TestShelveInstance-1183991641 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-4981e10c-be5f-49d8-9abb-009ee0cac6b6" returned: 1 in 0.370s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:34:13 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-74d2d199-88eb-494e-8bbc-8add75b8d7c6 tempest-TestShelveInstance-1183991641 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-4981e10c-be5f-49d8-9abb-009ee0cac6b6' failed. Not Retrying. {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 21:34:13 devstack cinder-volume[82780]: DEBUG cinder.volume.volume_utils [None req-74d2d199-88eb-494e-8bbc-8add75b8d7c6 tempest-TestShelveInstance-1183991641 None] Downloaded image 844acb65-e174-4c79-a335-b56b5bb82298 ((None, None)) to volume 4981e10c-be5f-49d8-9abb-009ee0cac6b6 successfully. {{(pid=82780) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 10 21:34:13 devstack cinder-volume[82780]: DEBUG cinder.image.image_utils [None req-74d2d199-88eb-494e-8bbc-8add75b8d7c6 tempest-TestShelveInstance-1183991641 None] Temporary image 844acb65-e174-4c79-a335-b56b5bb82298 for user 006ad10bccd7488ba556f9f07f98be67 is deleted. {{(pid=82780) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 10 21:34:13 devstack cinder-volume[82780]: DEBUG cinder.volume.volume_utils [None req-74d2d199-88eb-494e-8bbc-8add75b8d7c6 tempest-TestShelveInstance-1183991641 None] Marking volume 4981e10c-be5f-49d8-9abb-009ee0cac6b6 as bootable. {{(pid=82780) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 10 21:34:13 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-74d2d199-88eb-494e-8bbc-8add75b8d7c6 tempest-TestShelveInstance-1183991641 None] Copying metadata from image 844acb65-e174-4c79-a335-b56b5bb82298 to 4981e10c-be5f-49d8-9abb-009ee0cac6b6. {{(pid=82780) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 10 21:34:13 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-74d2d199-88eb-494e-8bbc-8add75b8d7c6 tempest-TestShelveInstance-1183991641 None] Creating volume glance metadata for volume 4981e10c-be5f-49d8-9abb-009ee0cac6b6 backed by image 844acb65-e174-4c79-a335-b56b5bb82298 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '844acb65-e174-4c79-a335-b56b5bb82298', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82780) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 10 21:34:13 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-74d2d199-88eb-494e-8bbc-8add75b8d7c6 tempest-TestShelveInstance-1183991641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (844fd635-9214-44aa-9bb5-a3032bfd0894) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4981e10c-be5f-49d8-9abb-009ee0cac6b6', 'volume_size': 1, 'image_id': '844acb65-e174-4c79-a335-b56b5bb82298', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2bf6d32ea4d94e048fb27411155cf2e9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '844acb65-e174-4c79-a335-b56b5bb82298', 'created_at': datetime.datetime(2025, 9, 10, 18, 53, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 18, 53, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/844acb65-e174-4c79-a335-b56b5bb82298/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:34:13 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-74d2d199-88eb-494e-8bbc-8add75b8d7c6 tempest-TestShelveInstance-1183991641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d53143a-a43c-4369-a8eb-284c6d4342a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:34:13 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-74d2d199-88eb-494e-8bbc-8add75b8d7c6 tempest-TestShelveInstance-1183991641 None] Volume volume-4981e10c-be5f-49d8-9abb-009ee0cac6b6 (4981e10c-be5f-49d8-9abb-009ee0cac6b6): created successfully Sep 10 21:34:13 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-74d2d199-88eb-494e-8bbc-8add75b8d7c6 tempest-TestShelveInstance-1183991641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d53143a-a43c-4369-a8eb-284c6d4342a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:34:13 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-74d2d199-88eb-494e-8bbc-8add75b8d7c6 tempest-TestShelveInstance-1183991641 None] Flow 'volume_create_manager' (08d7ed2f-c314-4659-871a-0453421fa97a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:34:13 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-74d2d199-88eb-494e-8bbc-8add75b8d7c6 tempest-TestShelveInstance-1183991641 None] Created volume successfully. Sep 10 21:34:20 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-beab5cfc-3c88-4fad-82f7-78c6b221ed87 req-0f148e82-4e21-4e71-a2c1-640b0a28b60c tempest-AttachVolumeNegativeTest-1522791108 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:34:20 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-beab5cfc-3c88-4fad-82f7-78c6b221ed87 req-0f148e82-4e21-4e71-a2c1-640b0a28b60c tempest-AttachVolumeNegativeTest-1522791108 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:34:20 devstack cinder-volume[82780]: INFO cinder.volume.manager [req-beab5cfc-3c88-4fad-82f7-78c6b221ed87 req-0f148e82-4e21-4e71-a2c1-640b0a28b60c tempest-AttachVolumeNegativeTest-1522791108 None] Terminate volume connection completed successfully. Sep 10 21:34:20 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-beab5cfc-3c88-4fad-82f7-78c6b221ed87 req-0f148e82-4e21-4e71-a2c1-640b0a28b60c tempest-AttachVolumeNegativeTest-1522791108 None] Deleting attachment 9930ce80-af70-49d3-8b5f-546ca65bdda0. {{(pid=82780) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 21:34:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-ad27a010-fcba-40ad-baa6-a0e63dab6795 req-da90357e-d11f-4cc1-a66e-dfc83a4e5964 tempest-TestShelveInstance-1183991641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:34:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-ad27a010-fcba-40ad-baa6-a0e63dab6795 req-da90357e-d11f-4cc1-a66e-dfc83a4e5964 tempest-TestShelveInstance-1183991641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:34:23 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c85dcf6-65a6-4aff-973c-9d0438cb0589]: (4, 'raw') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:34:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-ad27a010-fcba-40ad-baa6-a0e63dab6795 req-da90357e-d11f-4cc1-a66e-dfc83a4e5964 tempest-TestShelveInstance-1183991641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-4981e10c-be5f-49d8-9abb-009ee0cac6b6 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:34:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-ad27a010-fcba-40ad-baa6-a0e63dab6795 req-da90357e-d11f-4cc1-a66e-dfc83a4e5964 tempest-TestShelveInstance-1183991641 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-4981e10c-be5f-49d8-9abb-009ee0cac6b6" returned: 0 in 0.497s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:34:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-ad27a010-fcba-40ad-baa6-a0e63dab6795 req-da90357e-d11f-4cc1-a66e-dfc83a4e5964 tempest-TestShelveInstance-1183991641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-4981e10c-be5f-49d8-9abb-009ee0cac6b6 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:34:25 devstack quobyte-client[82807]: System call of process 97841 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:34:25 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-ad27a010-fcba-40ad-baa6-a0e63dab6795 req-da90357e-d11f-4cc1-a66e-dfc83a4e5964 tempest-TestShelveInstance-1183991641 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-4981e10c-be5f-49d8-9abb-009ee0cac6b6" returned: 1 in 1.657s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:34:25 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-ad27a010-fcba-40ad-baa6-a0e63dab6795 req-da90357e-d11f-4cc1-a66e-dfc83a4e5964 tempest-TestShelveInstance-1183991641 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-4981e10c-be5f-49d8-9abb-009ee0cac6b6' failed. Not Retrying. {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 21:34:25 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-ad27a010-fcba-40ad-baa6-a0e63dab6795 req-da90357e-d11f-4cc1-a66e-dfc83a4e5964 tempest-TestShelveInstance-1183991641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.341s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:34:25 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-ad27a010-fcba-40ad-baa6-a0e63dab6795 req-da90357e-d11f-4cc1-a66e-dfc83a4e5964 tempest-TestShelveInstance-1183991641 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b', 'name': 'volume-4981e10c-be5f-49d8-9abb-009ee0cac6b6', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'da1adf93-e501-493e-a45a-86fe60548bde', 'enforce_multipath': True} {{(pid=82780) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 21:34:25 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-ad27a010-fcba-40ad-baa6-a0e63dab6795 req-da90357e-d11f-4cc1-a66e-dfc83a4e5964 tempest-TestShelveInstance-1183991641 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:34:26 devstack cinder-volume[82780]: INFO cinder.volume.manager [req-ad27a010-fcba-40ad-baa6-a0e63dab6795 req-da90357e-d11f-4cc1-a66e-dfc83a4e5964 tempest-TestShelveInstance-1183991641 None] attachment_update completed successfully. Sep 10 21:34:35 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-21b92a01-1304-449f-95c1-5e95fc77a39d tempest-AttachVolumeNegativeTest-1522791108 None] Acquiring lock "cinder-bdce569e-70b0-4515-a7f0-f3bd2457aecb-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:34:35 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-21b92a01-1304-449f-95c1-5e95fc77a39d tempest-AttachVolumeNegativeTest-1522791108 None] Lock "cinder-bdce569e-70b0-4515-a7f0-f3bd2457aecb-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:34:35 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-21b92a01-1304-449f-95c1-5e95fc77a39d tempest-AttachVolumeNegativeTest-1522791108 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:34:35 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-21b92a01-1304-449f-95c1-5e95fc77a39d tempest-AttachVolumeNegativeTest-1522791108 None] Acquiring lock "cinder-quobyte-bdce569e-70b0-4515-a7f0-f3bd2457aecb" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:34:35 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-21b92a01-1304-449f-95c1-5e95fc77a39d tempest-AttachVolumeNegativeTest-1522791108 None] Lock "cinder-quobyte-bdce569e-70b0-4515-a7f0-f3bd2457aecb" acquired by "delete_volume" :: waited 0.014s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:34:35 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc1cbe2-dcfd-46b4-a139-efbfd1b81f3a]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:34:35 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-21b92a01-1304-449f-95c1-5e95fc77a39d tempest-AttachVolumeNegativeTest-1522791108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-bdce569e-70b0-4515-a7f0-f3bd2457aecb {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:34:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-21b92a01-1304-449f-95c1-5e95fc77a39d tempest-AttachVolumeNegativeTest-1522791108 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-bdce569e-70b0-4515-a7f0-f3bd2457aecb" returned: 0 in 0.530s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:34:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-21b92a01-1304-449f-95c1-5e95fc77a39d tempest-AttachVolumeNegativeTest-1522791108 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-bdce569e-70b0-4515-a7f0-f3bd2457aecb {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:34:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-21b92a01-1304-449f-95c1-5e95fc77a39d tempest-AttachVolumeNegativeTest-1522791108 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-bdce569e-70b0-4515-a7f0-f3bd2457aecb" returned: 0 in 0.127s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:34:36 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-21b92a01-1304-449f-95c1-5e95fc77a39d tempest-AttachVolumeNegativeTest-1522791108 None] Lock "cinder-quobyte-bdce569e-70b0-4515-a7f0-f3bd2457aecb" released by "delete_volume" :: held 0.845s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:34:37 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-21b92a01-1304-449f-95c1-5e95fc77a39d tempest-AttachVolumeNegativeTest-1522791108 None] Created reservations ['fde23914-58b8-46ad-9d21-f77f5eacf57b', '8e0b376d-2b43-4b5c-931a-e75ae315dcb9', 'dc6817ec-f393-44c4-a714-20c33d7c4041', 'aa91948e-2a74-40d3-a226-1c5930010d9c'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:34:37 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-21b92a01-1304-449f-95c1-5e95fc77a39d tempest-AttachVolumeNegativeTest-1522791108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:34:37 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-21b92a01-1304-449f-95c1-5e95fc77a39d tempest-AttachVolumeNegativeTest-1522791108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:34:37 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-21b92a01-1304-449f-95c1-5e95fc77a39d tempest-AttachVolumeNegativeTest-1522791108 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:34:37 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-21b92a01-1304-449f-95c1-5e95fc77a39d tempest-AttachVolumeNegativeTest-1522791108 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:34:37 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-21b92a01-1304-449f-95c1-5e95fc77a39d tempest-AttachVolumeNegativeTest-1522791108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:34:37 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-21b92a01-1304-449f-95c1-5e95fc77a39d tempest-AttachVolumeNegativeTest-1522791108 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:34:37 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-21b92a01-1304-449f-95c1-5e95fc77a39d tempest-AttachVolumeNegativeTest-1522791108 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.095s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:34:37 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-21b92a01-1304-449f-95c1-5e95fc77a39d tempest-AttachVolumeNegativeTest-1522791108 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:34:37 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-21b92a01-1304-449f-95c1-5e95fc77a39d tempest-AttachVolumeNegativeTest-1522791108 None] Deleted volume successfully. Sep 10 21:34:38 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-21b92a01-1304-449f-95c1-5e95fc77a39d tempest-AttachVolumeNegativeTest-1522791108 None] Lock "cinder-bdce569e-70b0-4515-a7f0-f3bd2457aecb-delete_volume" released by "delete_volume" :: held 2.323s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:34:38 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-43d5185e-bc72-4cf5-803e-dccd7d6c9dba tempest-AttachVolumeNegativeTest-1522791108 None] Acquiring lock "cinder-98fe3568-9e06-4eba-b006-c2d73e94af6e-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:34:38 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-43d5185e-bc72-4cf5-803e-dccd7d6c9dba tempest-AttachVolumeNegativeTest-1522791108 None] Lock "cinder-98fe3568-9e06-4eba-b006-c2d73e94af6e-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:34:39 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-43d5185e-bc72-4cf5-803e-dccd7d6c9dba tempest-AttachVolumeNegativeTest-1522791108 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:34:39 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-43d5185e-bc72-4cf5-803e-dccd7d6c9dba tempest-AttachVolumeNegativeTest-1522791108 None] Acquiring lock "cinder-quobyte-98fe3568-9e06-4eba-b006-c2d73e94af6e" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:34:39 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-43d5185e-bc72-4cf5-803e-dccd7d6c9dba tempest-AttachVolumeNegativeTest-1522791108 None] Lock "cinder-quobyte-98fe3568-9e06-4eba-b006-c2d73e94af6e" acquired by "delete_volume" :: waited 0.079s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:34:39 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd41e49e-a868-4752-9f09-ee764ecfca90]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:34:39 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-43d5185e-bc72-4cf5-803e-dccd7d6c9dba tempest-AttachVolumeNegativeTest-1522791108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-98fe3568-9e06-4eba-b006-c2d73e94af6e {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:34:40 devstack quobyte-client[82807]: System call of process 98335 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:34:40 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-43d5185e-bc72-4cf5-803e-dccd7d6c9dba tempest-AttachVolumeNegativeTest-1522791108 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-98fe3568-9e06-4eba-b006-c2d73e94af6e" returned: 0 in 0.990s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:34:40 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-43d5185e-bc72-4cf5-803e-dccd7d6c9dba tempest-AttachVolumeNegativeTest-1522791108 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-98fe3568-9e06-4eba-b006-c2d73e94af6e {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:34:40 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-43d5185e-bc72-4cf5-803e-dccd7d6c9dba tempest-AttachVolumeNegativeTest-1522791108 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-98fe3568-9e06-4eba-b006-c2d73e94af6e" returned: 0 in 0.143s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:34:41 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-43d5185e-bc72-4cf5-803e-dccd7d6c9dba tempest-AttachVolumeNegativeTest-1522791108 None] Lock "cinder-quobyte-98fe3568-9e06-4eba-b006-c2d73e94af6e" released by "delete_volume" :: held 1.591s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:34:41 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-43d5185e-bc72-4cf5-803e-dccd7d6c9dba tempest-AttachVolumeNegativeTest-1522791108 None] Created reservations ['dac4821d-11ca-4723-b732-97f8d0dee905', 'f6547d98-68cd-49ea-8f9f-d8310a7d2ec6', 'c9db7277-091e-47d5-981e-cf12e448ca38', 'da7b0337-aae3-4a33-a905-321aaa65bf7d'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:34:41 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-43d5185e-bc72-4cf5-803e-dccd7d6c9dba tempest-AttachVolumeNegativeTest-1522791108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:34:41 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-43d5185e-bc72-4cf5-803e-dccd7d6c9dba tempest-AttachVolumeNegativeTest-1522791108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:34:41 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-43d5185e-bc72-4cf5-803e-dccd7d6c9dba tempest-AttachVolumeNegativeTest-1522791108 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:34:41 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-43d5185e-bc72-4cf5-803e-dccd7d6c9dba tempest-AttachVolumeNegativeTest-1522791108 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:34:41 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-43d5185e-bc72-4cf5-803e-dccd7d6c9dba tempest-AttachVolumeNegativeTest-1522791108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:34:41 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-43d5185e-bc72-4cf5-803e-dccd7d6c9dba tempest-AttachVolumeNegativeTest-1522791108 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:34:41 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-43d5185e-bc72-4cf5-803e-dccd7d6c9dba tempest-AttachVolumeNegativeTest-1522791108 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.197s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:34:41 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-43d5185e-bc72-4cf5-803e-dccd7d6c9dba tempest-AttachVolumeNegativeTest-1522791108 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:34:42 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-43d5185e-bc72-4cf5-803e-dccd7d6c9dba tempest-AttachVolumeNegativeTest-1522791108 None] Deleted volume successfully. Sep 10 21:34:42 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-43d5185e-bc72-4cf5-803e-dccd7d6c9dba tempest-AttachVolumeNegativeTest-1522791108 None] Lock "cinder-98fe3568-9e06-4eba-b006-c2d73e94af6e-delete_volume" released by "delete_volume" :: held 3.510s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:34:43 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-773dc394-f6bb-4bde-accf-4df6b4212ff2 tempest-AttachVolumeNegativeTest-1522791108 None] Acquiring lock "cinder-bac9b53d-8552-4be9-82ed-ea0e06b3192a-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:34:43 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-773dc394-f6bb-4bde-accf-4df6b4212ff2 tempest-AttachVolumeNegativeTest-1522791108 None] Lock "cinder-bac9b53d-8552-4be9-82ed-ea0e06b3192a-delete_volume" acquired by "delete_volume" :: waited 0.124s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:34:43 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-773dc394-f6bb-4bde-accf-4df6b4212ff2 tempest-AttachVolumeNegativeTest-1522791108 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:34:43 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-773dc394-f6bb-4bde-accf-4df6b4212ff2 tempest-AttachVolumeNegativeTest-1522791108 None] Acquiring lock "cinder-quobyte-bac9b53d-8552-4be9-82ed-ea0e06b3192a" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:34:43 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-773dc394-f6bb-4bde-accf-4df6b4212ff2 tempest-AttachVolumeNegativeTest-1522791108 None] Lock "cinder-quobyte-bac9b53d-8552-4be9-82ed-ea0e06b3192a" acquired by "delete_volume" :: waited 0.023s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:34:43 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[887afbb0-78c0-454c-8cb8-cf1e3c02e29c]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:34:43 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-773dc394-f6bb-4bde-accf-4df6b4212ff2 tempest-AttachVolumeNegativeTest-1522791108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-bac9b53d-8552-4be9-82ed-ea0e06b3192a {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:34:44 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-773dc394-f6bb-4bde-accf-4df6b4212ff2 tempest-AttachVolumeNegativeTest-1522791108 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-bac9b53d-8552-4be9-82ed-ea0e06b3192a" returned: 0 in 0.530s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:34:44 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-773dc394-f6bb-4bde-accf-4df6b4212ff2 tempest-AttachVolumeNegativeTest-1522791108 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-bac9b53d-8552-4be9-82ed-ea0e06b3192a {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:34:44 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-773dc394-f6bb-4bde-accf-4df6b4212ff2 tempest-AttachVolumeNegativeTest-1522791108 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-bac9b53d-8552-4be9-82ed-ea0e06b3192a" returned: 0 in 0.120s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:34:44 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-773dc394-f6bb-4bde-accf-4df6b4212ff2 tempest-AttachVolumeNegativeTest-1522791108 None] Lock "cinder-quobyte-bac9b53d-8552-4be9-82ed-ea0e06b3192a" released by "delete_volume" :: held 0.875s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:34:44 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-773dc394-f6bb-4bde-accf-4df6b4212ff2 tempest-AttachVolumeNegativeTest-1522791108 None] Created reservations ['f72f0c28-9716-4247-84f3-fecd4cda743a', 'ca125955-e5ca-4d66-88cc-9faea757cf8b', 'fefb1211-2a74-4449-b75b-144cfa939dd5', '55c943e9-daa6-4368-b3b2-96e5bec5fdbb'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:34:44 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-773dc394-f6bb-4bde-accf-4df6b4212ff2 tempest-AttachVolumeNegativeTest-1522791108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:34:44 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-773dc394-f6bb-4bde-accf-4df6b4212ff2 tempest-AttachVolumeNegativeTest-1522791108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:34:44 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-773dc394-f6bb-4bde-accf-4df6b4212ff2 tempest-AttachVolumeNegativeTest-1522791108 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:34:44 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-773dc394-f6bb-4bde-accf-4df6b4212ff2 tempest-AttachVolumeNegativeTest-1522791108 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:34:44 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-773dc394-f6bb-4bde-accf-4df6b4212ff2 tempest-AttachVolumeNegativeTest-1522791108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:34:44 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-773dc394-f6bb-4bde-accf-4df6b4212ff2 tempest-AttachVolumeNegativeTest-1522791108 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:34:45 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-773dc394-f6bb-4bde-accf-4df6b4212ff2 tempest-AttachVolumeNegativeTest-1522791108 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.105s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:34:45 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-773dc394-f6bb-4bde-accf-4df6b4212ff2 tempest-AttachVolumeNegativeTest-1522791108 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:34:45 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-773dc394-f6bb-4bde-accf-4df6b4212ff2 tempest-AttachVolumeNegativeTest-1522791108 None] Deleted volume successfully. Sep 10 21:34:45 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-773dc394-f6bb-4bde-accf-4df6b4212ff2 tempest-AttachVolumeNegativeTest-1522791108 None] Lock "cinder-bac9b53d-8552-4be9-82ed-ea0e06b3192a-delete_volume" released by "delete_volume" :: held 2.040s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:34:54 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=33,cinder:INSERT=19,cinder:UPDATE=30,cinder:DELETE=1 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:34:55 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=27,cinder:UPDATE=28,cinder:DELETE=3,cinder:INSERT=6 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:34:57 devstack cinder-volume[82780]: DEBUG oslo_service.periodic_task [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82780) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 21:34:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:34:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:34:57 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:34:57 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:34:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.052s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:34:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:34:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.590s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:34:57 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:35:00 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-60758852-c56b-4279-a2a2-f7134a89ffe6 req-263f2353-faf3-458b-8010-c2e664c4bc34 tempest-VolumesGetTestJSON-1590546343 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:35:00 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [req-60758852-c56b-4279-a2a2-f7134a89ffe6 req-263f2353-faf3-458b-8010-c2e664c4bc34 tempest-VolumesGetTestJSON-1590546343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:35:00 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-60758852-c56b-4279-a2a2-f7134a89ffe6 req-263f2353-faf3-458b-8010-c2e664c4bc34 tempest-VolumesGetTestJSON-1590546343 None] Flow 'volume_create_manager' (c20ac18c-0ff1-4f4e-87e2-08c3825f1f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:35:00 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-60758852-c56b-4279-a2a2-f7134a89ffe6 req-263f2353-faf3-458b-8010-c2e664c4bc34 tempest-VolumesGetTestJSON-1590546343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (207d4da8-e28d-4f25-8e28-914f8f13598a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:35:00 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-60758852-c56b-4279-a2a2-f7134a89ffe6 req-263f2353-faf3-458b-8010-c2e664c4bc34 tempest-VolumesGetTestJSON-1590546343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (207d4da8-e28d-4f25-8e28-914f8f13598a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1345882218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa55b61d-ee7e-466e-85f8-6211855d6ca6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5b3279487dae416f879d6f4bae71c24a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:35:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:35:01Z,use_quota=True,user_id='123efe83920247728fdf1a6bfc91cb08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:35:00 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-60758852-c56b-4279-a2a2-f7134a89ffe6 req-263f2353-faf3-458b-8010-c2e664c4bc34 tempest-VolumesGetTestJSON-1590546343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b930fde-0348-4814-9322-bdb909794983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:35:00 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-60758852-c56b-4279-a2a2-f7134a89ffe6 req-263f2353-faf3-458b-8010-c2e664c4bc34 tempest-VolumesGetTestJSON-1590546343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b930fde-0348-4814-9322-bdb909794983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:35:01 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-60758852-c56b-4279-a2a2-f7134a89ffe6 req-263f2353-faf3-458b-8010-c2e664c4bc34 tempest-VolumesGetTestJSON-1590546343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76641359-8967-4f81-a81b-c2367ce773a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:35:01 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-60758852-c56b-4279-a2a2-f7134a89ffe6 req-263f2353-faf3-458b-8010-c2e664c4bc34 tempest-VolumesGetTestJSON-1590546343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76641359-8967-4f81-a81b-c2367ce773a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa55b61d-ee7e-466e-85f8-6211855d6ca6', 'volume_name': 'volume-aa55b61d-ee7e-466e-85f8-6211855d6ca6', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:35:01 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-60758852-c56b-4279-a2a2-f7134a89ffe6 req-263f2353-faf3-458b-8010-c2e664c4bc34 tempest-VolumesGetTestJSON-1590546343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a171a4a-d9e8-4d41-af86-5d394be655f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:35:01 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-60758852-c56b-4279-a2a2-f7134a89ffe6 req-263f2353-faf3-458b-8010-c2e664c4bc34 tempest-VolumesGetTestJSON-1590546343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a171a4a-d9e8-4d41-af86-5d394be655f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:35:01 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-60758852-c56b-4279-a2a2-f7134a89ffe6 req-263f2353-faf3-458b-8010-c2e664c4bc34 tempest-VolumesGetTestJSON-1590546343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3198e440-d07d-472c-921b-4b64e838fa26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:35:01 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [req-60758852-c56b-4279-a2a2-f7134a89ffe6 req-263f2353-faf3-458b-8010-c2e664c4bc34 tempest-VolumesGetTestJSON-1590546343 None] Volume aa55b61d-ee7e-466e-85f8-6211855d6ca6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa55b61d-ee7e-466e-85f8-6211855d6ca6', 'volume_size': 1} Sep 10 21:35:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-60758852-c56b-4279-a2a2-f7134a89ffe6 req-263f2353-faf3-458b-8010-c2e664c4bc34 tempest-VolumesGetTestJSON-1590546343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:35:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-60758852-c56b-4279-a2a2-f7134a89ffe6 req-263f2353-faf3-458b-8010-c2e664c4bc34 tempest-VolumesGetTestJSON-1590546343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:35:01 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [req-60758852-c56b-4279-a2a2-f7134a89ffe6 req-263f2353-faf3-458b-8010-c2e664c4bc34 tempest-VolumesGetTestJSON-1590546343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1345882218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa55b61d-ee7e-466e-85f8-6211855d6ca6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5b3279487dae416f879d6f4bae71c24a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:35:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:35:01Z,use_quota=True,user_id='123efe83920247728fdf1a6bfc91cb08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:35:01 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [req-60758852-c56b-4279-a2a2-f7134a89ffe6 req-263f2353-faf3-458b-8010-c2e664c4bc34 tempest-VolumesGetTestJSON-1590546343 None] Creating volume aa55b61d-ee7e-466e-85f8-6211855d6ca6 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:35:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-60758852-c56b-4279-a2a2-f7134a89ffe6 req-263f2353-faf3-458b-8010-c2e664c4bc34 tempest-VolumesGetTestJSON-1590546343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:35:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-60758852-c56b-4279-a2a2-f7134a89ffe6 req-263f2353-faf3-458b-8010-c2e664c4bc34 tempest-VolumesGetTestJSON-1590546343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:35:01 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [req-60758852-c56b-4279-a2a2-f7134a89ffe6 req-263f2353-faf3-458b-8010-c2e664c4bc34 tempest-VolumesGetTestJSON-1590546343 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:35:01 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [req-60758852-c56b-4279-a2a2-f7134a89ffe6 req-263f2353-faf3-458b-8010-c2e664c4bc34 tempest-VolumesGetTestJSON-1590546343 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:35:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-60758852-c56b-4279-a2a2-f7134a89ffe6 req-263f2353-faf3-458b-8010-c2e664c4bc34 tempest-VolumesGetTestJSON-1590546343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:35:01 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [req-60758852-c56b-4279-a2a2-f7134a89ffe6 req-263f2353-faf3-458b-8010-c2e664c4bc34 tempest-VolumesGetTestJSON-1590546343 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:35:01 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [req-60758852-c56b-4279-a2a2-f7134a89ffe6 req-263f2353-faf3-458b-8010-c2e664c4bc34 tempest-VolumesGetTestJSON-1590546343 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:35:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-60758852-c56b-4279-a2a2-f7134a89ffe6 req-263f2353-faf3-458b-8010-c2e664c4bc34 tempest-VolumesGetTestJSON-1590546343 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-aa55b61d-ee7e-466e-85f8-6211855d6ca6 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:35:01 devstack quobyte-client[82807]: System call of process 98437 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:35:01 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=90, name=volume-aa55b61d-ee7e-466e-85f8-6211855d6ca6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:35:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-60758852-c56b-4279-a2a2-f7134a89ffe6 req-263f2353-faf3-458b-8010-c2e664c4bc34 tempest-VolumesGetTestJSON-1590546343 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-aa55b61d-ee7e-466e-85f8-6211855d6ca6 1073741824" returned: 0 in 0.419s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:35:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-60758852-c56b-4279-a2a2-f7134a89ffe6 req-263f2353-faf3-458b-8010-c2e664c4bc34 tempest-VolumesGetTestJSON-1590546343 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-aa55b61d-ee7e-466e-85f8-6211855d6ca6 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:35:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-60758852-c56b-4279-a2a2-f7134a89ffe6 req-263f2353-faf3-458b-8010-c2e664c4bc34 tempest-VolumesGetTestJSON-1590546343 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-aa55b61d-ee7e-466e-85f8-6211855d6ca6" returned: 0 in 0.146s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:35:01 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [req-60758852-c56b-4279-a2a2-f7134a89ffe6 req-263f2353-faf3-458b-8010-c2e664c4bc34 tempest-VolumesGetTestJSON-1590546343 None] <== create_volume: return (662ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:35:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-60758852-c56b-4279-a2a2-f7134a89ffe6 req-263f2353-faf3-458b-8010-c2e664c4bc34 tempest-VolumesGetTestJSON-1590546343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.679s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:35:01 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-60758852-c56b-4279-a2a2-f7134a89ffe6 req-263f2353-faf3-458b-8010-c2e664c4bc34 tempest-VolumesGetTestJSON-1590546343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3198e440-d07d-472c-921b-4b64e838fa26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa55b61d-ee7e-466e-85f8-6211855d6ca6', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:35:01 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-60758852-c56b-4279-a2a2-f7134a89ffe6 req-263f2353-faf3-458b-8010-c2e664c4bc34 tempest-VolumesGetTestJSON-1590546343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68a52089-21b5-41be-8f93-aa14c1cbad5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:35:02 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [req-60758852-c56b-4279-a2a2-f7134a89ffe6 req-263f2353-faf3-458b-8010-c2e664c4bc34 tempest-VolumesGetTestJSON-1590546343 None] Volume volume-aa55b61d-ee7e-466e-85f8-6211855d6ca6 (aa55b61d-ee7e-466e-85f8-6211855d6ca6): created successfully Sep 10 21:35:02 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-60758852-c56b-4279-a2a2-f7134a89ffe6 req-263f2353-faf3-458b-8010-c2e664c4bc34 tempest-VolumesGetTestJSON-1590546343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68a52089-21b5-41be-8f93-aa14c1cbad5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:35:02 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-60758852-c56b-4279-a2a2-f7134a89ffe6 req-263f2353-faf3-458b-8010-c2e664c4bc34 tempest-VolumesGetTestJSON-1590546343 None] Flow 'volume_create_manager' (c20ac18c-0ff1-4f4e-87e2-08c3825f1f3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:35:02 devstack cinder-volume[82780]: INFO cinder.volume.manager [req-60758852-c56b-4279-a2a2-f7134a89ffe6 req-263f2353-faf3-458b-8010-c2e664c4bc34 tempest-VolumesGetTestJSON-1590546343 None] Created volume successfully. Sep 10 21:35:03 devstack cinder-volume[82780]: DEBUG cinder.coordination [req-cabef9c1-7c8d-4777-9816-46358919dcf3 req-6dc8487b-96b4-4df5-a315-90322f6316cb tempest-VolumesGetTestJSON-1590546343 None] Acquiring lock "cinder-aa55b61d-ee7e-466e-85f8-6211855d6ca6-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:35:03 devstack cinder-volume[82780]: DEBUG cinder.coordination [req-cabef9c1-7c8d-4777-9816-46358919dcf3 req-6dc8487b-96b4-4df5-a315-90322f6316cb tempest-VolumesGetTestJSON-1590546343 None] Lock "cinder-aa55b61d-ee7e-466e-85f8-6211855d6ca6-delete_volume" acquired by "delete_volume" :: waited 0.097s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:35:03 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-cabef9c1-7c8d-4777-9816-46358919dcf3 req-6dc8487b-96b4-4df5-a315-90322f6316cb tempest-VolumesGetTestJSON-1590546343 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:35:03 devstack cinder-volume[82780]: DEBUG cinder.coordination [req-cabef9c1-7c8d-4777-9816-46358919dcf3 req-6dc8487b-96b4-4df5-a315-90322f6316cb tempest-VolumesGetTestJSON-1590546343 None] Acquiring lock "cinder-quobyte-aa55b61d-ee7e-466e-85f8-6211855d6ca6" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:35:03 devstack cinder-volume[82780]: DEBUG cinder.coordination [req-cabef9c1-7c8d-4777-9816-46358919dcf3 req-6dc8487b-96b4-4df5-a315-90322f6316cb tempest-VolumesGetTestJSON-1590546343 None] Lock "cinder-quobyte-aa55b61d-ee7e-466e-85f8-6211855d6ca6" acquired by "delete_volume" :: waited 0.020s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:35:03 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b936876-bdcc-4d70-ba96-d07721cc1634]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:35:03 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-cabef9c1-7c8d-4777-9816-46358919dcf3 req-6dc8487b-96b4-4df5-a315-90322f6316cb tempest-VolumesGetTestJSON-1590546343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-aa55b61d-ee7e-466e-85f8-6211855d6ca6 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:35:04 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-cabef9c1-7c8d-4777-9816-46358919dcf3 req-6dc8487b-96b4-4df5-a315-90322f6316cb tempest-VolumesGetTestJSON-1590546343 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-aa55b61d-ee7e-466e-85f8-6211855d6ca6" returned: 0 in 0.566s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:35:04 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-cabef9c1-7c8d-4777-9816-46358919dcf3 req-6dc8487b-96b4-4df5-a315-90322f6316cb tempest-VolumesGetTestJSON-1590546343 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-aa55b61d-ee7e-466e-85f8-6211855d6ca6 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:35:04 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-cabef9c1-7c8d-4777-9816-46358919dcf3 req-6dc8487b-96b4-4df5-a315-90322f6316cb tempest-VolumesGetTestJSON-1590546343 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-aa55b61d-ee7e-466e-85f8-6211855d6ca6" returned: 0 in 0.135s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:35:04 devstack cinder-volume[82780]: DEBUG cinder.coordination [req-cabef9c1-7c8d-4777-9816-46358919dcf3 req-6dc8487b-96b4-4df5-a315-90322f6316cb tempest-VolumesGetTestJSON-1590546343 None] Lock "cinder-quobyte-aa55b61d-ee7e-466e-85f8-6211855d6ca6" released by "delete_volume" :: held 0.897s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:35:04 devstack cinder-volume[82780]: DEBUG cinder.quota [req-cabef9c1-7c8d-4777-9816-46358919dcf3 req-6dc8487b-96b4-4df5-a315-90322f6316cb tempest-VolumesGetTestJSON-1590546343 None] Created reservations ['5cd2d40b-47ad-428b-b22e-b82fa32b9beb', 'e5ceed33-e1ad-45e6-8a4e-2784792aa316', '4010569f-ac88-4bce-a6e2-eef7261fbf0a', 'ed1446b3-1f12-42c2-ac25-e454b707ca08'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:35:05 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-cabef9c1-7c8d-4777-9816-46358919dcf3 req-6dc8487b-96b4-4df5-a315-90322f6316cb tempest-VolumesGetTestJSON-1590546343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:35:05 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-cabef9c1-7c8d-4777-9816-46358919dcf3 req-6dc8487b-96b4-4df5-a315-90322f6316cb tempest-VolumesGetTestJSON-1590546343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:35:05 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [req-cabef9c1-7c8d-4777-9816-46358919dcf3 req-6dc8487b-96b4-4df5-a315-90322f6316cb tempest-VolumesGetTestJSON-1590546343 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:35:05 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [req-cabef9c1-7c8d-4777-9816-46358919dcf3 req-6dc8487b-96b4-4df5-a315-90322f6316cb tempest-VolumesGetTestJSON-1590546343 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:35:05 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-cabef9c1-7c8d-4777-9816-46358919dcf3 req-6dc8487b-96b4-4df5-a315-90322f6316cb tempest-VolumesGetTestJSON-1590546343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:35:05 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-cabef9c1-7c8d-4777-9816-46358919dcf3 req-6dc8487b-96b4-4df5-a315-90322f6316cb tempest-VolumesGetTestJSON-1590546343 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:35:05 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-cabef9c1-7c8d-4777-9816-46358919dcf3 req-6dc8487b-96b4-4df5-a315-90322f6316cb tempest-VolumesGetTestJSON-1590546343 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.106s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:35:05 devstack cinder-volume[82780]: DEBUG cinder.manager [req-cabef9c1-7c8d-4777-9816-46358919dcf3 req-6dc8487b-96b4-4df5-a315-90322f6316cb tempest-VolumesGetTestJSON-1590546343 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:35:05 devstack cinder-volume[82780]: INFO cinder.volume.manager [req-cabef9c1-7c8d-4777-9816-46358919dcf3 req-6dc8487b-96b4-4df5-a315-90322f6316cb tempest-VolumesGetTestJSON-1590546343 None] Deleted volume successfully. Sep 10 21:35:05 devstack cinder-volume[82780]: DEBUG cinder.coordination [req-cabef9c1-7c8d-4777-9816-46358919dcf3 req-6dc8487b-96b4-4df5-a315-90322f6316cb tempest-VolumesGetTestJSON-1590546343 None] Lock "cinder-aa55b61d-ee7e-466e-85f8-6211855d6ca6-delete_volume" released by "delete_volume" :: held 2.128s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:35:10 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-ec914e26-ed19-4659-bd3e-07dca7c95679 tempest-VolumesTestJSON-1131863311 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:35:10 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec914e26-ed19-4659-bd3e-07dca7c95679 tempest-VolumesTestJSON-1131863311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:35:10 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ec914e26-ed19-4659-bd3e-07dca7c95679 tempest-VolumesTestJSON-1131863311 None] Flow 'volume_create_manager' (bca4220a-bd70-4d2b-a770-167fc14c6702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:35:10 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ec914e26-ed19-4659-bd3e-07dca7c95679 tempest-VolumesTestJSON-1131863311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (805eb167-dda6-44c6-8d80-7f3c3c40a3f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:35:10 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ec914e26-ed19-4659-bd3e-07dca7c95679 tempest-VolumesTestJSON-1131863311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (805eb167-dda6-44c6-8d80-7f3c3c40a3f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:35:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-46603325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a312995-1cff-430b-9d8b-78cd93b4c72b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='946050d132bf4c5fae668b87a6c0e4cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:35:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:35:10Z,use_quota=True,user_id='96f725bfb3ab4195acf6408dcec83a2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:35:10 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ec914e26-ed19-4659-bd3e-07dca7c95679 tempest-VolumesTestJSON-1131863311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (959474e6-d60f-47e1-af08-c2f0f2386026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:35:10 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ec914e26-ed19-4659-bd3e-07dca7c95679 tempest-VolumesTestJSON-1131863311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (959474e6-d60f-47e1-af08-c2f0f2386026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:35:10 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ec914e26-ed19-4659-bd3e-07dca7c95679 tempest-VolumesTestJSON-1131863311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00e2526b-081c-4347-9ee2-37f26e102d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:35:10 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ec914e26-ed19-4659-bd3e-07dca7c95679 tempest-VolumesTestJSON-1131863311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00e2526b-081c-4347-9ee2-37f26e102d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a312995-1cff-430b-9d8b-78cd93b4c72b', 'volume_name': 'volume-9a312995-1cff-430b-9d8b-78cd93b4c72b', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:35:10 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ec914e26-ed19-4659-bd3e-07dca7c95679 tempest-VolumesTestJSON-1131863311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e2a5437-1b95-4be4-b9aa-c0109e69f386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:35:10 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ec914e26-ed19-4659-bd3e-07dca7c95679 tempest-VolumesTestJSON-1131863311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e2a5437-1b95-4be4-b9aa-c0109e69f386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:35:10 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ec914e26-ed19-4659-bd3e-07dca7c95679 tempest-VolumesTestJSON-1131863311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32627b0d-f2e3-4cf9-b736-ad78a97fc999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:35:10 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-ec914e26-ed19-4659-bd3e-07dca7c95679 tempest-VolumesTestJSON-1131863311 None] Volume 9a312995-1cff-430b-9d8b-78cd93b4c72b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a312995-1cff-430b-9d8b-78cd93b4c72b', 'volume_size': 1} Sep 10 21:35:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-ec914e26-ed19-4659-bd3e-07dca7c95679 tempest-VolumesTestJSON-1131863311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:35:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-ec914e26-ed19-4659-bd3e-07dca7c95679 tempest-VolumesTestJSON-1131863311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:35:10 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-ec914e26-ed19-4659-bd3e-07dca7c95679 tempest-VolumesTestJSON-1131863311 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:35:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-46603325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a312995-1cff-430b-9d8b-78cd93b4c72b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='946050d132bf4c5fae668b87a6c0e4cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:35:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:35:10Z,use_quota=True,user_id='96f725bfb3ab4195acf6408dcec83a2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:35:10 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-ec914e26-ed19-4659-bd3e-07dca7c95679 tempest-VolumesTestJSON-1131863311 None] Creating volume 9a312995-1cff-430b-9d8b-78cd93b4c72b {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:35:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-ec914e26-ed19-4659-bd3e-07dca7c95679 tempest-VolumesTestJSON-1131863311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:35:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-ec914e26-ed19-4659-bd3e-07dca7c95679 tempest-VolumesTestJSON-1131863311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:35:10 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-ec914e26-ed19-4659-bd3e-07dca7c95679 tempest-VolumesTestJSON-1131863311 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:35:10 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-ec914e26-ed19-4659-bd3e-07dca7c95679 tempest-VolumesTestJSON-1131863311 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:35:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-ec914e26-ed19-4659-bd3e-07dca7c95679 tempest-VolumesTestJSON-1131863311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:35:10 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-ec914e26-ed19-4659-bd3e-07dca7c95679 tempest-VolumesTestJSON-1131863311 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:35:10 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-ec914e26-ed19-4659-bd3e-07dca7c95679 tempest-VolumesTestJSON-1131863311 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:35:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ec914e26-ed19-4659-bd3e-07dca7c95679 tempest-VolumesTestJSON-1131863311 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-9a312995-1cff-430b-9d8b-78cd93b4c72b 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:35:10 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=91, name=volume-9a312995-1cff-430b-9d8b-78cd93b4c72b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:35:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ec914e26-ed19-4659-bd3e-07dca7c95679 tempest-VolumesTestJSON-1131863311 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-9a312995-1cff-430b-9d8b-78cd93b4c72b 1073741824" returned: 0 in 0.397s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:35:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ec914e26-ed19-4659-bd3e-07dca7c95679 tempest-VolumesTestJSON-1131863311 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-9a312995-1cff-430b-9d8b-78cd93b4c72b {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:35:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ec914e26-ed19-4659-bd3e-07dca7c95679 tempest-VolumesTestJSON-1131863311 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-9a312995-1cff-430b-9d8b-78cd93b4c72b" returned: 0 in 0.138s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:35:10 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-ec914e26-ed19-4659-bd3e-07dca7c95679 tempest-VolumesTestJSON-1131863311 None] <== create_volume: return (606ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:35:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-ec914e26-ed19-4659-bd3e-07dca7c95679 tempest-VolumesTestJSON-1131863311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.618s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:35:11 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ec914e26-ed19-4659-bd3e-07dca7c95679 tempest-VolumesTestJSON-1131863311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32627b0d-f2e3-4cf9-b736-ad78a97fc999) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a312995-1cff-430b-9d8b-78cd93b4c72b', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:35:11 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ec914e26-ed19-4659-bd3e-07dca7c95679 tempest-VolumesTestJSON-1131863311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (876f7155-c9a6-4f12-b49a-fedd79b2c4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:35:11 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-ec914e26-ed19-4659-bd3e-07dca7c95679 tempest-VolumesTestJSON-1131863311 None] Volume volume-9a312995-1cff-430b-9d8b-78cd93b4c72b (9a312995-1cff-430b-9d8b-78cd93b4c72b): created successfully Sep 10 21:35:11 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ec914e26-ed19-4659-bd3e-07dca7c95679 tempest-VolumesTestJSON-1131863311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (876f7155-c9a6-4f12-b49a-fedd79b2c4b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:35:11 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ec914e26-ed19-4659-bd3e-07dca7c95679 tempest-VolumesTestJSON-1131863311 None] Flow 'volume_create_manager' (bca4220a-bd70-4d2b-a770-167fc14c6702) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:35:11 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-ec914e26-ed19-4659-bd3e-07dca7c95679 tempest-VolumesTestJSON-1131863311 None] Created volume successfully. Sep 10 21:35:12 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-fd164548-946e-4cae-8aec-6cb9c87c7397 tempest-VolumesTestJSON-1131863311 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:35:12 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd164548-946e-4cae-8aec-6cb9c87c7397 tempest-VolumesTestJSON-1131863311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:35:12 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fd164548-946e-4cae-8aec-6cb9c87c7397 tempest-VolumesTestJSON-1131863311 None] Flow 'volume_create_manager' (51976169-4c88-43ff-8970-ca206e5c1f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:35:12 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fd164548-946e-4cae-8aec-6cb9c87c7397 tempest-VolumesTestJSON-1131863311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7225f3b-3ca8-4a0d-a2e4-864115cb037e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:35:12 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fd164548-946e-4cae-8aec-6cb9c87c7397 tempest-VolumesTestJSON-1131863311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7225f3b-3ca8-4a0d-a2e4-864115cb037e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:35:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2042572423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ed87a7e-38bb-4678-a971-733d88aa62d4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='946050d132bf4c5fae668b87a6c0e4cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:35:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:35:13Z,use_quota=True,user_id='96f725bfb3ab4195acf6408dcec83a2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:35:12 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fd164548-946e-4cae-8aec-6cb9c87c7397 tempest-VolumesTestJSON-1131863311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5407dd56-70fa-4f75-96ba-7e46de9122fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:35:12 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fd164548-946e-4cae-8aec-6cb9c87c7397 tempest-VolumesTestJSON-1131863311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5407dd56-70fa-4f75-96ba-7e46de9122fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:35:12 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fd164548-946e-4cae-8aec-6cb9c87c7397 tempest-VolumesTestJSON-1131863311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50fdeff9-20fa-40a5-a820-9ae2a6f17057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:35:12 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fd164548-946e-4cae-8aec-6cb9c87c7397 tempest-VolumesTestJSON-1131863311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50fdeff9-20fa-40a5-a820-9ae2a6f17057) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ed87a7e-38bb-4678-a971-733d88aa62d4', 'volume_name': 'volume-5ed87a7e-38bb-4678-a971-733d88aa62d4', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:35:12 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fd164548-946e-4cae-8aec-6cb9c87c7397 tempest-VolumesTestJSON-1131863311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4626b1f3-aae3-484b-8e42-0e317164bcbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:35:12 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fd164548-946e-4cae-8aec-6cb9c87c7397 tempest-VolumesTestJSON-1131863311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4626b1f3-aae3-484b-8e42-0e317164bcbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:35:12 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fd164548-946e-4cae-8aec-6cb9c87c7397 tempest-VolumesTestJSON-1131863311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (677d0e95-1445-4ee6-a4ad-d5a339420e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:35:12 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-fd164548-946e-4cae-8aec-6cb9c87c7397 tempest-VolumesTestJSON-1131863311 None] Volume 5ed87a7e-38bb-4678-a971-733d88aa62d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ed87a7e-38bb-4678-a971-733d88aa62d4', 'volume_size': 1} Sep 10 21:35:12 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-fd164548-946e-4cae-8aec-6cb9c87c7397 tempest-VolumesTestJSON-1131863311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:35:12 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-fd164548-946e-4cae-8aec-6cb9c87c7397 tempest-VolumesTestJSON-1131863311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:35:12 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-fd164548-946e-4cae-8aec-6cb9c87c7397 tempest-VolumesTestJSON-1131863311 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:35:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2042572423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ed87a7e-38bb-4678-a971-733d88aa62d4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='946050d132bf4c5fae668b87a6c0e4cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:35:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:35:13Z,use_quota=True,user_id='96f725bfb3ab4195acf6408dcec83a2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:35:12 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-fd164548-946e-4cae-8aec-6cb9c87c7397 tempest-VolumesTestJSON-1131863311 None] Creating volume 5ed87a7e-38bb-4678-a971-733d88aa62d4 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:35:12 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-fd164548-946e-4cae-8aec-6cb9c87c7397 tempest-VolumesTestJSON-1131863311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:35:12 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-fd164548-946e-4cae-8aec-6cb9c87c7397 tempest-VolumesTestJSON-1131863311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:35:12 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-fd164548-946e-4cae-8aec-6cb9c87c7397 tempest-VolumesTestJSON-1131863311 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:35:12 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-fd164548-946e-4cae-8aec-6cb9c87c7397 tempest-VolumesTestJSON-1131863311 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:35:12 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-fd164548-946e-4cae-8aec-6cb9c87c7397 tempest-VolumesTestJSON-1131863311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:35:12 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-fd164548-946e-4cae-8aec-6cb9c87c7397 tempest-VolumesTestJSON-1131863311 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:35:12 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-fd164548-946e-4cae-8aec-6cb9c87c7397 tempest-VolumesTestJSON-1131863311 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:35:12 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-fd164548-946e-4cae-8aec-6cb9c87c7397 tempest-VolumesTestJSON-1131863311 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5ed87a7e-38bb-4678-a971-733d88aa62d4 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:35:13 devstack quobyte-client[82807]: System call of process 98451 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:35:13 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=92, name=volume-5ed87a7e-38bb-4678-a971-733d88aa62d4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:35:13 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-fd164548-946e-4cae-8aec-6cb9c87c7397 tempest-VolumesTestJSON-1131863311 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5ed87a7e-38bb-4678-a971-733d88aa62d4 1073741824" returned: 0 in 0.410s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:35:13 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-fd164548-946e-4cae-8aec-6cb9c87c7397 tempest-VolumesTestJSON-1131863311 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5ed87a7e-38bb-4678-a971-733d88aa62d4 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:35:13 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-fd164548-946e-4cae-8aec-6cb9c87c7397 tempest-VolumesTestJSON-1131863311 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5ed87a7e-38bb-4678-a971-733d88aa62d4" returned: 0 in 0.136s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:35:13 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-fd164548-946e-4cae-8aec-6cb9c87c7397 tempest-VolumesTestJSON-1131863311 None] <== create_volume: return (627ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:35:13 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-fd164548-946e-4cae-8aec-6cb9c87c7397 tempest-VolumesTestJSON-1131863311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.640s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:35:13 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fd164548-946e-4cae-8aec-6cb9c87c7397 tempest-VolumesTestJSON-1131863311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (677d0e95-1445-4ee6-a4ad-d5a339420e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ed87a7e-38bb-4678-a971-733d88aa62d4', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:35:13 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fd164548-946e-4cae-8aec-6cb9c87c7397 tempest-VolumesTestJSON-1131863311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37cc7f22-4483-4107-9608-66e3baae31dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:35:13 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-fd164548-946e-4cae-8aec-6cb9c87c7397 tempest-VolumesTestJSON-1131863311 None] Volume volume-5ed87a7e-38bb-4678-a971-733d88aa62d4 (5ed87a7e-38bb-4678-a971-733d88aa62d4): created successfully Sep 10 21:35:13 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fd164548-946e-4cae-8aec-6cb9c87c7397 tempest-VolumesTestJSON-1131863311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37cc7f22-4483-4107-9608-66e3baae31dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:35:13 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fd164548-946e-4cae-8aec-6cb9c87c7397 tempest-VolumesTestJSON-1131863311 None] Flow 'volume_create_manager' (51976169-4c88-43ff-8970-ca206e5c1f44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:35:13 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-fd164548-946e-4cae-8aec-6cb9c87c7397 tempest-VolumesTestJSON-1131863311 None] Created volume successfully. Sep 10 21:35:15 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-4f20f9eb-3e28-48f6-a88d-d493ec3dc392 tempest-VolumesTestJSON-1131863311 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:35:15 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f20f9eb-3e28-48f6-a88d-d493ec3dc392 tempest-VolumesTestJSON-1131863311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:35:15 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4f20f9eb-3e28-48f6-a88d-d493ec3dc392 tempest-VolumesTestJSON-1131863311 None] Flow 'volume_create_manager' (96c6de1b-c562-4845-b447-15ba5784ad3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:35:15 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4f20f9eb-3e28-48f6-a88d-d493ec3dc392 tempest-VolumesTestJSON-1131863311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c5ffdaf-4854-4de0-b529-7fce93af7652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:35:15 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4f20f9eb-3e28-48f6-a88d-d493ec3dc392 tempest-VolumesTestJSON-1131863311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c5ffdaf-4854-4de0-b529-7fce93af7652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:35:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1364550018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0adbaad4-2ee2-4759-bfa0-c2d269a13b46,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='946050d132bf4c5fae668b87a6c0e4cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:35:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:35:15Z,use_quota=True,user_id='96f725bfb3ab4195acf6408dcec83a2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:35:15 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4f20f9eb-3e28-48f6-a88d-d493ec3dc392 tempest-VolumesTestJSON-1131863311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ed45b40-dc7a-4c4e-82d9-36aad527ff8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:35:15 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4f20f9eb-3e28-48f6-a88d-d493ec3dc392 tempest-VolumesTestJSON-1131863311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ed45b40-dc7a-4c4e-82d9-36aad527ff8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:35:15 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4f20f9eb-3e28-48f6-a88d-d493ec3dc392 tempest-VolumesTestJSON-1131863311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c0911ba-f923-4931-85d6-1ce30743be78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:35:15 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4f20f9eb-3e28-48f6-a88d-d493ec3dc392 tempest-VolumesTestJSON-1131863311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c0911ba-f923-4931-85d6-1ce30743be78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0adbaad4-2ee2-4759-bfa0-c2d269a13b46', 'volume_name': 'volume-0adbaad4-2ee2-4759-bfa0-c2d269a13b46', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:35:15 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4f20f9eb-3e28-48f6-a88d-d493ec3dc392 tempest-VolumesTestJSON-1131863311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e031001-3e0c-49ef-b663-9ea78d047af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:35:15 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4f20f9eb-3e28-48f6-a88d-d493ec3dc392 tempest-VolumesTestJSON-1131863311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e031001-3e0c-49ef-b663-9ea78d047af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:35:15 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4f20f9eb-3e28-48f6-a88d-d493ec3dc392 tempest-VolumesTestJSON-1131863311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69ff3462-d15c-49b5-80c6-a06692bf3313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:35:15 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-4f20f9eb-3e28-48f6-a88d-d493ec3dc392 tempest-VolumesTestJSON-1131863311 None] Volume 0adbaad4-2ee2-4759-bfa0-c2d269a13b46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0adbaad4-2ee2-4759-bfa0-c2d269a13b46', 'volume_size': 1} Sep 10 21:35:15 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-4f20f9eb-3e28-48f6-a88d-d493ec3dc392 tempest-VolumesTestJSON-1131863311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:35:15 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-4f20f9eb-3e28-48f6-a88d-d493ec3dc392 tempest-VolumesTestJSON-1131863311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:35:15 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-4f20f9eb-3e28-48f6-a88d-d493ec3dc392 tempest-VolumesTestJSON-1131863311 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:35:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1364550018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0adbaad4-2ee2-4759-bfa0-c2d269a13b46,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='946050d132bf4c5fae668b87a6c0e4cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:35:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:35:15Z,use_quota=True,user_id='96f725bfb3ab4195acf6408dcec83a2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:35:15 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-4f20f9eb-3e28-48f6-a88d-d493ec3dc392 tempest-VolumesTestJSON-1131863311 None] Creating volume 0adbaad4-2ee2-4759-bfa0-c2d269a13b46 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:35:15 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-4f20f9eb-3e28-48f6-a88d-d493ec3dc392 tempest-VolumesTestJSON-1131863311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:35:15 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-4f20f9eb-3e28-48f6-a88d-d493ec3dc392 tempest-VolumesTestJSON-1131863311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:35:15 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-4f20f9eb-3e28-48f6-a88d-d493ec3dc392 tempest-VolumesTestJSON-1131863311 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:35:15 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-4f20f9eb-3e28-48f6-a88d-d493ec3dc392 tempest-VolumesTestJSON-1131863311 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:35:15 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-4f20f9eb-3e28-48f6-a88d-d493ec3dc392 tempest-VolumesTestJSON-1131863311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:35:15 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-4f20f9eb-3e28-48f6-a88d-d493ec3dc392 tempest-VolumesTestJSON-1131863311 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:35:15 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-4f20f9eb-3e28-48f6-a88d-d493ec3dc392 tempest-VolumesTestJSON-1131863311 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:35:15 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4f20f9eb-3e28-48f6-a88d-d493ec3dc392 tempest-VolumesTestJSON-1131863311 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-0adbaad4-2ee2-4759-bfa0-c2d269a13b46 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:35:15 devstack quobyte-client[82807]: System call of process 98457 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:35:15 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=93, name=volume-0adbaad4-2ee2-4759-bfa0-c2d269a13b46, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:35:16 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4f20f9eb-3e28-48f6-a88d-d493ec3dc392 tempest-VolumesTestJSON-1131863311 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-0adbaad4-2ee2-4759-bfa0-c2d269a13b46 1073741824" returned: 0 in 0.421s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:35:16 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4f20f9eb-3e28-48f6-a88d-d493ec3dc392 tempest-VolumesTestJSON-1131863311 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-0adbaad4-2ee2-4759-bfa0-c2d269a13b46 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:35:16 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4f20f9eb-3e28-48f6-a88d-d493ec3dc392 tempest-VolumesTestJSON-1131863311 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-0adbaad4-2ee2-4759-bfa0-c2d269a13b46" returned: 0 in 0.106s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:35:16 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-4f20f9eb-3e28-48f6-a88d-d493ec3dc392 tempest-VolumesTestJSON-1131863311 None] <== create_volume: return (589ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:35:16 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-4f20f9eb-3e28-48f6-a88d-d493ec3dc392 tempest-VolumesTestJSON-1131863311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.600s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:35:16 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4f20f9eb-3e28-48f6-a88d-d493ec3dc392 tempest-VolumesTestJSON-1131863311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69ff3462-d15c-49b5-80c6-a06692bf3313) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0adbaad4-2ee2-4759-bfa0-c2d269a13b46', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:35:16 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4f20f9eb-3e28-48f6-a88d-d493ec3dc392 tempest-VolumesTestJSON-1131863311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c6872ef-4fb3-4988-8803-352e05fb8cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:35:16 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-4f20f9eb-3e28-48f6-a88d-d493ec3dc392 tempest-VolumesTestJSON-1131863311 None] Volume volume-0adbaad4-2ee2-4759-bfa0-c2d269a13b46 (0adbaad4-2ee2-4759-bfa0-c2d269a13b46): created successfully Sep 10 21:35:16 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4f20f9eb-3e28-48f6-a88d-d493ec3dc392 tempest-VolumesTestJSON-1131863311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c6872ef-4fb3-4988-8803-352e05fb8cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:35:16 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4f20f9eb-3e28-48f6-a88d-d493ec3dc392 tempest-VolumesTestJSON-1131863311 None] Flow 'volume_create_manager' (96c6de1b-c562-4845-b447-15ba5784ad3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:35:16 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-4f20f9eb-3e28-48f6-a88d-d493ec3dc392 tempest-VolumesTestJSON-1131863311 None] Created volume successfully. Sep 10 21:35:18 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-a42ae19c-7b8c-4b00-a1da-ee7a2d3cc9f4 tempest-VolumesTestJSON-1131863311 None] Acquiring lock "cinder-0adbaad4-2ee2-4759-bfa0-c2d269a13b46-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:35:18 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-a42ae19c-7b8c-4b00-a1da-ee7a2d3cc9f4 tempest-VolumesTestJSON-1131863311 None] Lock "cinder-0adbaad4-2ee2-4759-bfa0-c2d269a13b46-delete_volume" acquired by "delete_volume" :: waited 0.094s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:35:19 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-a42ae19c-7b8c-4b00-a1da-ee7a2d3cc9f4 tempest-VolumesTestJSON-1131863311 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:35:19 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-a42ae19c-7b8c-4b00-a1da-ee7a2d3cc9f4 tempest-VolumesTestJSON-1131863311 None] Acquiring lock "cinder-quobyte-0adbaad4-2ee2-4759-bfa0-c2d269a13b46" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:35:19 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-a42ae19c-7b8c-4b00-a1da-ee7a2d3cc9f4 tempest-VolumesTestJSON-1131863311 None] Lock "cinder-quobyte-0adbaad4-2ee2-4759-bfa0-c2d269a13b46" acquired by "delete_volume" :: waited 0.024s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:35:19 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b68fe2e-08c0-4362-aee1-9130a337daf7]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:35:19 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a42ae19c-7b8c-4b00-a1da-ee7a2d3cc9f4 tempest-VolumesTestJSON-1131863311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-0adbaad4-2ee2-4759-bfa0-c2d269a13b46 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:35:19 devstack quobyte-client[82807]: System call of process 98477 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:35:19 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a42ae19c-7b8c-4b00-a1da-ee7a2d3cc9f4 tempest-VolumesTestJSON-1131863311 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-0adbaad4-2ee2-4759-bfa0-c2d269a13b46" returned: 0 in 0.527s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:35:19 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a42ae19c-7b8c-4b00-a1da-ee7a2d3cc9f4 tempest-VolumesTestJSON-1131863311 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-0adbaad4-2ee2-4759-bfa0-c2d269a13b46 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:35:19 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a42ae19c-7b8c-4b00-a1da-ee7a2d3cc9f4 tempest-VolumesTestJSON-1131863311 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-0adbaad4-2ee2-4759-bfa0-c2d269a13b46" returned: 0 in 0.102s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:35:19 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-a42ae19c-7b8c-4b00-a1da-ee7a2d3cc9f4 tempest-VolumesTestJSON-1131863311 None] Lock "cinder-quobyte-0adbaad4-2ee2-4759-bfa0-c2d269a13b46" released by "delete_volume" :: held 0.811s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:35:20 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-a42ae19c-7b8c-4b00-a1da-ee7a2d3cc9f4 tempest-VolumesTestJSON-1131863311 None] Created reservations ['9265ffbe-88f9-405d-8803-093e8bbea41f', '06811a46-0ff8-4520-a04d-0526ce6a002e', 'b60c00d4-e2ab-4a30-a810-af6b6b18e9e2', '406afa4b-35a4-43ea-8c4e-9be0b0def4e4'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:35:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a42ae19c-7b8c-4b00-a1da-ee7a2d3cc9f4 tempest-VolumesTestJSON-1131863311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:35:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a42ae19c-7b8c-4b00-a1da-ee7a2d3cc9f4 tempest-VolumesTestJSON-1131863311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:35:20 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a42ae19c-7b8c-4b00-a1da-ee7a2d3cc9f4 tempest-VolumesTestJSON-1131863311 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:35:20 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a42ae19c-7b8c-4b00-a1da-ee7a2d3cc9f4 tempest-VolumesTestJSON-1131863311 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:35:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a42ae19c-7b8c-4b00-a1da-ee7a2d3cc9f4 tempest-VolumesTestJSON-1131863311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:35:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a42ae19c-7b8c-4b00-a1da-ee7a2d3cc9f4 tempest-VolumesTestJSON-1131863311 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:35:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a42ae19c-7b8c-4b00-a1da-ee7a2d3cc9f4 tempest-VolumesTestJSON-1131863311 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.127s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:35:20 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-a42ae19c-7b8c-4b00-a1da-ee7a2d3cc9f4 tempest-VolumesTestJSON-1131863311 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:35:20 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-a42ae19c-7b8c-4b00-a1da-ee7a2d3cc9f4 tempest-VolumesTestJSON-1131863311 None] Deleted volume successfully. Sep 10 21:35:21 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-a42ae19c-7b8c-4b00-a1da-ee7a2d3cc9f4 tempest-VolumesTestJSON-1131863311 None] Lock "cinder-0adbaad4-2ee2-4759-bfa0-c2d269a13b46-delete_volume" released by "delete_volume" :: held 2.017s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:35:21 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-59c95863-a488-4729-b8fe-4433517543e8 tempest-VolumesTestJSON-1131863311 None] Acquiring lock "cinder-5ed87a7e-38bb-4678-a971-733d88aa62d4-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:35:21 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-59c95863-a488-4729-b8fe-4433517543e8 tempest-VolumesTestJSON-1131863311 None] Lock "cinder-5ed87a7e-38bb-4678-a971-733d88aa62d4-delete_volume" acquired by "delete_volume" :: waited 0.111s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:35:21 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-59c95863-a488-4729-b8fe-4433517543e8 tempest-VolumesTestJSON-1131863311 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:35:21 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-59c95863-a488-4729-b8fe-4433517543e8 tempest-VolumesTestJSON-1131863311 None] Acquiring lock "cinder-quobyte-5ed87a7e-38bb-4678-a971-733d88aa62d4" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:35:21 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-59c95863-a488-4729-b8fe-4433517543e8 tempest-VolumesTestJSON-1131863311 None] Lock "cinder-quobyte-5ed87a7e-38bb-4678-a971-733d88aa62d4" acquired by "delete_volume" :: waited 0.016s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:35:21 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d07c37-0ca9-4e36-9b4e-2b6969c45e9f]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:35:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-59c95863-a488-4729-b8fe-4433517543e8 tempest-VolumesTestJSON-1131863311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5ed87a7e-38bb-4678-a971-733d88aa62d4 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:35:22 devstack quobyte-client[82807]: System call of process 98482 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:35:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-59c95863-a488-4729-b8fe-4433517543e8 tempest-VolumesTestJSON-1131863311 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5ed87a7e-38bb-4678-a971-733d88aa62d4" returned: 0 in 0.505s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:35:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-59c95863-a488-4729-b8fe-4433517543e8 tempest-VolumesTestJSON-1131863311 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5ed87a7e-38bb-4678-a971-733d88aa62d4 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:35:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-59c95863-a488-4729-b8fe-4433517543e8 tempest-VolumesTestJSON-1131863311 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5ed87a7e-38bb-4678-a971-733d88aa62d4" returned: 0 in 0.123s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:35:22 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-59c95863-a488-4729-b8fe-4433517543e8 tempest-VolumesTestJSON-1131863311 None] Lock "cinder-quobyte-5ed87a7e-38bb-4678-a971-733d88aa62d4" released by "delete_volume" :: held 0.836s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:35:22 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-59c95863-a488-4729-b8fe-4433517543e8 tempest-VolumesTestJSON-1131863311 None] Created reservations ['ecbb90db-3175-47d2-be8a-b98c44804cb0', '44eda479-fc53-4b2a-8788-ea82e6189fd6', '4ca2b680-0d43-4211-8e17-7a789940778c', '99589ee1-0877-4767-b809-184d0fdec8f6'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:35:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-59c95863-a488-4729-b8fe-4433517543e8 tempest-VolumesTestJSON-1131863311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:35:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-59c95863-a488-4729-b8fe-4433517543e8 tempest-VolumesTestJSON-1131863311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.020s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:35:22 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-59c95863-a488-4729-b8fe-4433517543e8 tempest-VolumesTestJSON-1131863311 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:35:22 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-59c95863-a488-4729-b8fe-4433517543e8 tempest-VolumesTestJSON-1131863311 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:35:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-59c95863-a488-4729-b8fe-4433517543e8 tempest-VolumesTestJSON-1131863311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:35:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-59c95863-a488-4729-b8fe-4433517543e8 tempest-VolumesTestJSON-1131863311 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:35:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-59c95863-a488-4729-b8fe-4433517543e8 tempest-VolumesTestJSON-1131863311 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.144s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:35:23 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-59c95863-a488-4729-b8fe-4433517543e8 tempest-VolumesTestJSON-1131863311 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:35:23 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-59c95863-a488-4729-b8fe-4433517543e8 tempest-VolumesTestJSON-1131863311 None] Deleted volume successfully. Sep 10 21:35:23 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-59c95863-a488-4729-b8fe-4433517543e8 tempest-VolumesTestJSON-1131863311 None] Lock "cinder-5ed87a7e-38bb-4678-a971-733d88aa62d4-delete_volume" released by "delete_volume" :: held 2.026s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:35:23 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-16a53ed7-08ab-44ab-b292-d28ee2032107 tempest-VolumesTestJSON-1131863311 None] Acquiring lock "cinder-9a312995-1cff-430b-9d8b-78cd93b4c72b-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:35:23 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-16a53ed7-08ab-44ab-b292-d28ee2032107 tempest-VolumesTestJSON-1131863311 None] Lock "cinder-9a312995-1cff-430b-9d8b-78cd93b4c72b-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:35:24 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-16a53ed7-08ab-44ab-b292-d28ee2032107 tempest-VolumesTestJSON-1131863311 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:35:24 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-16a53ed7-08ab-44ab-b292-d28ee2032107 tempest-VolumesTestJSON-1131863311 None] Acquiring lock "cinder-quobyte-9a312995-1cff-430b-9d8b-78cd93b4c72b" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:35:24 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-16a53ed7-08ab-44ab-b292-d28ee2032107 tempest-VolumesTestJSON-1131863311 None] Lock "cinder-quobyte-9a312995-1cff-430b-9d8b-78cd93b4c72b" acquired by "delete_volume" :: waited 0.014s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:35:24 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3271d49-d221-4353-8258-7b0e137fa165]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:35:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-16a53ed7-08ab-44ab-b292-d28ee2032107 tempest-VolumesTestJSON-1131863311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-9a312995-1cff-430b-9d8b-78cd93b4c72b {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:35:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-16a53ed7-08ab-44ab-b292-d28ee2032107 tempest-VolumesTestJSON-1131863311 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-9a312995-1cff-430b-9d8b-78cd93b4c72b" returned: 0 in 0.505s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:35:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-16a53ed7-08ab-44ab-b292-d28ee2032107 tempest-VolumesTestJSON-1131863311 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-9a312995-1cff-430b-9d8b-78cd93b4c72b {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:35:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-16a53ed7-08ab-44ab-b292-d28ee2032107 tempest-VolumesTestJSON-1131863311 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-9a312995-1cff-430b-9d8b-78cd93b4c72b" returned: 0 in 0.117s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:35:24 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-16a53ed7-08ab-44ab-b292-d28ee2032107 tempest-VolumesTestJSON-1131863311 None] Lock "cinder-quobyte-9a312995-1cff-430b-9d8b-78cd93b4c72b" released by "delete_volume" :: held 0.815s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:35:25 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-16a53ed7-08ab-44ab-b292-d28ee2032107 tempest-VolumesTestJSON-1131863311 None] Created reservations ['de64ad2e-de85-420c-bb41-9fb64c50dcb7', '9209059d-25a0-4210-b1a7-984b778eb8b2', '75601a20-b474-428f-8099-5a68f5f524f6', 'bc7ec0c6-a8b4-4419-a479-1d9f7309cc69'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:35:25 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-16a53ed7-08ab-44ab-b292-d28ee2032107 tempest-VolumesTestJSON-1131863311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:35:25 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-16a53ed7-08ab-44ab-b292-d28ee2032107 tempest-VolumesTestJSON-1131863311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:35:25 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-16a53ed7-08ab-44ab-b292-d28ee2032107 tempest-VolumesTestJSON-1131863311 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:35:25 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-16a53ed7-08ab-44ab-b292-d28ee2032107 tempest-VolumesTestJSON-1131863311 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:35:25 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-16a53ed7-08ab-44ab-b292-d28ee2032107 tempest-VolumesTestJSON-1131863311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:35:25 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-16a53ed7-08ab-44ab-b292-d28ee2032107 tempest-VolumesTestJSON-1131863311 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:35:25 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-16a53ed7-08ab-44ab-b292-d28ee2032107 tempest-VolumesTestJSON-1131863311 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.119s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:35:25 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-16a53ed7-08ab-44ab-b292-d28ee2032107 tempest-VolumesTestJSON-1131863311 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:35:25 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-16a53ed7-08ab-44ab-b292-d28ee2032107 tempest-VolumesTestJSON-1131863311 None] Deleted volume successfully. Sep 10 21:35:25 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-16a53ed7-08ab-44ab-b292-d28ee2032107 tempest-VolumesTestJSON-1131863311 None] Lock "cinder-9a312995-1cff-430b-9d8b-78cd93b4c72b-delete_volume" released by "delete_volume" :: held 2.003s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:35:30 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-d621aa1a-7c87-45a1-8e65-003ab881d226 tempest-GroupSnapshotsTest-630474466 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:35:30 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-d621aa1a-7c87-45a1-8e65-003ab881d226 tempest-GroupSnapshotsTest-630474466 None] Group tempest-GroupSnapshotsTest-Group-562303511: creating Sep 10 21:35:31 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-d621aa1a-7c87-45a1-8e65-003ab881d226 tempest-GroupSnapshotsTest-630474466 None] Group tempest-GroupSnapshotsTest-Group-562303511: created successfully Sep 10 21:35:31 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-d621aa1a-7c87-45a1-8e65-003ab881d226 tempest-GroupSnapshotsTest-630474466 None] Create group completed successfully. Sep 10 21:35:32 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-de230ade-1958-46a6-847e-9e121db3ed32 tempest-GroupSnapshotsTest-630474466 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:35:32 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-de230ade-1958-46a6-847e-9e121db3ed32 tempest-GroupSnapshotsTest-630474466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:35:32 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-de230ade-1958-46a6-847e-9e121db3ed32 tempest-GroupSnapshotsTest-630474466 None] Flow 'volume_create_manager' (05c7f45f-1741-49e8-9d2b-03600fb67cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:35:32 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-de230ade-1958-46a6-847e-9e121db3ed32 tempest-GroupSnapshotsTest-630474466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2955518-c1fc-47de-babb-297964822b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:35:32 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-de230ade-1958-46a6-847e-9e121db3ed32 tempest-GroupSnapshotsTest-630474466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2955518-c1fc-47de-babb-297964822b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:35:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-250794738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=da5849d9-0a3c-412d-bad4-93a4041c60b3,host='devstack@QuobyteHD#QuobyteHD',id=d3f1bd8e-c94d-4ad0-b336-52d26a19409c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e814d05ca6b4cd692e805a481a5f61b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:35:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:35:33Z,use_quota=True,user_id='bdbc71ad5d354ec3ad72730134e89080',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0a6b160-7d48-48ad-a5af-61dce21bf5e1),volume_type_id=e0a6b160-7d48-48ad-a5af-61dce21bf5e1)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:35:32 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-de230ade-1958-46a6-847e-9e121db3ed32 tempest-GroupSnapshotsTest-630474466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e539ee39-f43d-4ccf-acdf-99dc6a32ba97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:35:32 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-de230ade-1958-46a6-847e-9e121db3ed32 tempest-GroupSnapshotsTest-630474466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e539ee39-f43d-4ccf-acdf-99dc6a32ba97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:35:32 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-de230ade-1958-46a6-847e-9e121db3ed32 tempest-GroupSnapshotsTest-630474466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ff3015f-8fbd-4715-9256-74b60a0c2fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:35:32 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-de230ade-1958-46a6-847e-9e121db3ed32 tempest-GroupSnapshotsTest-630474466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ff3015f-8fbd-4715-9256-74b60a0c2fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3f1bd8e-c94d-4ad0-b336-52d26a19409c', 'volume_name': 'volume-d3f1bd8e-c94d-4ad0-b336-52d26a19409c', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:35:32 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-de230ade-1958-46a6-847e-9e121db3ed32 tempest-GroupSnapshotsTest-630474466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a31715cc-add8-4ded-a912-29f66453d8f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:35:32 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-de230ade-1958-46a6-847e-9e121db3ed32 tempest-GroupSnapshotsTest-630474466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a31715cc-add8-4ded-a912-29f66453d8f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:35:32 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-de230ade-1958-46a6-847e-9e121db3ed32 tempest-GroupSnapshotsTest-630474466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df40a5f0-fe13-42e7-9d19-acab94e9df3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:35:32 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-de230ade-1958-46a6-847e-9e121db3ed32 tempest-GroupSnapshotsTest-630474466 None] Volume d3f1bd8e-c94d-4ad0-b336-52d26a19409c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3f1bd8e-c94d-4ad0-b336-52d26a19409c', 'volume_size': 1} Sep 10 21:35:32 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-de230ade-1958-46a6-847e-9e121db3ed32 tempest-GroupSnapshotsTest-630474466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:35:32 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-de230ade-1958-46a6-847e-9e121db3ed32 tempest-GroupSnapshotsTest-630474466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:35:32 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-de230ade-1958-46a6-847e-9e121db3ed32 tempest-GroupSnapshotsTest-630474466 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=da5849d9-0a3c-412d-bad4-93a4041c60b3,created_at=2025-09-10T19:35:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-250794738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=da5849d9-0a3c-412d-bad4-93a4041c60b3,host='devstack@QuobyteHD#QuobyteHD',id=d3f1bd8e-c94d-4ad0-b336-52d26a19409c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e814d05ca6b4cd692e805a481a5f61b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:35:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:35:33Z,use_quota=True,user_id='bdbc71ad5d354ec3ad72730134e89080',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0a6b160-7d48-48ad-a5af-61dce21bf5e1),volume_type_id=e0a6b160-7d48-48ad-a5af-61dce21bf5e1)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:35:32 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-de230ade-1958-46a6-847e-9e121db3ed32 tempest-GroupSnapshotsTest-630474466 None] Creating volume d3f1bd8e-c94d-4ad0-b336-52d26a19409c {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:35:32 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-de230ade-1958-46a6-847e-9e121db3ed32 tempest-GroupSnapshotsTest-630474466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:35:32 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-de230ade-1958-46a6-847e-9e121db3ed32 tempest-GroupSnapshotsTest-630474466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:35:32 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-de230ade-1958-46a6-847e-9e121db3ed32 tempest-GroupSnapshotsTest-630474466 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:35:32 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-de230ade-1958-46a6-847e-9e121db3ed32 tempest-GroupSnapshotsTest-630474466 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:35:32 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-de230ade-1958-46a6-847e-9e121db3ed32 tempest-GroupSnapshotsTest-630474466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:35:32 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-de230ade-1958-46a6-847e-9e121db3ed32 tempest-GroupSnapshotsTest-630474466 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:35:32 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-de230ade-1958-46a6-847e-9e121db3ed32 tempest-GroupSnapshotsTest-630474466 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:35:32 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-de230ade-1958-46a6-847e-9e121db3ed32 tempest-GroupSnapshotsTest-630474466 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d3f1bd8e-c94d-4ad0-b336-52d26a19409c 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:35:33 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=94, name=volume-d3f1bd8e-c94d-4ad0-b336-52d26a19409c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:35:33 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-de230ade-1958-46a6-847e-9e121db3ed32 tempest-GroupSnapshotsTest-630474466 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d3f1bd8e-c94d-4ad0-b336-52d26a19409c 1073741824" returned: 0 in 0.335s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:35:33 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-de230ade-1958-46a6-847e-9e121db3ed32 tempest-GroupSnapshotsTest-630474466 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d3f1bd8e-c94d-4ad0-b336-52d26a19409c {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:35:33 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-de230ade-1958-46a6-847e-9e121db3ed32 tempest-GroupSnapshotsTest-630474466 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d3f1bd8e-c94d-4ad0-b336-52d26a19409c" returned: 0 in 0.089s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:35:33 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-de230ade-1958-46a6-847e-9e121db3ed32 tempest-GroupSnapshotsTest-630474466 None] <== create_volume: return (525ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:35:33 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-de230ade-1958-46a6-847e-9e121db3ed32 tempest-GroupSnapshotsTest-630474466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.537s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:35:33 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-de230ade-1958-46a6-847e-9e121db3ed32 tempest-GroupSnapshotsTest-630474466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df40a5f0-fe13-42e7-9d19-acab94e9df3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3f1bd8e-c94d-4ad0-b336-52d26a19409c', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:35:33 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-de230ade-1958-46a6-847e-9e121db3ed32 tempest-GroupSnapshotsTest-630474466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e5111c8-8048-4c0c-b1c0-e23082c319df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:35:33 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-de230ade-1958-46a6-847e-9e121db3ed32 tempest-GroupSnapshotsTest-630474466 None] Volume volume-d3f1bd8e-c94d-4ad0-b336-52d26a19409c (d3f1bd8e-c94d-4ad0-b336-52d26a19409c): created successfully Sep 10 21:35:33 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-de230ade-1958-46a6-847e-9e121db3ed32 tempest-GroupSnapshotsTest-630474466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e5111c8-8048-4c0c-b1c0-e23082c319df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:35:33 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-de230ade-1958-46a6-847e-9e121db3ed32 tempest-GroupSnapshotsTest-630474466 None] Flow 'volume_create_manager' (05c7f45f-1741-49e8-9d2b-03600fb67cd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:35:33 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-de230ade-1958-46a6-847e-9e121db3ed32 tempest-GroupSnapshotsTest-630474466 None] Created volume successfully. Sep 10 21:35:35 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-e7150f04-96a6-4370-becd-a80a70dd5669 tempest-GroupSnapshotsTest-630474466 None] GroupSnapshot 83124649-19f3-4272-86ec-1d0e2241590f: creating. Sep 10 21:35:35 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-e7150f04-96a6-4370-becd-a80a70dd5669 tempest-GroupSnapshotsTest-630474466 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:35:35 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-e7150f04-96a6-4370-becd-a80a70dd5669 tempest-GroupSnapshotsTest-630474466 None] Group snapshot 83124649-19f3-4272-86ec-1d0e2241590f: creating. {{(pid=82780) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}} Sep 10 21:35:35 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-e7150f04-96a6-4370-becd-a80a70dd5669 tempest-GroupSnapshotsTest-630474466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:35:35 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-e7150f04-96a6-4370-becd-a80a70dd5669 tempest-GroupSnapshotsTest-630474466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:35:35 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-e7150f04-96a6-4370-becd-a80a70dd5669 tempest-GroupSnapshotsTest-630474466 None] Creating offline snapshot 4cc5529a-ebfd-4d91-be00-a25e055b5549 of volume d3f1bd8e-c94d-4ad0-b336-52d26a19409c {{(pid=82780) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 21:35:35 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d741aad8-e072-411b-95c0-61ccb9027ec8]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:35:35 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e7150f04-96a6-4370-becd-a80a70dd5669 tempest-GroupSnapshotsTest-630474466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d3f1bd8e-c94d-4ad0-b336-52d26a19409c {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:35:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e7150f04-96a6-4370-becd-a80a70dd5669 tempest-GroupSnapshotsTest-630474466 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d3f1bd8e-c94d-4ad0-b336-52d26a19409c" returned: 0 in 0.550s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:35:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e7150f04-96a6-4370-becd-a80a70dd5669 tempest-GroupSnapshotsTest-630474466 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d3f1bd8e-c94d-4ad0-b336-52d26a19409c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d3f1bd8e-c94d-4ad0-b336-52d26a19409c.4cc5529a-ebfd-4d91-be00-a25e055b5549 1G {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:35:36 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=95, name=volume-d3f1bd8e-c94d-4ad0-b336-52d26a19409c.4cc5529a-ebfd-4d91-be00-a25e055b5549, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:35:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e7150f04-96a6-4370-becd-a80a70dd5669 tempest-GroupSnapshotsTest-630474466 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d3f1bd8e-c94d-4ad0-b336-52d26a19409c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d3f1bd8e-c94d-4ad0-b336-52d26a19409c.4cc5529a-ebfd-4d91-be00-a25e055b5549 1G" returned: 0 in 0.278s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:35:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e7150f04-96a6-4370-becd-a80a70dd5669 tempest-GroupSnapshotsTest-630474466 None] Running cmd (subprocess): qemu-img rebase -u -b volume-d3f1bd8e-c94d-4ad0-b336-52d26a19409c -F qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d3f1bd8e-c94d-4ad0-b336-52d26a19409c.4cc5529a-ebfd-4d91-be00-a25e055b5549 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:35:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e7150f04-96a6-4370-becd-a80a70dd5669 tempest-GroupSnapshotsTest-630474466 None] CMD "qemu-img rebase -u -b volume-d3f1bd8e-c94d-4ad0-b336-52d26a19409c -F qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d3f1bd8e-c94d-4ad0-b336-52d26a19409c.4cc5529a-ebfd-4d91-be00-a25e055b5549" returned: 0 in 0.193s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:35:36 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-e7150f04-96a6-4370-becd-a80a70dd5669 tempest-GroupSnapshotsTest-630474466 None] File path /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d3f1bd8e-c94d-4ad0-b336-52d26a19409c.4cc5529a-ebfd-4d91-be00-a25e055b5549 is being set with permissions: 660 {{(pid=82780) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 21:35:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e7150f04-96a6-4370-becd-a80a70dd5669 tempest-GroupSnapshotsTest-630474466 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d3f1bd8e-c94d-4ad0-b336-52d26a19409c.4cc5529a-ebfd-4d91-be00-a25e055b5549 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:35:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e7150f04-96a6-4370-becd-a80a70dd5669 tempest-GroupSnapshotsTest-630474466 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d3f1bd8e-c94d-4ad0-b336-52d26a19409c.4cc5529a-ebfd-4d91-be00-a25e055b5549" returned: 0 in 0.098s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:35:36 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-e7150f04-96a6-4370-becd-a80a70dd5669 tempest-GroupSnapshotsTest-630474466 None] Setting permissions: /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d3f1bd8e-c94d-4ad0-b336-52d26a19409c -> 1000:1000 {{(pid=82780) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 21:35:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e7150f04-96a6-4370-becd-a80a70dd5669 tempest-GroupSnapshotsTest-630474466 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d3f1bd8e-c94d-4ad0-b336-52d26a19409c /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d3f1bd8e-c94d-4ad0-b336-52d26a19409c.4cc5529a-ebfd-4d91-be00-a25e055b5549 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:35:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e7150f04-96a6-4370-becd-a80a70dd5669 tempest-GroupSnapshotsTest-630474466 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d3f1bd8e-c94d-4ad0-b336-52d26a19409c /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d3f1bd8e-c94d-4ad0-b336-52d26a19409c.4cc5529a-ebfd-4d91-be00-a25e055b5549" returned: 0 in 0.107s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:35:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e7150f04-96a6-4370-becd-a80a70dd5669 tempest-GroupSnapshotsTest-630474466 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d3f1bd8e-c94d-4ad0-b336-52d26a19409c.info {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:35:37 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e7150f04-96a6-4370-becd-a80a70dd5669 tempest-GroupSnapshotsTest-630474466 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d3f1bd8e-c94d-4ad0-b336-52d26a19409c.info" returned: 0 in 0.119s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:35:37 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-e7150f04-96a6-4370-becd-a80a70dd5669 tempest-GroupSnapshotsTest-630474466 None] File path /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d3f1bd8e-c94d-4ad0-b336-52d26a19409c.info is being set with permissions: 660 {{(pid=82780) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 21:35:37 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e7150f04-96a6-4370-becd-a80a70dd5669 tempest-GroupSnapshotsTest-630474466 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d3f1bd8e-c94d-4ad0-b336-52d26a19409c.info {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:35:37 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e7150f04-96a6-4370-becd-a80a70dd5669 tempest-GroupSnapshotsTest-630474466 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d3f1bd8e-c94d-4ad0-b336-52d26a19409c.info" returned: 0 in 0.117s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:35:37 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-e7150f04-96a6-4370-becd-a80a70dd5669 tempest-GroupSnapshotsTest-630474466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.830s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:35:37 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-e7150f04-96a6-4370-becd-a80a70dd5669 tempest-GroupSnapshotsTest-630474466 None] group_snapshot 83124649-19f3-4272-86ec-1d0e2241590f: created successfully Sep 10 21:35:40 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-a7e85295-5aad-46d1-ac7e-eafabcb58f8b tempest-GroupSnapshotsTest-630474466 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:35:40 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a7e85295-5aad-46d1-ac7e-eafabcb58f8b tempest-GroupSnapshotsTest-630474466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:35:40 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a7e85295-5aad-46d1-ac7e-eafabcb58f8b tempest-GroupSnapshotsTest-630474466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:35:40 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-a7e85295-5aad-46d1-ac7e-eafabcb58f8b tempest-GroupSnapshotsTest-630474466 None] Acquiring lock "cinder-quobyte-4cc5529a-ebfd-4d91-be00-a25e055b5549-5bf6e6c9-dffa-4a7c-ad69-fcfec217eb99" by "_create_volume_from_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:35:40 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-a7e85295-5aad-46d1-ac7e-eafabcb58f8b tempest-GroupSnapshotsTest-630474466 None] Lock "cinder-quobyte-4cc5529a-ebfd-4d91-be00-a25e055b5549-5bf6e6c9-dffa-4a7c-ad69-fcfec217eb99" acquired by "_create_volume_from_snapshot" :: waited 0.065s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:35:40 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a7e85295-5aad-46d1-ac7e-eafabcb58f8b tempest-GroupSnapshotsTest-630474466 None] Creating volume 5bf6e6c9-dffa-4a7c-ad69-fcfec217eb99 from snapshot 4cc5529a-ebfd-4d91-be00-a25e055b5549 {{(pid=82780) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 10 21:35:40 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a7e85295-5aad-46d1-ac7e-eafabcb58f8b tempest-GroupSnapshotsTest-630474466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:35:40 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a7e85295-5aad-46d1-ac7e-eafabcb58f8b tempest-GroupSnapshotsTest-630474466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:35:40 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a7e85295-5aad-46d1-ac7e-eafabcb58f8b tempest-GroupSnapshotsTest-630474466 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:35:40 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a7e85295-5aad-46d1-ac7e-eafabcb58f8b tempest-GroupSnapshotsTest-630474466 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:35:40 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a7e85295-5aad-46d1-ac7e-eafabcb58f8b tempest-GroupSnapshotsTest-630474466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:35:40 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a7e85295-5aad-46d1-ac7e-eafabcb58f8b tempest-GroupSnapshotsTest-630474466 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:35:40 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-a7e85295-5aad-46d1-ac7e-eafabcb58f8b tempest-GroupSnapshotsTest-630474466 None] Acquiring lock "cinder-quobyte-5bf6e6c9-dffa-4a7c-ad69-fcfec217eb99" by "_copy_volume_from_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:35:40 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-a7e85295-5aad-46d1-ac7e-eafabcb58f8b tempest-GroupSnapshotsTest-630474466 None] Lock "cinder-quobyte-5bf6e6c9-dffa-4a7c-ad69-fcfec217eb99" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:35:40 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a7e85295-5aad-46d1-ac7e-eafabcb58f8b tempest-GroupSnapshotsTest-630474466 None] snapshot: 4cc5529a-ebfd-4d91-be00-a25e055b5549, volume: 5bf6e6c9-dffa-4a7c-ad69-fcfec217eb99, {{(pid=82780) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}} Sep 10 21:35:40 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a7e85295-5aad-46d1-ac7e-eafabcb58f8b tempest-GroupSnapshotsTest-630474466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:35:40 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a7e85295-5aad-46d1-ac7e-eafabcb58f8b tempest-GroupSnapshotsTest-630474466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:35:40 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a7e85295-5aad-46d1-ac7e-eafabcb58f8b tempest-GroupSnapshotsTest-630474466 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:35:40 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a7e85295-5aad-46d1-ac7e-eafabcb58f8b tempest-GroupSnapshotsTest-630474466 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:35:40 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a7e85295-5aad-46d1-ac7e-eafabcb58f8b tempest-GroupSnapshotsTest-630474466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:35:40 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[1936bb74-f4c6-4023-bc0b-5da7dea880bf]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:35:40 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a7e85295-5aad-46d1-ac7e-eafabcb58f8b tempest-GroupSnapshotsTest-630474466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d3f1bd8e-c94d-4ad0-b336-52d26a19409c.4cc5529a-ebfd-4d91-be00-a25e055b5549 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:35:40 devstack quobyte-client[82807]: System call of process 98522 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:35:40 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a7e85295-5aad-46d1-ac7e-eafabcb58f8b tempest-GroupSnapshotsTest-630474466 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d3f1bd8e-c94d-4ad0-b336-52d26a19409c.4cc5529a-ebfd-4d91-be00-a25e055b5549" returned: 0 in 0.485s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:35:40 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-a7e85295-5aad-46d1-ac7e-eafabcb58f8b tempest-GroupSnapshotsTest-630474466 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3f1bd8e-c94d-4ad0-b336-52d26a19409c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82780) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 21:35:40 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a7e85295-5aad-46d1-ac7e-eafabcb58f8b tempest-GroupSnapshotsTest-630474466 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d3f1bd8e-c94d-4ad0-b336-52d26a19409c {{(pid=82780) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}} Sep 10 21:35:40 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a7e85295-5aad-46d1-ac7e-eafabcb58f8b tempest-GroupSnapshotsTest-630474466 None] Creating direct copy from snapshot {{(pid=82780) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Sep 10 21:35:40 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b416c4-02e8-4fd0-b8b1-e0479d58cbd0]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:35:40 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a7e85295-5aad-46d1-ac7e-eafabcb58f8b tempest-GroupSnapshotsTest-630474466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d3f1bd8e-c94d-4ad0-b336-52d26a19409c {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:35:41 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a7e85295-5aad-46d1-ac7e-eafabcb58f8b tempest-GroupSnapshotsTest-630474466 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d3f1bd8e-c94d-4ad0-b336-52d26a19409c" returned: 0 in 0.481s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:35:41 devstack cinder-volume[82780]: DEBUG cinder.utils [None req-a7e85295-5aad-46d1-ac7e-eafabcb58f8b tempest-GroupSnapshotsTest-630474466 None] Path /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5bf6e6c9-dffa-4a7c-ad69-fcfec217eb99 not found in is_blk_device check {{(pid=82780) is_blk_device /opt/stack/cinder/cinder/utils.py:591}} Sep 10 21:35:41 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a7e85295-5aad-46d1-ac7e-eafabcb58f8b tempest-GroupSnapshotsTest-630474466 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d3f1bd8e-c94d-4ad0-b336-52d26a19409c /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5bf6e6c9-dffa-4a7c-ad69-fcfec217eb99 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:35:41 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=97, name=volume-5bf6e6c9-dffa-4a7c-ad69-fcfec217eb99, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:35:48 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a7e85295-5aad-46d1-ac7e-eafabcb58f8b tempest-GroupSnapshotsTest-630474466 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d3f1bd8e-c94d-4ad0-b336-52d26a19409c /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5bf6e6c9-dffa-4a7c-ad69-fcfec217eb99" returned: 0 in 7.321s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:35:48 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac650eb-9c01-43c5-b1b3-267235469683]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:35:48 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a7e85295-5aad-46d1-ac7e-eafabcb58f8b tempest-GroupSnapshotsTest-630474466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d3f1bd8e-c94d-4ad0-b336-52d26a19409c {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:35:49 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a7e85295-5aad-46d1-ac7e-eafabcb58f8b tempest-GroupSnapshotsTest-630474466 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d3f1bd8e-c94d-4ad0-b336-52d26a19409c" returned: 0 in 0.686s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:35:49 devstack cinder-volume[82780]: DEBUG cinder.image.image_utils [None req-a7e85295-5aad-46d1-ac7e-eafabcb58f8b tempest-GroupSnapshotsTest-630474466 None] Image conversion details: src /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d3f1bd8e-c94d-4ad0-b336-52d26a19409c, size 1024.00 MB, duration 7.34 sec, destination /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5bf6e6c9-dffa-4a7c-ad69-fcfec217eb99 {{(pid=82780) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 10 21:35:49 devstack cinder-volume[82780]: INFO cinder.image.image_utils [None req-a7e85295-5aad-46d1-ac7e-eafabcb58f8b tempest-GroupSnapshotsTest-630474466 None] Converted 1024.00 MB image at 139.43 MB/s Sep 10 21:35:49 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-a7e85295-5aad-46d1-ac7e-eafabcb58f8b tempest-GroupSnapshotsTest-630474466 None] File path /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5bf6e6c9-dffa-4a7c-ad69-fcfec217eb99 is being set with permissions: 660 {{(pid=82780) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 21:35:49 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a7e85295-5aad-46d1-ac7e-eafabcb58f8b tempest-GroupSnapshotsTest-630474466 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5bf6e6c9-dffa-4a7c-ad69-fcfec217eb99 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:35:49 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a7e85295-5aad-46d1-ac7e-eafabcb58f8b tempest-GroupSnapshotsTest-630474466 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5bf6e6c9-dffa-4a7c-ad69-fcfec217eb99" returned: 0 in 0.321s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:35:49 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-a7e85295-5aad-46d1-ac7e-eafabcb58f8b tempest-GroupSnapshotsTest-630474466 None] Lock "cinder-quobyte-5bf6e6c9-dffa-4a7c-ad69-fcfec217eb99" released by "_copy_volume_from_snapshot" :: held 9.745s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:35:50 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-a7e85295-5aad-46d1-ac7e-eafabcb58f8b tempest-GroupSnapshotsTest-630474466 None] Lock "cinder-quobyte-4cc5529a-ebfd-4d91-be00-a25e055b5549-5bf6e6c9-dffa-4a7c-ad69-fcfec217eb99" released by "_create_volume_from_snapshot" :: held 9.828s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:35:50 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a7e85295-5aad-46d1-ac7e-eafabcb58f8b tempest-GroupSnapshotsTest-630474466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.904s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:35:50 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-a7e85295-5aad-46d1-ac7e-eafabcb58f8b tempest-GroupSnapshotsTest-630474466 None] Create group from source-snapshot-83124649-19f3-4272-86ec-1d0e2241590f completed successfully. Sep 10 21:35:51 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-fc00db8d-970c-4cf0-b63c-597410b867cb tempest-GroupSnapshotsTest-630474466 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:35:51 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-fc00db8d-970c-4cf0-b63c-597410b867cb tempest-GroupSnapshotsTest-630474466 None] Acquiring lock "cinder-quobyte-5bf6e6c9-dffa-4a7c-ad69-fcfec217eb99" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:35:51 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-fc00db8d-970c-4cf0-b63c-597410b867cb tempest-GroupSnapshotsTest-630474466 None] Lock "cinder-quobyte-5bf6e6c9-dffa-4a7c-ad69-fcfec217eb99" acquired by "delete_volume" :: waited 0.028s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:35:52 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf5307c-9325-4e40-9789-1e4b959c9795]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:35:52 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-fc00db8d-970c-4cf0-b63c-597410b867cb tempest-GroupSnapshotsTest-630474466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5bf6e6c9-dffa-4a7c-ad69-fcfec217eb99 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:35:52 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-fc00db8d-970c-4cf0-b63c-597410b867cb tempest-GroupSnapshotsTest-630474466 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5bf6e6c9-dffa-4a7c-ad69-fcfec217eb99" returned: 0 in 0.514s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:35:52 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-fc00db8d-970c-4cf0-b63c-597410b867cb tempest-GroupSnapshotsTest-630474466 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5bf6e6c9-dffa-4a7c-ad69-fcfec217eb99 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:35:52 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-fc00db8d-970c-4cf0-b63c-597410b867cb tempest-GroupSnapshotsTest-630474466 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5bf6e6c9-dffa-4a7c-ad69-fcfec217eb99" returned: 0 in 0.139s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:35:52 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-fc00db8d-970c-4cf0-b63c-597410b867cb tempest-GroupSnapshotsTest-630474466 None] Lock "cinder-quobyte-5bf6e6c9-dffa-4a7c-ad69-fcfec217eb99" released by "delete_volume" :: held 0.891s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:35:53 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-fc00db8d-970c-4cf0-b63c-597410b867cb tempest-GroupSnapshotsTest-630474466 None] Created reservations ['33884deb-7041-41e5-b794-bf18a1b1a265'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:35:53 devstack cinder-volume[82780]: WARNING cinder.quota [None req-fc00db8d-970c-4cf0-b63c-597410b867cb tempest-GroupSnapshotsTest-630474466 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1092462717 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1092462717, it is now deprecated. Please use the default quota class for default quota. Sep 10 21:35:53 devstack cinder-volume[82780]: WARNING cinder.quota [None req-fc00db8d-970c-4cf0-b63c-597410b867cb tempest-GroupSnapshotsTest-630474466 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1092462717 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1092462717, it is now deprecated. Please use the default quota class for default quota. Sep 10 21:35:53 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-fc00db8d-970c-4cf0-b63c-597410b867cb tempest-GroupSnapshotsTest-630474466 None] Created reservations ['98f0743b-58ed-4b7d-b1d5-535345d978c7', '4ff85ebd-b8d7-42e3-abec-3a2f4b5ff837', '7b6e11f3-c7fd-4444-85e6-f3e37faabbcd', 'd6ea854c-9746-4dc2-8977-8f327e114851'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:35:53 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-fc00db8d-970c-4cf0-b63c-597410b867cb tempest-GroupSnapshotsTest-630474466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:35:53 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-fc00db8d-970c-4cf0-b63c-597410b867cb tempest-GroupSnapshotsTest-630474466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:35:53 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-fc00db8d-970c-4cf0-b63c-597410b867cb tempest-GroupSnapshotsTest-630474466 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:35:53 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-fc00db8d-970c-4cf0-b63c-597410b867cb tempest-GroupSnapshotsTest-630474466 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:35:53 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-fc00db8d-970c-4cf0-b63c-597410b867cb tempest-GroupSnapshotsTest-630474466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:35:53 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-fc00db8d-970c-4cf0-b63c-597410b867cb tempest-GroupSnapshotsTest-630474466 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:35:53 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-fc00db8d-970c-4cf0-b63c-597410b867cb tempest-GroupSnapshotsTest-630474466 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.093s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:35:53 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-fc00db8d-970c-4cf0-b63c-597410b867cb tempest-GroupSnapshotsTest-630474466 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:35:53 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-fc00db8d-970c-4cf0-b63c-597410b867cb tempest-GroupSnapshotsTest-630474466 None] Delete group completed successfully. Sep 10 21:35:54 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-55e0e546-51b0-4df1-9d44-8493879f52a5 tempest-GroupSnapshotsTest-630474466 None] group_snapshot 83124649-19f3-4272-86ec-1d0e2241590f: deleting Sep 10 21:35:54 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-55e0e546-51b0-4df1-9d44-8493879f52a5 tempest-GroupSnapshotsTest-630474466 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:35:54 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-55e0e546-51b0-4df1-9d44-8493879f52a5 tempest-GroupSnapshotsTest-630474466 None] group_snapshot 83124649-19f3-4272-86ec-1d0e2241590f: deleting {{(pid=82780) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}} Sep 10 21:35:54 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:UPDATE=58,cinder:DELETE=7,cinder:SELECT=52,cinder:INSERT=6 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:35:55 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-55e0e546-51b0-4df1-9d44-8493879f52a5 tempest-GroupSnapshotsTest-630474466 None] Acquiring lock "cinder-quobyte-d3f1bd8e-c94d-4ad0-b336-52d26a19409c" by "delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:35:55 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-55e0e546-51b0-4df1-9d44-8493879f52a5 tempest-GroupSnapshotsTest-630474466 None] Lock "cinder-quobyte-d3f1bd8e-c94d-4ad0-b336-52d26a19409c" acquired by "delete_snapshot" :: waited 0.115s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:35:55 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-55e0e546-51b0-4df1-9d44-8493879f52a5 tempest-GroupSnapshotsTest-630474466 None] Acquiring lock "cinder-quobyte-4cc5529a-ebfd-4d91-be00-a25e055b5549" by "_delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:35:55 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-55e0e546-51b0-4df1-9d44-8493879f52a5 tempest-GroupSnapshotsTest-630474466 None] Lock "cinder-quobyte-4cc5529a-ebfd-4d91-be00-a25e055b5549" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:35:55 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-55e0e546-51b0-4df1-9d44-8493879f52a5 tempest-GroupSnapshotsTest-630474466 None] Deleting offline snapshot 4cc5529a-ebfd-4d91-be00-a25e055b5549 of volume d3f1bd8e-c94d-4ad0-b336-52d26a19409c {{(pid=82780) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 21:35:55 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-55e0e546-51b0-4df1-9d44-8493879f52a5 tempest-GroupSnapshotsTest-630474466 None] snapshot_file for this snap is: volume-d3f1bd8e-c94d-4ad0-b336-52d26a19409c.4cc5529a-ebfd-4d91-be00-a25e055b5549 {{(pid=82780) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 21:35:55 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b699db-5c9e-49e4-8fad-108d1338d6d8]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:35:55 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-55e0e546-51b0-4df1-9d44-8493879f52a5 tempest-GroupSnapshotsTest-630474466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d3f1bd8e-c94d-4ad0-b336-52d26a19409c.4cc5529a-ebfd-4d91-be00-a25e055b5549 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:35:55 devstack quobyte-client[82807]: System call of process 98590 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:35:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-55e0e546-51b0-4df1-9d44-8493879f52a5 tempest-GroupSnapshotsTest-630474466 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d3f1bd8e-c94d-4ad0-b336-52d26a19409c.4cc5529a-ebfd-4d91-be00-a25e055b5549" returned: 0 in 0.697s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:35:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-55e0e546-51b0-4df1-9d44-8493879f52a5 tempest-GroupSnapshotsTest-630474466 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3f1bd8e-c94d-4ad0-b336-52d26a19409c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82780) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 21:35:56 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee084b4-0bb0-4c79-99d7-b2f62b4d0201]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:35:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-55e0e546-51b0-4df1-9d44-8493879f52a5 tempest-GroupSnapshotsTest-630474466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d3f1bd8e-c94d-4ad0-b336-52d26a19409c {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:35:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-55e0e546-51b0-4df1-9d44-8493879f52a5 tempest-GroupSnapshotsTest-630474466 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d3f1bd8e-c94d-4ad0-b336-52d26a19409c" returned: 0 in 0.483s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:35:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-55e0e546-51b0-4df1-9d44-8493879f52a5 tempest-GroupSnapshotsTest-630474466 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d3f1bd8e-c94d-4ad0-b336-52d26a19409c.4cc5529a-ebfd-4d91-be00-a25e055b5549 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:35:56 devstack quobyte-client[82807]: System call of process 98598 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:35:57 devstack cinder-volume[82780]: DEBUG oslo_service.periodic_task [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82780) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 21:35:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:35:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.017s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:35:57 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:35:57 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:35:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:35:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:35:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-55e0e546-51b0-4df1-9d44-8493879f52a5 tempest-GroupSnapshotsTest-630474466 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d3f1bd8e-c94d-4ad0-b336-52d26a19409c.4cc5529a-ebfd-4d91-be00-a25e055b5549" returned: 0 in 0.446s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:35:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-55e0e546-51b0-4df1-9d44-8493879f52a5 tempest-GroupSnapshotsTest-630474466 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d3f1bd8e-c94d-4ad0-b336-52d26a19409c.4cc5529a-ebfd-4d91-be00-a25e055b5549 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:35:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.199s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:35:57 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:35:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-55e0e546-51b0-4df1-9d44-8493879f52a5 tempest-GroupSnapshotsTest-630474466 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d3f1bd8e-c94d-4ad0-b336-52d26a19409c.4cc5529a-ebfd-4d91-be00-a25e055b5549" returned: 0 in 0.215s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:35:57 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-55e0e546-51b0-4df1-9d44-8493879f52a5 tempest-GroupSnapshotsTest-630474466 None] Lock "cinder-quobyte-4cc5529a-ebfd-4d91-be00-a25e055b5549" released by "_delete_snapshot" :: held 2.398s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:35:57 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-55e0e546-51b0-4df1-9d44-8493879f52a5 tempest-GroupSnapshotsTest-630474466 None] Lock "cinder-quobyte-d3f1bd8e-c94d-4ad0-b336-52d26a19409c" released by "delete_snapshot" :: held 2.436s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:35:57 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=44,cinder:UPDATE=57,cinder:INSERT=15,cinder:DELETE=2 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:35:57 devstack cinder-volume[82780]: WARNING cinder.quota [None req-55e0e546-51b0-4df1-9d44-8493879f52a5 tempest-GroupSnapshotsTest-630474466 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1092462717 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1092462717, it is now deprecated. Please use the default quota class for default quota. Sep 10 21:35:58 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-55e0e546-51b0-4df1-9d44-8493879f52a5 tempest-GroupSnapshotsTest-630474466 None] Created reservations ['6344faf4-d0c8-4307-837d-3768e28e8712', 'c65df5df-6ed7-4d4e-82e8-c6a78d44d248', '1f259cb0-2f0e-4d30-8c37-9d5681ace8c4', '3713a1f1-9e0c-4cee-883b-498303354b04'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:35:58 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-55e0e546-51b0-4df1-9d44-8493879f52a5 tempest-GroupSnapshotsTest-630474466 None] group_snapshot 83124649-19f3-4272-86ec-1d0e2241590f: deleted successfully Sep 10 21:35:58 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-aa617106-ea77-4087-b646-b05e9910f0ec tempest-GroupSnapshotsTest-630474466 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:35:59 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-aa617106-ea77-4087-b646-b05e9910f0ec tempest-GroupSnapshotsTest-630474466 None] Acquiring lock "cinder-quobyte-d3f1bd8e-c94d-4ad0-b336-52d26a19409c" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:35:59 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-aa617106-ea77-4087-b646-b05e9910f0ec tempest-GroupSnapshotsTest-630474466 None] Lock "cinder-quobyte-d3f1bd8e-c94d-4ad0-b336-52d26a19409c" acquired by "delete_volume" :: waited 0.034s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:35:59 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6867d45-f5ac-4e76-ba90-c6a8509251cc]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:35:59 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-aa617106-ea77-4087-b646-b05e9910f0ec tempest-GroupSnapshotsTest-630474466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d3f1bd8e-c94d-4ad0-b336-52d26a19409c {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:35:59 devstack quobyte-client[82807]: System call of process 98608 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:35:59 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-aa617106-ea77-4087-b646-b05e9910f0ec tempest-GroupSnapshotsTest-630474466 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d3f1bd8e-c94d-4ad0-b336-52d26a19409c" returned: 0 in 0.600s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:35:59 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-aa617106-ea77-4087-b646-b05e9910f0ec tempest-GroupSnapshotsTest-630474466 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d3f1bd8e-c94d-4ad0-b336-52d26a19409c {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:35:59 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-aa617106-ea77-4087-b646-b05e9910f0ec tempest-GroupSnapshotsTest-630474466 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d3f1bd8e-c94d-4ad0-b336-52d26a19409c" returned: 0 in 0.105s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:35:59 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-aa617106-ea77-4087-b646-b05e9910f0ec tempest-GroupSnapshotsTest-630474466 None] Lock "cinder-quobyte-d3f1bd8e-c94d-4ad0-b336-52d26a19409c" released by "delete_volume" :: held 0.918s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:36:00 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-aa617106-ea77-4087-b646-b05e9910f0ec tempest-GroupSnapshotsTest-630474466 None] Created reservations ['ac336e3e-ebca-479d-8aa6-d4358aa99e90'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:36:00 devstack cinder-volume[82780]: WARNING cinder.db.sqlalchemy.api [None req-aa617106-ea77-4087-b646-b05e9910f0ec tempest-GroupSnapshotsTest-630474466 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1092462717'] Sep 10 21:36:00 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-aa617106-ea77-4087-b646-b05e9910f0ec tempest-GroupSnapshotsTest-630474466 None] Created reservations ['a160dc14-2731-4b19-9803-6026bd13e049', '9727ce1e-f924-4d45-bb48-91b05520bab5', 'cf35022d-6a77-4a10-862d-ccd75d61f67a', 'c25974cb-a729-4c55-a885-c88ce8f40c29'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:36:00 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-aa617106-ea77-4087-b646-b05e9910f0ec tempest-GroupSnapshotsTest-630474466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:36:00 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-aa617106-ea77-4087-b646-b05e9910f0ec tempest-GroupSnapshotsTest-630474466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:36:00 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-aa617106-ea77-4087-b646-b05e9910f0ec tempest-GroupSnapshotsTest-630474466 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:36:00 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-aa617106-ea77-4087-b646-b05e9910f0ec tempest-GroupSnapshotsTest-630474466 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:36:00 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-aa617106-ea77-4087-b646-b05e9910f0ec tempest-GroupSnapshotsTest-630474466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:36:00 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-aa617106-ea77-4087-b646-b05e9910f0ec tempest-GroupSnapshotsTest-630474466 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:36:00 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-aa617106-ea77-4087-b646-b05e9910f0ec tempest-GroupSnapshotsTest-630474466 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.135s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:36:01 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-aa617106-ea77-4087-b646-b05e9910f0ec tempest-GroupSnapshotsTest-630474466 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:36:01 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-aa617106-ea77-4087-b646-b05e9910f0ec tempest-GroupSnapshotsTest-630474466 None] Delete group completed successfully. Sep 10 21:36:02 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-84a1b022-cb56-4a1d-b8b5-59d7db544346 tempest-GroupSnapshotsTest-630474466 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:36:02 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-84a1b022-cb56-4a1d-b8b5-59d7db544346 tempest-GroupSnapshotsTest-630474466 None] Group tempest-GroupSnapshotsTest-Group-1140146477: creating Sep 10 21:36:02 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-84a1b022-cb56-4a1d-b8b5-59d7db544346 tempest-GroupSnapshotsTest-630474466 None] Group tempest-GroupSnapshotsTest-Group-1140146477: created successfully Sep 10 21:36:02 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-84a1b022-cb56-4a1d-b8b5-59d7db544346 tempest-GroupSnapshotsTest-630474466 None] Create group completed successfully. Sep 10 21:36:05 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-f28ff32a-755d-49e6-8fdf-ea9eeac541a6 tempest-GroupSnapshotsTest-630474466 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:36:05 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-f28ff32a-755d-49e6-8fdf-ea9eeac541a6 tempest-GroupSnapshotsTest-630474466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:36:05 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-f28ff32a-755d-49e6-8fdf-ea9eeac541a6 tempest-GroupSnapshotsTest-630474466 None] Flow 'volume_create_manager' (c8b5f099-3202-47d4-a5f0-afcd4a6237c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:36:05 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-f28ff32a-755d-49e6-8fdf-ea9eeac541a6 tempest-GroupSnapshotsTest-630474466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dddc0e1d-9a71-4655-9418-492ea6bab67d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:36:05 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-f28ff32a-755d-49e6-8fdf-ea9eeac541a6 tempest-GroupSnapshotsTest-630474466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dddc0e1d-9a71-4655-9418-492ea6bab67d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1148238662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d2336015-4d4a-48e9-98d9-d0fffca7ec54,host='devstack@QuobyteHD#QuobyteHD',id=eb0e4966-9a26-4905-8383-b4f958f69c71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e814d05ca6b4cd692e805a481a5f61b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:36:05Z,use_quota=True,user_id='bdbc71ad5d354ec3ad72730134e89080',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97872e46-6415-4b83-832b-7b230e761f88),volume_type_id=97872e46-6415-4b83-832b-7b230e761f88)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:36:05 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-f28ff32a-755d-49e6-8fdf-ea9eeac541a6 tempest-GroupSnapshotsTest-630474466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (351c2276-7771-4f0c-9700-c646c504b115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:36:05 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-f28ff32a-755d-49e6-8fdf-ea9eeac541a6 tempest-GroupSnapshotsTest-630474466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (351c2276-7771-4f0c-9700-c646c504b115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:36:05 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-f28ff32a-755d-49e6-8fdf-ea9eeac541a6 tempest-GroupSnapshotsTest-630474466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56f61a44-a934-4489-85e3-4425d636ab4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:36:05 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-f28ff32a-755d-49e6-8fdf-ea9eeac541a6 tempest-GroupSnapshotsTest-630474466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56f61a44-a934-4489-85e3-4425d636ab4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb0e4966-9a26-4905-8383-b4f958f69c71', 'volume_name': 'volume-eb0e4966-9a26-4905-8383-b4f958f69c71', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:36:05 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-f28ff32a-755d-49e6-8fdf-ea9eeac541a6 tempest-GroupSnapshotsTest-630474466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d270b22-003b-4149-9e9b-4692839e6912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:36:05 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-f28ff32a-755d-49e6-8fdf-ea9eeac541a6 tempest-GroupSnapshotsTest-630474466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d270b22-003b-4149-9e9b-4692839e6912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:36:05 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-f28ff32a-755d-49e6-8fdf-ea9eeac541a6 tempest-GroupSnapshotsTest-630474466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dfe3c68-fac1-4430-9efc-5344421ec273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:36:05 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-f28ff32a-755d-49e6-8fdf-ea9eeac541a6 tempest-GroupSnapshotsTest-630474466 None] Volume eb0e4966-9a26-4905-8383-b4f958f69c71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb0e4966-9a26-4905-8383-b4f958f69c71', 'volume_size': 1} Sep 10 21:36:05 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-f28ff32a-755d-49e6-8fdf-ea9eeac541a6 tempest-GroupSnapshotsTest-630474466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:36:05 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-f28ff32a-755d-49e6-8fdf-ea9eeac541a6 tempest-GroupSnapshotsTest-630474466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:36:05 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-f28ff32a-755d-49e6-8fdf-ea9eeac541a6 tempest-GroupSnapshotsTest-630474466 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d2336015-4d4a-48e9-98d9-d0fffca7ec54,created_at=2025-09-10T19:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1148238662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d2336015-4d4a-48e9-98d9-d0fffca7ec54,host='devstack@QuobyteHD#QuobyteHD',id=eb0e4966-9a26-4905-8383-b4f958f69c71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e814d05ca6b4cd692e805a481a5f61b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:36:05Z,use_quota=True,user_id='bdbc71ad5d354ec3ad72730134e89080',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97872e46-6415-4b83-832b-7b230e761f88),volume_type_id=97872e46-6415-4b83-832b-7b230e761f88)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:36:05 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-f28ff32a-755d-49e6-8fdf-ea9eeac541a6 tempest-GroupSnapshotsTest-630474466 None] Creating volume eb0e4966-9a26-4905-8383-b4f958f69c71 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:36:05 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-f28ff32a-755d-49e6-8fdf-ea9eeac541a6 tempest-GroupSnapshotsTest-630474466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:36:05 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-f28ff32a-755d-49e6-8fdf-ea9eeac541a6 tempest-GroupSnapshotsTest-630474466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:36:05 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-f28ff32a-755d-49e6-8fdf-ea9eeac541a6 tempest-GroupSnapshotsTest-630474466 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:36:05 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-f28ff32a-755d-49e6-8fdf-ea9eeac541a6 tempest-GroupSnapshotsTest-630474466 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:36:05 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-f28ff32a-755d-49e6-8fdf-ea9eeac541a6 tempest-GroupSnapshotsTest-630474466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:36:05 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-f28ff32a-755d-49e6-8fdf-ea9eeac541a6 tempest-GroupSnapshotsTest-630474466 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:36:05 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-f28ff32a-755d-49e6-8fdf-ea9eeac541a6 tempest-GroupSnapshotsTest-630474466 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:36:05 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f28ff32a-755d-49e6-8fdf-ea9eeac541a6 tempest-GroupSnapshotsTest-630474466 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eb0e4966-9a26-4905-8383-b4f958f69c71 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:36:05 devstack quobyte-client[82807]: System call of process 98686 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:36:05 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=98, name=volume-eb0e4966-9a26-4905-8383-b4f958f69c71, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:36:06 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f28ff32a-755d-49e6-8fdf-ea9eeac541a6 tempest-GroupSnapshotsTest-630474466 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eb0e4966-9a26-4905-8383-b4f958f69c71 1073741824" returned: 0 in 0.673s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:36:06 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f28ff32a-755d-49e6-8fdf-ea9eeac541a6 tempest-GroupSnapshotsTest-630474466 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eb0e4966-9a26-4905-8383-b4f958f69c71 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:36:06 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f28ff32a-755d-49e6-8fdf-ea9eeac541a6 tempest-GroupSnapshotsTest-630474466 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eb0e4966-9a26-4905-8383-b4f958f69c71" returned: 0 in 0.193s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:36:06 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-f28ff32a-755d-49e6-8fdf-ea9eeac541a6 tempest-GroupSnapshotsTest-630474466 None] <== create_volume: return (1012ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:36:06 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-f28ff32a-755d-49e6-8fdf-ea9eeac541a6 tempest-GroupSnapshotsTest-630474466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:36:06 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-f28ff32a-755d-49e6-8fdf-ea9eeac541a6 tempest-GroupSnapshotsTest-630474466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dfe3c68-fac1-4430-9efc-5344421ec273) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb0e4966-9a26-4905-8383-b4f958f69c71', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:36:06 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-f28ff32a-755d-49e6-8fdf-ea9eeac541a6 tempest-GroupSnapshotsTest-630474466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f95efa44-1fae-4d6b-99d8-1306045fe089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:36:06 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-f28ff32a-755d-49e6-8fdf-ea9eeac541a6 tempest-GroupSnapshotsTest-630474466 None] Volume volume-eb0e4966-9a26-4905-8383-b4f958f69c71 (eb0e4966-9a26-4905-8383-b4f958f69c71): created successfully Sep 10 21:36:06 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-f28ff32a-755d-49e6-8fdf-ea9eeac541a6 tempest-GroupSnapshotsTest-630474466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f95efa44-1fae-4d6b-99d8-1306045fe089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:36:07 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-f28ff32a-755d-49e6-8fdf-ea9eeac541a6 tempest-GroupSnapshotsTest-630474466 None] Flow 'volume_create_manager' (c8b5f099-3202-47d4-a5f0-afcd4a6237c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:36:07 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-f28ff32a-755d-49e6-8fdf-ea9eeac541a6 tempest-GroupSnapshotsTest-630474466 None] Created volume successfully. Sep 10 21:36:09 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-4ea2f5e8-4c0c-4481-9bb8-ba92280743f8 tempest-GroupSnapshotsTest-630474466 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:36:09 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ea2f5e8-4c0c-4481-9bb8-ba92280743f8 tempest-GroupSnapshotsTest-630474466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:36:09 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4ea2f5e8-4c0c-4481-9bb8-ba92280743f8 tempest-GroupSnapshotsTest-630474466 None] Flow 'volume_create_manager' (efc65b7f-127d-4abf-9472-5fa241be6886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:36:09 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4ea2f5e8-4c0c-4481-9bb8-ba92280743f8 tempest-GroupSnapshotsTest-630474466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd9f71d5-dab7-44c9-9604-933a844700cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:36:10 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4ea2f5e8-4c0c-4481-9bb8-ba92280743f8 tempest-GroupSnapshotsTest-630474466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd9f71d5-dab7-44c9-9604-933a844700cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1381562204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d2336015-4d4a-48e9-98d9-d0fffca7ec54,host='devstack@QuobyteHD#QuobyteHD',id=d16629f5-5163-48b7-9092-bedd80502f78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e814d05ca6b4cd692e805a481a5f61b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:36:10Z,use_quota=True,user_id='bdbc71ad5d354ec3ad72730134e89080',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97872e46-6415-4b83-832b-7b230e761f88),volume_type_id=97872e46-6415-4b83-832b-7b230e761f88)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:36:10 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4ea2f5e8-4c0c-4481-9bb8-ba92280743f8 tempest-GroupSnapshotsTest-630474466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc91f869-d5d7-4f35-820d-42cd6ec8d877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:36:10 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4ea2f5e8-4c0c-4481-9bb8-ba92280743f8 tempest-GroupSnapshotsTest-630474466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc91f869-d5d7-4f35-820d-42cd6ec8d877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:36:10 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4ea2f5e8-4c0c-4481-9bb8-ba92280743f8 tempest-GroupSnapshotsTest-630474466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18acafd6-2375-4152-8d02-291a77ccafda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:36:10 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4ea2f5e8-4c0c-4481-9bb8-ba92280743f8 tempest-GroupSnapshotsTest-630474466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18acafd6-2375-4152-8d02-291a77ccafda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd16629f5-5163-48b7-9092-bedd80502f78', 'volume_name': 'volume-d16629f5-5163-48b7-9092-bedd80502f78', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:36:10 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4ea2f5e8-4c0c-4481-9bb8-ba92280743f8 tempest-GroupSnapshotsTest-630474466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e565d495-8397-4933-ac72-4ae76d9bef80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:36:10 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4ea2f5e8-4c0c-4481-9bb8-ba92280743f8 tempest-GroupSnapshotsTest-630474466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e565d495-8397-4933-ac72-4ae76d9bef80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:36:10 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4ea2f5e8-4c0c-4481-9bb8-ba92280743f8 tempest-GroupSnapshotsTest-630474466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b02835e0-e3ac-40f6-af74-3e78b9871df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:36:10 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-4ea2f5e8-4c0c-4481-9bb8-ba92280743f8 tempest-GroupSnapshotsTest-630474466 None] Volume d16629f5-5163-48b7-9092-bedd80502f78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d16629f5-5163-48b7-9092-bedd80502f78', 'volume_size': 1} Sep 10 21:36:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-4ea2f5e8-4c0c-4481-9bb8-ba92280743f8 tempest-GroupSnapshotsTest-630474466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:36:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-4ea2f5e8-4c0c-4481-9bb8-ba92280743f8 tempest-GroupSnapshotsTest-630474466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:36:10 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-4ea2f5e8-4c0c-4481-9bb8-ba92280743f8 tempest-GroupSnapshotsTest-630474466 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d2336015-4d4a-48e9-98d9-d0fffca7ec54,created_at=2025-09-10T19:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1381562204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d2336015-4d4a-48e9-98d9-d0fffca7ec54,host='devstack@QuobyteHD#QuobyteHD',id=d16629f5-5163-48b7-9092-bedd80502f78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e814d05ca6b4cd692e805a481a5f61b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:36:10Z,use_quota=True,user_id='bdbc71ad5d354ec3ad72730134e89080',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97872e46-6415-4b83-832b-7b230e761f88),volume_type_id=97872e46-6415-4b83-832b-7b230e761f88)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:36:10 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-4ea2f5e8-4c0c-4481-9bb8-ba92280743f8 tempest-GroupSnapshotsTest-630474466 None] Creating volume d16629f5-5163-48b7-9092-bedd80502f78 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:36:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-4ea2f5e8-4c0c-4481-9bb8-ba92280743f8 tempest-GroupSnapshotsTest-630474466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:36:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-4ea2f5e8-4c0c-4481-9bb8-ba92280743f8 tempest-GroupSnapshotsTest-630474466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:36:10 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-4ea2f5e8-4c0c-4481-9bb8-ba92280743f8 tempest-GroupSnapshotsTest-630474466 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:36:10 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-4ea2f5e8-4c0c-4481-9bb8-ba92280743f8 tempest-GroupSnapshotsTest-630474466 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:36:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-4ea2f5e8-4c0c-4481-9bb8-ba92280743f8 tempest-GroupSnapshotsTest-630474466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:36:10 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-4ea2f5e8-4c0c-4481-9bb8-ba92280743f8 tempest-GroupSnapshotsTest-630474466 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:36:10 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-4ea2f5e8-4c0c-4481-9bb8-ba92280743f8 tempest-GroupSnapshotsTest-630474466 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:36:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4ea2f5e8-4c0c-4481-9bb8-ba92280743f8 tempest-GroupSnapshotsTest-630474466 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d16629f5-5163-48b7-9092-bedd80502f78 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:36:10 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=99, name=volume-d16629f5-5163-48b7-9092-bedd80502f78, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:36:11 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4ea2f5e8-4c0c-4481-9bb8-ba92280743f8 tempest-GroupSnapshotsTest-630474466 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d16629f5-5163-48b7-9092-bedd80502f78 1073741824" returned: 0 in 0.622s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:36:11 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4ea2f5e8-4c0c-4481-9bb8-ba92280743f8 tempest-GroupSnapshotsTest-630474466 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d16629f5-5163-48b7-9092-bedd80502f78 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:36:11 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4ea2f5e8-4c0c-4481-9bb8-ba92280743f8 tempest-GroupSnapshotsTest-630474466 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d16629f5-5163-48b7-9092-bedd80502f78" returned: 0 in 0.202s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:36:11 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-4ea2f5e8-4c0c-4481-9bb8-ba92280743f8 tempest-GroupSnapshotsTest-630474466 None] <== create_volume: return (946ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:36:11 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-4ea2f5e8-4c0c-4481-9bb8-ba92280743f8 tempest-GroupSnapshotsTest-630474466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:36:11 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-48ba93d1-b656-4fc3-b466-bad0a7b43feb req-a9e4bfdb-0233-40c4-b2fe-00793dd7e425 tempest-TestShelveInstance-1183991641 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:36:11 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4ea2f5e8-4c0c-4481-9bb8-ba92280743f8 tempest-GroupSnapshotsTest-630474466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b02835e0-e3ac-40f6-af74-3e78b9871df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d16629f5-5163-48b7-9092-bedd80502f78', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:36:11 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4ea2f5e8-4c0c-4481-9bb8-ba92280743f8 tempest-GroupSnapshotsTest-630474466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4771ceda-851c-4528-83f9-c7c1307a07b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:36:11 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-48ba93d1-b656-4fc3-b466-bad0a7b43feb req-a9e4bfdb-0233-40c4-b2fe-00793dd7e425 tempest-TestShelveInstance-1183991641 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:36:11 devstack cinder-volume[82780]: INFO cinder.volume.manager [req-48ba93d1-b656-4fc3-b466-bad0a7b43feb req-a9e4bfdb-0233-40c4-b2fe-00793dd7e425 tempest-TestShelveInstance-1183991641 None] Terminate volume connection completed successfully. Sep 10 21:36:11 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-48ba93d1-b656-4fc3-b466-bad0a7b43feb req-a9e4bfdb-0233-40c4-b2fe-00793dd7e425 tempest-TestShelveInstance-1183991641 None] Deleting attachment da1adf93-e501-493e-a45a-86fe60548bde. {{(pid=82780) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 21:36:11 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-4ea2f5e8-4c0c-4481-9bb8-ba92280743f8 tempest-GroupSnapshotsTest-630474466 None] Volume volume-d16629f5-5163-48b7-9092-bedd80502f78 (d16629f5-5163-48b7-9092-bedd80502f78): created successfully Sep 10 21:36:11 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4ea2f5e8-4c0c-4481-9bb8-ba92280743f8 tempest-GroupSnapshotsTest-630474466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4771ceda-851c-4528-83f9-c7c1307a07b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:36:11 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4ea2f5e8-4c0c-4481-9bb8-ba92280743f8 tempest-GroupSnapshotsTest-630474466 None] Flow 'volume_create_manager' (efc65b7f-127d-4abf-9472-5fa241be6886) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:36:11 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-4ea2f5e8-4c0c-4481-9bb8-ba92280743f8 tempest-GroupSnapshotsTest-630474466 None] Created volume successfully. Sep 10 21:36:12 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-79bc371e-4eba-470d-8fb5-a23ba343b9d2 tempest-GroupSnapshotsTest-630474466 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:36:12 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-79bc371e-4eba-470d-8fb5-a23ba343b9d2 tempest-GroupSnapshotsTest-630474466 None] Update group completed successfully. Sep 10 21:36:13 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-543cafba-82ce-4dd5-a7a5-e77888f62d5e tempest-GroupSnapshotsTest-630474466 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:36:13 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-543cafba-82ce-4dd5-a7a5-e77888f62d5e tempest-GroupSnapshotsTest-630474466 None] Update group completed successfully. Sep 10 21:36:14 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-ac42f2ed-aeaf-44be-8e7e-ae2a31dd3735 tempest-GroupSnapshotsTest-630474466 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:36:14 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-ac42f2ed-aeaf-44be-8e7e-ae2a31dd3735 tempest-GroupSnapshotsTest-630474466 None] Update group completed successfully. Sep 10 21:36:16 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-c48754ef-77d8-483c-bd54-ea600fe5f2a6 tempest-GroupSnapshotsTest-630474466 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:36:16 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-c48754ef-77d8-483c-bd54-ea600fe5f2a6 tempest-GroupSnapshotsTest-630474466 None] Update group completed successfully. Sep 10 21:36:17 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-3d620035-3ff3-4186-a29e-efb2d36e9efe tempest-GroupSnapshotsTest-630474466 None] GroupSnapshot 56b3c4d9-b96e-4d88-8f35-331184a2bd88: creating. Sep 10 21:36:17 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-3d620035-3ff3-4186-a29e-efb2d36e9efe tempest-GroupSnapshotsTest-630474466 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:36:17 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-3d620035-3ff3-4186-a29e-efb2d36e9efe tempest-GroupSnapshotsTest-630474466 None] Group snapshot 56b3c4d9-b96e-4d88-8f35-331184a2bd88: creating. {{(pid=82780) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}} Sep 10 21:36:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-3d620035-3ff3-4186-a29e-efb2d36e9efe tempest-GroupSnapshotsTest-630474466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:36:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-3d620035-3ff3-4186-a29e-efb2d36e9efe tempest-GroupSnapshotsTest-630474466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:36:17 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-3d620035-3ff3-4186-a29e-efb2d36e9efe tempest-GroupSnapshotsTest-630474466 None] Creating offline snapshot 2d4ce596-1267-4a5e-9164-59efb0d8c2d9 of volume d16629f5-5163-48b7-9092-bedd80502f78 {{(pid=82780) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 21:36:18 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[34aeb781-624a-4d0f-a225-548fdb45a33d]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:36:18 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-3d620035-3ff3-4186-a29e-efb2d36e9efe tempest-GroupSnapshotsTest-630474466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d16629f5-5163-48b7-9092-bedd80502f78 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:36:18 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-3d620035-3ff3-4186-a29e-efb2d36e9efe tempest-GroupSnapshotsTest-630474466 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d16629f5-5163-48b7-9092-bedd80502f78" returned: 0 in 0.512s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:36:18 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-3d620035-3ff3-4186-a29e-efb2d36e9efe tempest-GroupSnapshotsTest-630474466 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d16629f5-5163-48b7-9092-bedd80502f78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d16629f5-5163-48b7-9092-bedd80502f78.2d4ce596-1267-4a5e-9164-59efb0d8c2d9 1G {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:36:18 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=100, name=volume-d16629f5-5163-48b7-9092-bedd80502f78.2d4ce596-1267-4a5e-9164-59efb0d8c2d9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:36:18 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-3d620035-3ff3-4186-a29e-efb2d36e9efe tempest-GroupSnapshotsTest-630474466 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d16629f5-5163-48b7-9092-bedd80502f78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d16629f5-5163-48b7-9092-bedd80502f78.2d4ce596-1267-4a5e-9164-59efb0d8c2d9 1G" returned: 0 in 0.354s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:36:18 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-3d620035-3ff3-4186-a29e-efb2d36e9efe tempest-GroupSnapshotsTest-630474466 None] Running cmd (subprocess): qemu-img rebase -u -b volume-d16629f5-5163-48b7-9092-bedd80502f78 -F qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d16629f5-5163-48b7-9092-bedd80502f78.2d4ce596-1267-4a5e-9164-59efb0d8c2d9 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:36:19 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-3d620035-3ff3-4186-a29e-efb2d36e9efe tempest-GroupSnapshotsTest-630474466 None] CMD "qemu-img rebase -u -b volume-d16629f5-5163-48b7-9092-bedd80502f78 -F qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d16629f5-5163-48b7-9092-bedd80502f78.2d4ce596-1267-4a5e-9164-59efb0d8c2d9" returned: 0 in 0.182s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:36:19 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-3d620035-3ff3-4186-a29e-efb2d36e9efe tempest-GroupSnapshotsTest-630474466 None] File path /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d16629f5-5163-48b7-9092-bedd80502f78.2d4ce596-1267-4a5e-9164-59efb0d8c2d9 is being set with permissions: 660 {{(pid=82780) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 21:36:19 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-3d620035-3ff3-4186-a29e-efb2d36e9efe tempest-GroupSnapshotsTest-630474466 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d16629f5-5163-48b7-9092-bedd80502f78.2d4ce596-1267-4a5e-9164-59efb0d8c2d9 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:36:19 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-3d620035-3ff3-4186-a29e-efb2d36e9efe tempest-GroupSnapshotsTest-630474466 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d16629f5-5163-48b7-9092-bedd80502f78.2d4ce596-1267-4a5e-9164-59efb0d8c2d9" returned: 0 in 0.214s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:36:19 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-3d620035-3ff3-4186-a29e-efb2d36e9efe tempest-GroupSnapshotsTest-630474466 None] Setting permissions: /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d16629f5-5163-48b7-9092-bedd80502f78 -> 1000:1000 {{(pid=82780) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 21:36:19 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-3d620035-3ff3-4186-a29e-efb2d36e9efe tempest-GroupSnapshotsTest-630474466 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d16629f5-5163-48b7-9092-bedd80502f78 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d16629f5-5163-48b7-9092-bedd80502f78.2d4ce596-1267-4a5e-9164-59efb0d8c2d9 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:36:19 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-3d620035-3ff3-4186-a29e-efb2d36e9efe tempest-GroupSnapshotsTest-630474466 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d16629f5-5163-48b7-9092-bedd80502f78 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d16629f5-5163-48b7-9092-bedd80502f78.2d4ce596-1267-4a5e-9164-59efb0d8c2d9" returned: 0 in 0.133s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:36:19 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-3d620035-3ff3-4186-a29e-efb2d36e9efe tempest-GroupSnapshotsTest-630474466 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d16629f5-5163-48b7-9092-bedd80502f78.info {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:36:19 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-3d620035-3ff3-4186-a29e-efb2d36e9efe tempest-GroupSnapshotsTest-630474466 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d16629f5-5163-48b7-9092-bedd80502f78.info" returned: 0 in 0.179s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:36:19 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-3d620035-3ff3-4186-a29e-efb2d36e9efe tempest-GroupSnapshotsTest-630474466 None] File path /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d16629f5-5163-48b7-9092-bedd80502f78.info is being set with permissions: 660 {{(pid=82780) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 21:36:19 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-3d620035-3ff3-4186-a29e-efb2d36e9efe tempest-GroupSnapshotsTest-630474466 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d16629f5-5163-48b7-9092-bedd80502f78.info {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:36:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-3d620035-3ff3-4186-a29e-efb2d36e9efe tempest-GroupSnapshotsTest-630474466 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d16629f5-5163-48b7-9092-bedd80502f78.info" returned: 0 in 0.341s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:36:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-3d620035-3ff3-4186-a29e-efb2d36e9efe tempest-GroupSnapshotsTest-630474466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.350s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:36:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-3d620035-3ff3-4186-a29e-efb2d36e9efe tempest-GroupSnapshotsTest-630474466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:36:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-3d620035-3ff3-4186-a29e-efb2d36e9efe tempest-GroupSnapshotsTest-630474466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:36:20 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-3d620035-3ff3-4186-a29e-efb2d36e9efe tempest-GroupSnapshotsTest-630474466 None] Creating offline snapshot 67556014-af93-4518-b196-64754e9c7bf2 of volume eb0e4966-9a26-4905-8383-b4f958f69c71 {{(pid=82780) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 21:36:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-4860e56d-ac0f-4ad7-a6ab-83e1aebc361e req-719cb5d7-ebeb-4108-ab99-a7da16d0fe2c tempest-TestShelveInstance-1183991641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:36:20 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace67505-8dc7-445f-8e22-aa1c6c67340d]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:36:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-3d620035-3ff3-4186-a29e-efb2d36e9efe tempest-GroupSnapshotsTest-630474466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eb0e4966-9a26-4905-8383-b4f958f69c71 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:36:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-3d620035-3ff3-4186-a29e-efb2d36e9efe tempest-GroupSnapshotsTest-630474466 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eb0e4966-9a26-4905-8383-b4f958f69c71" returned: 0 in 0.487s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:36:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-3d620035-3ff3-4186-a29e-efb2d36e9efe tempest-GroupSnapshotsTest-630474466 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eb0e4966-9a26-4905-8383-b4f958f69c71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eb0e4966-9a26-4905-8383-b4f958f69c71.67556014-af93-4518-b196-64754e9c7bf2 1G {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:36:21 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=102, name=volume-eb0e4966-9a26-4905-8383-b4f958f69c71.67556014-af93-4518-b196-64754e9c7bf2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:36:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-3d620035-3ff3-4186-a29e-efb2d36e9efe tempest-GroupSnapshotsTest-630474466 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eb0e4966-9a26-4905-8383-b4f958f69c71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eb0e4966-9a26-4905-8383-b4f958f69c71.67556014-af93-4518-b196-64754e9c7bf2 1G" returned: 0 in 0.324s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:36:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-3d620035-3ff3-4186-a29e-efb2d36e9efe tempest-GroupSnapshotsTest-630474466 None] Running cmd (subprocess): qemu-img rebase -u -b volume-eb0e4966-9a26-4905-8383-b4f958f69c71 -F qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eb0e4966-9a26-4905-8383-b4f958f69c71.67556014-af93-4518-b196-64754e9c7bf2 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:36:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-3d620035-3ff3-4186-a29e-efb2d36e9efe tempest-GroupSnapshotsTest-630474466 None] CMD "qemu-img rebase -u -b volume-eb0e4966-9a26-4905-8383-b4f958f69c71 -F qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eb0e4966-9a26-4905-8383-b4f958f69c71.67556014-af93-4518-b196-64754e9c7bf2" returned: 0 in 0.187s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:36:21 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-3d620035-3ff3-4186-a29e-efb2d36e9efe tempest-GroupSnapshotsTest-630474466 None] File path /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eb0e4966-9a26-4905-8383-b4f958f69c71.67556014-af93-4518-b196-64754e9c7bf2 is being set with permissions: 660 {{(pid=82780) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 21:36:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-3d620035-3ff3-4186-a29e-efb2d36e9efe tempest-GroupSnapshotsTest-630474466 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eb0e4966-9a26-4905-8383-b4f958f69c71.67556014-af93-4518-b196-64754e9c7bf2 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:36:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-3d620035-3ff3-4186-a29e-efb2d36e9efe tempest-GroupSnapshotsTest-630474466 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eb0e4966-9a26-4905-8383-b4f958f69c71.67556014-af93-4518-b196-64754e9c7bf2" returned: 0 in 0.101s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:36:21 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-3d620035-3ff3-4186-a29e-efb2d36e9efe tempest-GroupSnapshotsTest-630474466 None] Setting permissions: /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eb0e4966-9a26-4905-8383-b4f958f69c71 -> 1000:1000 {{(pid=82780) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 21:36:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-3d620035-3ff3-4186-a29e-efb2d36e9efe tempest-GroupSnapshotsTest-630474466 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eb0e4966-9a26-4905-8383-b4f958f69c71 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eb0e4966-9a26-4905-8383-b4f958f69c71.67556014-af93-4518-b196-64754e9c7bf2 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:36:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-3d620035-3ff3-4186-a29e-efb2d36e9efe tempest-GroupSnapshotsTest-630474466 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eb0e4966-9a26-4905-8383-b4f958f69c71 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eb0e4966-9a26-4905-8383-b4f958f69c71.67556014-af93-4518-b196-64754e9c7bf2" returned: 0 in 0.103s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:36:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-3d620035-3ff3-4186-a29e-efb2d36e9efe tempest-GroupSnapshotsTest-630474466 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eb0e4966-9a26-4905-8383-b4f958f69c71.info {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:36:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-3d620035-3ff3-4186-a29e-efb2d36e9efe tempest-GroupSnapshotsTest-630474466 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eb0e4966-9a26-4905-8383-b4f958f69c71.info" returned: 0 in 0.119s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:36:21 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-3d620035-3ff3-4186-a29e-efb2d36e9efe tempest-GroupSnapshotsTest-630474466 None] File path /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eb0e4966-9a26-4905-8383-b4f958f69c71.info is being set with permissions: 660 {{(pid=82780) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 21:36:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-3d620035-3ff3-4186-a29e-efb2d36e9efe tempest-GroupSnapshotsTest-630474466 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eb0e4966-9a26-4905-8383-b4f958f69c71.info {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:36:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-3d620035-3ff3-4186-a29e-efb2d36e9efe tempest-GroupSnapshotsTest-630474466 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eb0e4966-9a26-4905-8383-b4f958f69c71.info" returned: 0 in 0.103s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:36:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-3d620035-3ff3-4186-a29e-efb2d36e9efe tempest-GroupSnapshotsTest-630474466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.891s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:36:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-4860e56d-ac0f-4ad7-a6ab-83e1aebc361e req-719cb5d7-ebeb-4108-ab99-a7da16d0fe2c tempest-TestShelveInstance-1183991641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.867s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:36:22 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ecead1b-ca85-4af6-b37c-8b0847dc3a9c]: (4, 'raw') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:36:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-4860e56d-ac0f-4ad7-a6ab-83e1aebc361e req-719cb5d7-ebeb-4108-ab99-a7da16d0fe2c tempest-TestShelveInstance-1183991641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-4981e10c-be5f-49d8-9abb-009ee0cac6b6 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:36:23 devstack quobyte-client[82807]: System call of process 98762 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:36:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-4860e56d-ac0f-4ad7-a6ab-83e1aebc361e req-719cb5d7-ebeb-4108-ab99-a7da16d0fe2c tempest-TestShelveInstance-1183991641 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-4981e10c-be5f-49d8-9abb-009ee0cac6b6" returned: 0 in 0.615s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:36:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-4860e56d-ac0f-4ad7-a6ab-83e1aebc361e req-719cb5d7-ebeb-4108-ab99-a7da16d0fe2c tempest-TestShelveInstance-1183991641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-4981e10c-be5f-49d8-9abb-009ee0cac6b6 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:36:23 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-3d620035-3ff3-4186-a29e-efb2d36e9efe tempest-GroupSnapshotsTest-630474466 None] group_snapshot 56b3c4d9-b96e-4d88-8f35-331184a2bd88: created successfully Sep 10 21:36:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-4860e56d-ac0f-4ad7-a6ab-83e1aebc361e req-719cb5d7-ebeb-4108-ab99-a7da16d0fe2c tempest-TestShelveInstance-1183991641 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-4981e10c-be5f-49d8-9abb-009ee0cac6b6" returned: 1 in 0.576s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:36:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-4860e56d-ac0f-4ad7-a6ab-83e1aebc361e req-719cb5d7-ebeb-4108-ab99-a7da16d0fe2c tempest-TestShelveInstance-1183991641 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-4981e10c-be5f-49d8-9abb-009ee0cac6b6' failed. Not Retrying. {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 21:36:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-4860e56d-ac0f-4ad7-a6ab-83e1aebc361e req-719cb5d7-ebeb-4108-ab99-a7da16d0fe2c tempest-TestShelveInstance-1183991641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.389s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:36:23 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-1f87f9c6-adb5-4446-a1d8-96ca9e472ffd tempest-GroupSnapshotsTest-630474466 None] group_snapshot 56b3c4d9-b96e-4d88-8f35-331184a2bd88: deleting Sep 10 21:36:23 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-1f87f9c6-adb5-4446-a1d8-96ca9e472ffd tempest-GroupSnapshotsTest-630474466 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:36:23 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1f87f9c6-adb5-4446-a1d8-96ca9e472ffd tempest-GroupSnapshotsTest-630474466 None] group_snapshot 56b3c4d9-b96e-4d88-8f35-331184a2bd88: deleting {{(pid=82780) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}} Sep 10 21:36:23 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-4860e56d-ac0f-4ad7-a6ab-83e1aebc361e req-719cb5d7-ebeb-4108-ab99-a7da16d0fe2c tempest-TestShelveInstance-1183991641 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b', 'name': 'volume-4981e10c-be5f-49d8-9abb-009ee0cac6b6', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7f982fe9-c752-4713-8d75-a2f52afd850d', 'enforce_multipath': True} {{(pid=82780) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 21:36:23 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-4860e56d-ac0f-4ad7-a6ab-83e1aebc361e req-719cb5d7-ebeb-4108-ab99-a7da16d0fe2c tempest-TestShelveInstance-1183991641 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:36:23 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-1f87f9c6-adb5-4446-a1d8-96ca9e472ffd tempest-GroupSnapshotsTest-630474466 None] Acquiring lock "cinder-quobyte-d16629f5-5163-48b7-9092-bedd80502f78" by "delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:36:23 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-1f87f9c6-adb5-4446-a1d8-96ca9e472ffd tempest-GroupSnapshotsTest-630474466 None] Lock "cinder-quobyte-d16629f5-5163-48b7-9092-bedd80502f78" acquired by "delete_snapshot" :: waited 0.081s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:36:23 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-1f87f9c6-adb5-4446-a1d8-96ca9e472ffd tempest-GroupSnapshotsTest-630474466 None] Acquiring lock "cinder-quobyte-2d4ce596-1267-4a5e-9164-59efb0d8c2d9" by "_delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:36:24 devstack cinder-volume[82780]: INFO cinder.volume.manager [req-4860e56d-ac0f-4ad7-a6ab-83e1aebc361e req-719cb5d7-ebeb-4108-ab99-a7da16d0fe2c tempest-TestShelveInstance-1183991641 None] attachment_update completed successfully. Sep 10 21:36:24 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-1f87f9c6-adb5-4446-a1d8-96ca9e472ffd tempest-GroupSnapshotsTest-630474466 None] Lock "cinder-quobyte-2d4ce596-1267-4a5e-9164-59efb0d8c2d9" acquired by "_delete_snapshot" :: waited 0.091s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:36:24 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-1f87f9c6-adb5-4446-a1d8-96ca9e472ffd tempest-GroupSnapshotsTest-630474466 None] Deleting offline snapshot 2d4ce596-1267-4a5e-9164-59efb0d8c2d9 of volume d16629f5-5163-48b7-9092-bedd80502f78 {{(pid=82780) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 21:36:24 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-1f87f9c6-adb5-4446-a1d8-96ca9e472ffd tempest-GroupSnapshotsTest-630474466 None] snapshot_file for this snap is: volume-d16629f5-5163-48b7-9092-bedd80502f78.2d4ce596-1267-4a5e-9164-59efb0d8c2d9 {{(pid=82780) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 21:36:24 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[527437fc-3c7a-4335-bcf6-abf25e44555a]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:36:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1f87f9c6-adb5-4446-a1d8-96ca9e472ffd tempest-GroupSnapshotsTest-630474466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d16629f5-5163-48b7-9092-bedd80502f78.2d4ce596-1267-4a5e-9164-59efb0d8c2d9 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:36:24 devstack quobyte-client[82807]: System call of process 98767 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:36:24 devstack quobyte-client[82807]: System call of process 98767 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:36:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1f87f9c6-adb5-4446-a1d8-96ca9e472ffd tempest-GroupSnapshotsTest-630474466 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d16629f5-5163-48b7-9092-bedd80502f78.2d4ce596-1267-4a5e-9164-59efb0d8c2d9" returned: 0 in 0.586s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:36:24 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-1f87f9c6-adb5-4446-a1d8-96ca9e472ffd tempest-GroupSnapshotsTest-630474466 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d16629f5-5163-48b7-9092-bedd80502f78(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82780) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 21:36:24 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[002fed18-9f96-48a2-afad-2f33c9887528]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:36:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1f87f9c6-adb5-4446-a1d8-96ca9e472ffd tempest-GroupSnapshotsTest-630474466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d16629f5-5163-48b7-9092-bedd80502f78 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:36:25 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1f87f9c6-adb5-4446-a1d8-96ca9e472ffd tempest-GroupSnapshotsTest-630474466 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d16629f5-5163-48b7-9092-bedd80502f78" returned: 0 in 0.481s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:36:25 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1f87f9c6-adb5-4446-a1d8-96ca9e472ffd tempest-GroupSnapshotsTest-630474466 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d16629f5-5163-48b7-9092-bedd80502f78.2d4ce596-1267-4a5e-9164-59efb0d8c2d9 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:36:25 devstack quobyte-client[82807]: System call of process 98773 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:36:25 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1f87f9c6-adb5-4446-a1d8-96ca9e472ffd tempest-GroupSnapshotsTest-630474466 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d16629f5-5163-48b7-9092-bedd80502f78.2d4ce596-1267-4a5e-9164-59efb0d8c2d9" returned: 0 in 0.217s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:36:25 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1f87f9c6-adb5-4446-a1d8-96ca9e472ffd tempest-GroupSnapshotsTest-630474466 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d16629f5-5163-48b7-9092-bedd80502f78.2d4ce596-1267-4a5e-9164-59efb0d8c2d9 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:36:25 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1f87f9c6-adb5-4446-a1d8-96ca9e472ffd tempest-GroupSnapshotsTest-630474466 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d16629f5-5163-48b7-9092-bedd80502f78.2d4ce596-1267-4a5e-9164-59efb0d8c2d9" returned: 0 in 0.115s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:36:25 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-1f87f9c6-adb5-4446-a1d8-96ca9e472ffd tempest-GroupSnapshotsTest-630474466 None] Lock "cinder-quobyte-2d4ce596-1267-4a5e-9164-59efb0d8c2d9" released by "_delete_snapshot" :: held 1.859s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:36:25 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-1f87f9c6-adb5-4446-a1d8-96ca9e472ffd tempest-GroupSnapshotsTest-630474466 None] Lock "cinder-quobyte-d16629f5-5163-48b7-9092-bedd80502f78" released by "delete_snapshot" :: held 1.970s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:36:26 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-1f87f9c6-adb5-4446-a1d8-96ca9e472ffd tempest-GroupSnapshotsTest-630474466 None] Acquiring lock "cinder-quobyte-eb0e4966-9a26-4905-8383-b4f958f69c71" by "delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:36:26 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-1f87f9c6-adb5-4446-a1d8-96ca9e472ffd tempest-GroupSnapshotsTest-630474466 None] Lock "cinder-quobyte-eb0e4966-9a26-4905-8383-b4f958f69c71" acquired by "delete_snapshot" :: waited 0.022s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:36:26 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-1f87f9c6-adb5-4446-a1d8-96ca9e472ffd tempest-GroupSnapshotsTest-630474466 None] Acquiring lock "cinder-quobyte-67556014-af93-4518-b196-64754e9c7bf2" by "_delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:36:26 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-1f87f9c6-adb5-4446-a1d8-96ca9e472ffd tempest-GroupSnapshotsTest-630474466 None] Lock "cinder-quobyte-67556014-af93-4518-b196-64754e9c7bf2" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:36:26 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-1f87f9c6-adb5-4446-a1d8-96ca9e472ffd tempest-GroupSnapshotsTest-630474466 None] Deleting offline snapshot 67556014-af93-4518-b196-64754e9c7bf2 of volume eb0e4966-9a26-4905-8383-b4f958f69c71 {{(pid=82780) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 21:36:26 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-1f87f9c6-adb5-4446-a1d8-96ca9e472ffd tempest-GroupSnapshotsTest-630474466 None] snapshot_file for this snap is: volume-eb0e4966-9a26-4905-8383-b4f958f69c71.67556014-af93-4518-b196-64754e9c7bf2 {{(pid=82780) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 21:36:26 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8231bb1-8ddd-4337-92b4-335b2416950a]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:36:26 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1f87f9c6-adb5-4446-a1d8-96ca9e472ffd tempest-GroupSnapshotsTest-630474466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eb0e4966-9a26-4905-8383-b4f958f69c71.67556014-af93-4518-b196-64754e9c7bf2 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:36:26 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1f87f9c6-adb5-4446-a1d8-96ca9e472ffd tempest-GroupSnapshotsTest-630474466 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eb0e4966-9a26-4905-8383-b4f958f69c71.67556014-af93-4518-b196-64754e9c7bf2" returned: 0 in 0.405s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:36:26 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-1f87f9c6-adb5-4446-a1d8-96ca9e472ffd tempest-GroupSnapshotsTest-630474466 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb0e4966-9a26-4905-8383-b4f958f69c71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82780) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 21:36:26 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa74a53f-f476-4e37-9284-0bebc898b64c]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:36:26 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1f87f9c6-adb5-4446-a1d8-96ca9e472ffd tempest-GroupSnapshotsTest-630474466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eb0e4966-9a26-4905-8383-b4f958f69c71 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:36:27 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1f87f9c6-adb5-4446-a1d8-96ca9e472ffd tempest-GroupSnapshotsTest-630474466 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eb0e4966-9a26-4905-8383-b4f958f69c71" returned: 0 in 0.493s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:36:27 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1f87f9c6-adb5-4446-a1d8-96ca9e472ffd tempest-GroupSnapshotsTest-630474466 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eb0e4966-9a26-4905-8383-b4f958f69c71.67556014-af93-4518-b196-64754e9c7bf2 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:36:27 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1f87f9c6-adb5-4446-a1d8-96ca9e472ffd tempest-GroupSnapshotsTest-630474466 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eb0e4966-9a26-4905-8383-b4f958f69c71.67556014-af93-4518-b196-64754e9c7bf2" returned: 0 in 0.213s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:36:27 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1f87f9c6-adb5-4446-a1d8-96ca9e472ffd tempest-GroupSnapshotsTest-630474466 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eb0e4966-9a26-4905-8383-b4f958f69c71.67556014-af93-4518-b196-64754e9c7bf2 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:36:27 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1f87f9c6-adb5-4446-a1d8-96ca9e472ffd tempest-GroupSnapshotsTest-630474466 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eb0e4966-9a26-4905-8383-b4f958f69c71.67556014-af93-4518-b196-64754e9c7bf2" returned: 0 in 0.085s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:36:27 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-1f87f9c6-adb5-4446-a1d8-96ca9e472ffd tempest-GroupSnapshotsTest-630474466 None] Lock "cinder-quobyte-67556014-af93-4518-b196-64754e9c7bf2" released by "_delete_snapshot" :: held 1.547s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:36:27 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-1f87f9c6-adb5-4446-a1d8-96ca9e472ffd tempest-GroupSnapshotsTest-630474466 None] Lock "cinder-quobyte-eb0e4966-9a26-4905-8383-b4f958f69c71" released by "delete_snapshot" :: held 1.579s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:36:28 devstack cinder-volume[82780]: WARNING cinder.quota [None req-1f87f9c6-adb5-4446-a1d8-96ca9e472ffd tempest-GroupSnapshotsTest-630474466 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1500785766 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1500785766, it is now deprecated. Please use the default quota class for default quota. Sep 10 21:36:28 devstack cinder-volume[82780]: WARNING cinder.quota [None req-1f87f9c6-adb5-4446-a1d8-96ca9e472ffd tempest-GroupSnapshotsTest-630474466 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1500785766 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1500785766, it is now deprecated. Please use the default quota class for default quota. Sep 10 21:36:28 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-1f87f9c6-adb5-4446-a1d8-96ca9e472ffd tempest-GroupSnapshotsTest-630474466 None] Created reservations ['8e0d2f0a-c87d-422e-9a41-14b5eb8683f6', '06b58692-b8a1-41be-b21c-f49d0d6f3149', '7a958780-6cf1-4657-9133-858b5837102c', '5f5bae03-b2b8-41fd-ae0d-4b089b695ac8'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:36:28 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-1f87f9c6-adb5-4446-a1d8-96ca9e472ffd tempest-GroupSnapshotsTest-630474466 None] Created reservations ['7b7bae45-56b5-4688-af63-3de3407bf0ab', '39ecbc7b-69e1-4ef1-bad2-2753eeee96cb', '57645470-8c5b-4033-8be4-aa78fbe0dc75', '2eff5a2f-f68b-4207-ba31-57d89010b240'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:36:28 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-1f87f9c6-adb5-4446-a1d8-96ca9e472ffd tempest-GroupSnapshotsTest-630474466 None] group_snapshot 56b3c4d9-b96e-4d88-8f35-331184a2bd88: deleted successfully Sep 10 21:36:29 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-1ce1b915-a4aa-4f9a-97f9-4286caab77ac tempest-GroupSnapshotsTest-630474466 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:36:29 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-1ce1b915-a4aa-4f9a-97f9-4286caab77ac tempest-GroupSnapshotsTest-630474466 None] Acquiring lock "cinder-quobyte-d16629f5-5163-48b7-9092-bedd80502f78" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:36:29 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-1ce1b915-a4aa-4f9a-97f9-4286caab77ac tempest-GroupSnapshotsTest-630474466 None] Lock "cinder-quobyte-d16629f5-5163-48b7-9092-bedd80502f78" acquired by "delete_volume" :: waited 0.023s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:36:30 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f79430-1d91-4c3c-a5d6-f614ea1f31ba]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:36:30 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1ce1b915-a4aa-4f9a-97f9-4286caab77ac tempest-GroupSnapshotsTest-630474466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d16629f5-5163-48b7-9092-bedd80502f78 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:36:30 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1ce1b915-a4aa-4f9a-97f9-4286caab77ac tempest-GroupSnapshotsTest-630474466 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d16629f5-5163-48b7-9092-bedd80502f78" returned: 0 in 0.445s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:36:30 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1ce1b915-a4aa-4f9a-97f9-4286caab77ac tempest-GroupSnapshotsTest-630474466 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d16629f5-5163-48b7-9092-bedd80502f78 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:36:30 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1ce1b915-a4aa-4f9a-97f9-4286caab77ac tempest-GroupSnapshotsTest-630474466 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d16629f5-5163-48b7-9092-bedd80502f78" returned: 0 in 0.134s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:36:30 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-1ce1b915-a4aa-4f9a-97f9-4286caab77ac tempest-GroupSnapshotsTest-630474466 None] Lock "cinder-quobyte-d16629f5-5163-48b7-9092-bedd80502f78" released by "delete_volume" :: held 0.765s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:36:30 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-1ce1b915-a4aa-4f9a-97f9-4286caab77ac tempest-GroupSnapshotsTest-630474466 None] Acquiring lock "cinder-quobyte-eb0e4966-9a26-4905-8383-b4f958f69c71" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:36:30 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-1ce1b915-a4aa-4f9a-97f9-4286caab77ac tempest-GroupSnapshotsTest-630474466 None] Lock "cinder-quobyte-eb0e4966-9a26-4905-8383-b4f958f69c71" acquired by "delete_volume" :: waited 0.034s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:36:30 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[763b035a-a78d-48db-8cf8-c4656e38a92b]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:36:30 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1ce1b915-a4aa-4f9a-97f9-4286caab77ac tempest-GroupSnapshotsTest-630474466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eb0e4966-9a26-4905-8383-b4f958f69c71 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:36:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1ce1b915-a4aa-4f9a-97f9-4286caab77ac tempest-GroupSnapshotsTest-630474466 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eb0e4966-9a26-4905-8383-b4f958f69c71" returned: 0 in 0.579s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:36:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1ce1b915-a4aa-4f9a-97f9-4286caab77ac tempest-GroupSnapshotsTest-630474466 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eb0e4966-9a26-4905-8383-b4f958f69c71 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:36:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1ce1b915-a4aa-4f9a-97f9-4286caab77ac tempest-GroupSnapshotsTest-630474466 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eb0e4966-9a26-4905-8383-b4f958f69c71" returned: 0 in 0.124s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:36:31 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-1ce1b915-a4aa-4f9a-97f9-4286caab77ac tempest-GroupSnapshotsTest-630474466 None] Lock "cinder-quobyte-eb0e4966-9a26-4905-8383-b4f958f69c71" released by "delete_volume" :: held 0.904s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:36:32 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-1ce1b915-a4aa-4f9a-97f9-4286caab77ac tempest-GroupSnapshotsTest-630474466 None] Created reservations ['6072005b-2578-4a88-abc0-f44021efa389'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:36:32 devstack cinder-volume[82780]: WARNING cinder.quota [None req-1ce1b915-a4aa-4f9a-97f9-4286caab77ac tempest-GroupSnapshotsTest-630474466 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1500785766 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1500785766, it is now deprecated. Please use the default quota class for default quota. Sep 10 21:36:32 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-1ce1b915-a4aa-4f9a-97f9-4286caab77ac tempest-GroupSnapshotsTest-630474466 None] Created reservations ['8874823d-9a52-4ca6-99f5-fe28316c07fe', 'fbbeead7-da95-4cac-9bcc-c60ec83ebf63', 'b5bb77ff-5896-4444-9e78-364c0d31e212', 'fd173315-0238-4c90-a444-eb83c86e0945'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:36:32 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-1ce1b915-a4aa-4f9a-97f9-4286caab77ac tempest-GroupSnapshotsTest-630474466 None] Created reservations ['d7435d63-1275-48b5-bad7-9d1328c2bd33', '186cc4e7-09ca-4297-9862-d7ed73618535', '385daeeb-2c6a-4535-b38f-780e63bf7f65', '3eded931-b4cf-40a5-b9e0-28226a65ca4d'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:36:32 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-1ce1b915-a4aa-4f9a-97f9-4286caab77ac tempest-GroupSnapshotsTest-630474466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:36:32 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-1ce1b915-a4aa-4f9a-97f9-4286caab77ac tempest-GroupSnapshotsTest-630474466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:36:32 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-1ce1b915-a4aa-4f9a-97f9-4286caab77ac tempest-GroupSnapshotsTest-630474466 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:36:32 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-1ce1b915-a4aa-4f9a-97f9-4286caab77ac tempest-GroupSnapshotsTest-630474466 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:36:32 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-1ce1b915-a4aa-4f9a-97f9-4286caab77ac tempest-GroupSnapshotsTest-630474466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:36:32 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1ce1b915-a4aa-4f9a-97f9-4286caab77ac tempest-GroupSnapshotsTest-630474466 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:36:32 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1ce1b915-a4aa-4f9a-97f9-4286caab77ac tempest-GroupSnapshotsTest-630474466 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.096s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:36:32 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-1ce1b915-a4aa-4f9a-97f9-4286caab77ac tempest-GroupSnapshotsTest-630474466 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:36:32 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-1ce1b915-a4aa-4f9a-97f9-4286caab77ac tempest-GroupSnapshotsTest-630474466 None] Delete group completed successfully. Sep 10 21:36:34 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-8b050cc7-eded-4e5b-9f37-1dad34bd6145 tempest-GroupSnapshotsTest-630474466 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:36:34 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-8b050cc7-eded-4e5b-9f37-1dad34bd6145 tempest-GroupSnapshotsTest-630474466 None] Group tempest-GroupSnapshotsTest-Group-490390652: creating Sep 10 21:36:34 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-8b050cc7-eded-4e5b-9f37-1dad34bd6145 tempest-GroupSnapshotsTest-630474466 None] Group tempest-GroupSnapshotsTest-Group-490390652: created successfully Sep 10 21:36:34 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-8b050cc7-eded-4e5b-9f37-1dad34bd6145 tempest-GroupSnapshotsTest-630474466 None] Create group completed successfully. Sep 10 21:36:36 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-e13fc6df-f409-4a45-a9ad-670c5d8a73c7 tempest-GroupSnapshotsTest-630474466 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:36:36 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-e13fc6df-f409-4a45-a9ad-670c5d8a73c7 tempest-GroupSnapshotsTest-630474466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:36:36 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-e13fc6df-f409-4a45-a9ad-670c5d8a73c7 tempest-GroupSnapshotsTest-630474466 None] Flow 'volume_create_manager' (9ca6bacb-b17f-467c-8e8f-811d0803ab71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:36:36 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-e13fc6df-f409-4a45-a9ad-670c5d8a73c7 tempest-GroupSnapshotsTest-630474466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ed2c626-ca95-4492-85cf-7f0667148a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:36:36 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-e13fc6df-f409-4a45-a9ad-670c5d8a73c7 tempest-GroupSnapshotsTest-630474466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ed2c626-ca95-4492-85cf-7f0667148a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:36:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1283660301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=755b29d9-93fd-4e82-940d-d8a6d9e2c595,host='devstack@QuobyteHD#QuobyteHD',id=abaaab50-4275-4524-8eda-29e1444268fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e814d05ca6b4cd692e805a481a5f61b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:36:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:36:36Z,use_quota=True,user_id='bdbc71ad5d354ec3ad72730134e89080',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8066d506-2586-4423-b78e-f93802f89406),volume_type_id=8066d506-2586-4423-b78e-f93802f89406)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:36:36 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-e13fc6df-f409-4a45-a9ad-670c5d8a73c7 tempest-GroupSnapshotsTest-630474466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1982b3ba-5da1-49c5-a177-de82a96eb95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:36:36 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-e13fc6df-f409-4a45-a9ad-670c5d8a73c7 tempest-GroupSnapshotsTest-630474466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1982b3ba-5da1-49c5-a177-de82a96eb95c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:36:36 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-e13fc6df-f409-4a45-a9ad-670c5d8a73c7 tempest-GroupSnapshotsTest-630474466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1350015-aaf8-46ef-9d3b-0a1fbd802189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:36:36 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-e13fc6df-f409-4a45-a9ad-670c5d8a73c7 tempest-GroupSnapshotsTest-630474466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1350015-aaf8-46ef-9d3b-0a1fbd802189) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abaaab50-4275-4524-8eda-29e1444268fc', 'volume_name': 'volume-abaaab50-4275-4524-8eda-29e1444268fc', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:36:36 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-e13fc6df-f409-4a45-a9ad-670c5d8a73c7 tempest-GroupSnapshotsTest-630474466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c41aeb07-cf4f-43a2-b1f1-1d5fdaaf9762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:36:36 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-e13fc6df-f409-4a45-a9ad-670c5d8a73c7 tempest-GroupSnapshotsTest-630474466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c41aeb07-cf4f-43a2-b1f1-1d5fdaaf9762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:36:36 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-e13fc6df-f409-4a45-a9ad-670c5d8a73c7 tempest-GroupSnapshotsTest-630474466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1290adf9-4e82-4725-8a9c-9ecb3073dd0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:36:36 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-e13fc6df-f409-4a45-a9ad-670c5d8a73c7 tempest-GroupSnapshotsTest-630474466 None] Volume abaaab50-4275-4524-8eda-29e1444268fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abaaab50-4275-4524-8eda-29e1444268fc', 'volume_size': 1} Sep 10 21:36:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-e13fc6df-f409-4a45-a9ad-670c5d8a73c7 tempest-GroupSnapshotsTest-630474466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:36:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-e13fc6df-f409-4a45-a9ad-670c5d8a73c7 tempest-GroupSnapshotsTest-630474466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:36:36 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-e13fc6df-f409-4a45-a9ad-670c5d8a73c7 tempest-GroupSnapshotsTest-630474466 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=755b29d9-93fd-4e82-940d-d8a6d9e2c595,created_at=2025-09-10T19:36:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1283660301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=755b29d9-93fd-4e82-940d-d8a6d9e2c595,host='devstack@QuobyteHD#QuobyteHD',id=abaaab50-4275-4524-8eda-29e1444268fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e814d05ca6b4cd692e805a481a5f61b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:36:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:36:36Z,use_quota=True,user_id='bdbc71ad5d354ec3ad72730134e89080',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8066d506-2586-4423-b78e-f93802f89406),volume_type_id=8066d506-2586-4423-b78e-f93802f89406)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:36:36 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-e13fc6df-f409-4a45-a9ad-670c5d8a73c7 tempest-GroupSnapshotsTest-630474466 None] Creating volume abaaab50-4275-4524-8eda-29e1444268fc {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:36:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-e13fc6df-f409-4a45-a9ad-670c5d8a73c7 tempest-GroupSnapshotsTest-630474466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:36:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-e13fc6df-f409-4a45-a9ad-670c5d8a73c7 tempest-GroupSnapshotsTest-630474466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:36:36 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-e13fc6df-f409-4a45-a9ad-670c5d8a73c7 tempest-GroupSnapshotsTest-630474466 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:36:36 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-e13fc6df-f409-4a45-a9ad-670c5d8a73c7 tempest-GroupSnapshotsTest-630474466 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:36:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-e13fc6df-f409-4a45-a9ad-670c5d8a73c7 tempest-GroupSnapshotsTest-630474466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:36:36 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-e13fc6df-f409-4a45-a9ad-670c5d8a73c7 tempest-GroupSnapshotsTest-630474466 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:36:36 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-e13fc6df-f409-4a45-a9ad-670c5d8a73c7 tempest-GroupSnapshotsTest-630474466 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:36:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e13fc6df-f409-4a45-a9ad-670c5d8a73c7 tempest-GroupSnapshotsTest-630474466 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-abaaab50-4275-4524-8eda-29e1444268fc 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:36:36 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=104, name=volume-abaaab50-4275-4524-8eda-29e1444268fc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:36:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e13fc6df-f409-4a45-a9ad-670c5d8a73c7 tempest-GroupSnapshotsTest-630474466 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-abaaab50-4275-4524-8eda-29e1444268fc 1073741824" returned: 0 in 0.511s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:36:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e13fc6df-f409-4a45-a9ad-670c5d8a73c7 tempest-GroupSnapshotsTest-630474466 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-abaaab50-4275-4524-8eda-29e1444268fc {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:36:37 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e13fc6df-f409-4a45-a9ad-670c5d8a73c7 tempest-GroupSnapshotsTest-630474466 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-abaaab50-4275-4524-8eda-29e1444268fc" returned: 0 in 0.142s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:36:37 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-e13fc6df-f409-4a45-a9ad-670c5d8a73c7 tempest-GroupSnapshotsTest-630474466 None] <== create_volume: return (746ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:36:37 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-e13fc6df-f409-4a45-a9ad-670c5d8a73c7 tempest-GroupSnapshotsTest-630474466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:36:37 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-e13fc6df-f409-4a45-a9ad-670c5d8a73c7 tempest-GroupSnapshotsTest-630474466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1290adf9-4e82-4725-8a9c-9ecb3073dd0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abaaab50-4275-4524-8eda-29e1444268fc', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:36:37 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-e13fc6df-f409-4a45-a9ad-670c5d8a73c7 tempest-GroupSnapshotsTest-630474466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (911aa538-10fc-4afc-87c0-fa88ac2d6df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:36:37 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-e13fc6df-f409-4a45-a9ad-670c5d8a73c7 tempest-GroupSnapshotsTest-630474466 None] Volume volume-abaaab50-4275-4524-8eda-29e1444268fc (abaaab50-4275-4524-8eda-29e1444268fc): created successfully Sep 10 21:36:37 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-e13fc6df-f409-4a45-a9ad-670c5d8a73c7 tempest-GroupSnapshotsTest-630474466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (911aa538-10fc-4afc-87c0-fa88ac2d6df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:36:37 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-e13fc6df-f409-4a45-a9ad-670c5d8a73c7 tempest-GroupSnapshotsTest-630474466 None] Flow 'volume_create_manager' (9ca6bacb-b17f-467c-8e8f-811d0803ab71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:36:37 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-e13fc6df-f409-4a45-a9ad-670c5d8a73c7 tempest-GroupSnapshotsTest-630474466 None] Created volume successfully. Sep 10 21:36:38 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-a8806bc5-4184-4c1e-b9c2-d7599c93e0c9 tempest-GroupSnapshotsTest-630474466 None] GroupSnapshot 53f2e73d-14c5-44b4-9c5d-c3be84acc03e: creating. Sep 10 21:36:38 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-a8806bc5-4184-4c1e-b9c2-d7599c93e0c9 tempest-GroupSnapshotsTest-630474466 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:36:38 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-a8806bc5-4184-4c1e-b9c2-d7599c93e0c9 tempest-GroupSnapshotsTest-630474466 None] Group snapshot 53f2e73d-14c5-44b4-9c5d-c3be84acc03e: creating. {{(pid=82780) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}} Sep 10 21:36:38 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a8806bc5-4184-4c1e-b9c2-d7599c93e0c9 tempest-GroupSnapshotsTest-630474466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:36:38 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a8806bc5-4184-4c1e-b9c2-d7599c93e0c9 tempest-GroupSnapshotsTest-630474466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:36:38 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-a8806bc5-4184-4c1e-b9c2-d7599c93e0c9 tempest-GroupSnapshotsTest-630474466 None] Creating offline snapshot 70ddd573-3d45-4e69-89d4-dfdfa59ad720 of volume abaaab50-4275-4524-8eda-29e1444268fc {{(pid=82780) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 21:36:38 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1334e00-4713-4fd8-9fd3-ab4aa46b6efa]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:36:38 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a8806bc5-4184-4c1e-b9c2-d7599c93e0c9 tempest-GroupSnapshotsTest-630474466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-abaaab50-4275-4524-8eda-29e1444268fc {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:36:39 devstack quobyte-client[82807]: System call of process 99204 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:36:39 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a8806bc5-4184-4c1e-b9c2-d7599c93e0c9 tempest-GroupSnapshotsTest-630474466 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-abaaab50-4275-4524-8eda-29e1444268fc" returned: 0 in 0.827s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:36:39 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a8806bc5-4184-4c1e-b9c2-d7599c93e0c9 tempest-GroupSnapshotsTest-630474466 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-abaaab50-4275-4524-8eda-29e1444268fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-abaaab50-4275-4524-8eda-29e1444268fc.70ddd573-3d45-4e69-89d4-dfdfa59ad720 1G {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:36:40 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=105, name=volume-abaaab50-4275-4524-8eda-29e1444268fc.70ddd573-3d45-4e69-89d4-dfdfa59ad720, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:36:40 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a8806bc5-4184-4c1e-b9c2-d7599c93e0c9 tempest-GroupSnapshotsTest-630474466 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-abaaab50-4275-4524-8eda-29e1444268fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-abaaab50-4275-4524-8eda-29e1444268fc.70ddd573-3d45-4e69-89d4-dfdfa59ad720 1G" returned: 0 in 0.594s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:36:40 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a8806bc5-4184-4c1e-b9c2-d7599c93e0c9 tempest-GroupSnapshotsTest-630474466 None] Running cmd (subprocess): qemu-img rebase -u -b volume-abaaab50-4275-4524-8eda-29e1444268fc -F qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-abaaab50-4275-4524-8eda-29e1444268fc.70ddd573-3d45-4e69-89d4-dfdfa59ad720 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:36:40 devstack quobyte-client[82807]: System call of process 99233 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:36:41 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a8806bc5-4184-4c1e-b9c2-d7599c93e0c9 tempest-GroupSnapshotsTest-630474466 None] CMD "qemu-img rebase -u -b volume-abaaab50-4275-4524-8eda-29e1444268fc -F qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-abaaab50-4275-4524-8eda-29e1444268fc.70ddd573-3d45-4e69-89d4-dfdfa59ad720" returned: 0 in 0.418s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:36:41 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-a8806bc5-4184-4c1e-b9c2-d7599c93e0c9 tempest-GroupSnapshotsTest-630474466 None] File path /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-abaaab50-4275-4524-8eda-29e1444268fc.70ddd573-3d45-4e69-89d4-dfdfa59ad720 is being set with permissions: 660 {{(pid=82780) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 21:36:41 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a8806bc5-4184-4c1e-b9c2-d7599c93e0c9 tempest-GroupSnapshotsTest-630474466 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-abaaab50-4275-4524-8eda-29e1444268fc.70ddd573-3d45-4e69-89d4-dfdfa59ad720 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:36:41 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a8806bc5-4184-4c1e-b9c2-d7599c93e0c9 tempest-GroupSnapshotsTest-630474466 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-abaaab50-4275-4524-8eda-29e1444268fc.70ddd573-3d45-4e69-89d4-dfdfa59ad720" returned: 0 in 0.435s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:36:41 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-a8806bc5-4184-4c1e-b9c2-d7599c93e0c9 tempest-GroupSnapshotsTest-630474466 None] Setting permissions: /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-abaaab50-4275-4524-8eda-29e1444268fc -> 1000:1000 {{(pid=82780) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 21:36:41 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a8806bc5-4184-4c1e-b9c2-d7599c93e0c9 tempest-GroupSnapshotsTest-630474466 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-abaaab50-4275-4524-8eda-29e1444268fc /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-abaaab50-4275-4524-8eda-29e1444268fc.70ddd573-3d45-4e69-89d4-dfdfa59ad720 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:36:41 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a8806bc5-4184-4c1e-b9c2-d7599c93e0c9 tempest-GroupSnapshotsTest-630474466 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-abaaab50-4275-4524-8eda-29e1444268fc /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-abaaab50-4275-4524-8eda-29e1444268fc.70ddd573-3d45-4e69-89d4-dfdfa59ad720" returned: 0 in 0.249s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:36:41 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a8806bc5-4184-4c1e-b9c2-d7599c93e0c9 tempest-GroupSnapshotsTest-630474466 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-abaaab50-4275-4524-8eda-29e1444268fc.info {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:36:42 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a8806bc5-4184-4c1e-b9c2-d7599c93e0c9 tempest-GroupSnapshotsTest-630474466 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-abaaab50-4275-4524-8eda-29e1444268fc.info" returned: 0 in 0.179s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:36:42 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-a8806bc5-4184-4c1e-b9c2-d7599c93e0c9 tempest-GroupSnapshotsTest-630474466 None] File path /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-abaaab50-4275-4524-8eda-29e1444268fc.info is being set with permissions: 660 {{(pid=82780) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 21:36:42 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a8806bc5-4184-4c1e-b9c2-d7599c93e0c9 tempest-GroupSnapshotsTest-630474466 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-abaaab50-4275-4524-8eda-29e1444268fc.info {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:36:42 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a8806bc5-4184-4c1e-b9c2-d7599c93e0c9 tempest-GroupSnapshotsTest-630474466 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-abaaab50-4275-4524-8eda-29e1444268fc.info" returned: 0 in 0.217s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:36:42 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a8806bc5-4184-4c1e-b9c2-d7599c93e0c9 tempest-GroupSnapshotsTest-630474466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.570s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:36:43 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-a8806bc5-4184-4c1e-b9c2-d7599c93e0c9 tempest-GroupSnapshotsTest-630474466 None] group_snapshot 53f2e73d-14c5-44b4-9c5d-c3be84acc03e: created successfully Sep 10 21:36:43 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-70ecbc04-6979-41c4-9be3-1eed7a20b685 tempest-GroupSnapshotsTest-630474466 None] group_snapshot 53f2e73d-14c5-44b4-9c5d-c3be84acc03e: deleting Sep 10 21:36:43 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-70ecbc04-6979-41c4-9be3-1eed7a20b685 tempest-GroupSnapshotsTest-630474466 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:36:43 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-70ecbc04-6979-41c4-9be3-1eed7a20b685 tempest-GroupSnapshotsTest-630474466 None] group_snapshot 53f2e73d-14c5-44b4-9c5d-c3be84acc03e: deleting {{(pid=82780) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}} Sep 10 21:36:43 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-70ecbc04-6979-41c4-9be3-1eed7a20b685 tempest-GroupSnapshotsTest-630474466 None] Acquiring lock "cinder-quobyte-abaaab50-4275-4524-8eda-29e1444268fc" by "delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:36:43 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-70ecbc04-6979-41c4-9be3-1eed7a20b685 tempest-GroupSnapshotsTest-630474466 None] Lock "cinder-quobyte-abaaab50-4275-4524-8eda-29e1444268fc" acquired by "delete_snapshot" :: waited 0.056s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:36:43 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-70ecbc04-6979-41c4-9be3-1eed7a20b685 tempest-GroupSnapshotsTest-630474466 None] Acquiring lock "cinder-quobyte-70ddd573-3d45-4e69-89d4-dfdfa59ad720" by "_delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:36:43 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-70ecbc04-6979-41c4-9be3-1eed7a20b685 tempest-GroupSnapshotsTest-630474466 None] Lock "cinder-quobyte-70ddd573-3d45-4e69-89d4-dfdfa59ad720" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:36:43 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-70ecbc04-6979-41c4-9be3-1eed7a20b685 tempest-GroupSnapshotsTest-630474466 None] Deleting offline snapshot 70ddd573-3d45-4e69-89d4-dfdfa59ad720 of volume abaaab50-4275-4524-8eda-29e1444268fc {{(pid=82780) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 21:36:43 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-70ecbc04-6979-41c4-9be3-1eed7a20b685 tempest-GroupSnapshotsTest-630474466 None] snapshot_file for this snap is: volume-abaaab50-4275-4524-8eda-29e1444268fc.70ddd573-3d45-4e69-89d4-dfdfa59ad720 {{(pid=82780) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 21:36:43 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8caaac7-fe86-4951-b165-9e062eb29274]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:36:43 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-70ecbc04-6979-41c4-9be3-1eed7a20b685 tempest-GroupSnapshotsTest-630474466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-abaaab50-4275-4524-8eda-29e1444268fc.70ddd573-3d45-4e69-89d4-dfdfa59ad720 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:36:44 devstack quobyte-client[82807]: System call of process 99273 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:36:44 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-70ecbc04-6979-41c4-9be3-1eed7a20b685 tempest-GroupSnapshotsTest-630474466 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-abaaab50-4275-4524-8eda-29e1444268fc.70ddd573-3d45-4e69-89d4-dfdfa59ad720" returned: 0 in 0.871s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:36:44 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-70ecbc04-6979-41c4-9be3-1eed7a20b685 tempest-GroupSnapshotsTest-630474466 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-abaaab50-4275-4524-8eda-29e1444268fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82780) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 21:36:45 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[427e388b-c1a8-456e-9db7-8a483f97d523]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:36:45 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-70ecbc04-6979-41c4-9be3-1eed7a20b685 tempest-GroupSnapshotsTest-630474466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-abaaab50-4275-4524-8eda-29e1444268fc {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:36:45 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-70ecbc04-6979-41c4-9be3-1eed7a20b685 tempest-GroupSnapshotsTest-630474466 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-abaaab50-4275-4524-8eda-29e1444268fc" returned: 0 in 0.497s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:36:45 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-70ecbc04-6979-41c4-9be3-1eed7a20b685 tempest-GroupSnapshotsTest-630474466 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-abaaab50-4275-4524-8eda-29e1444268fc.70ddd573-3d45-4e69-89d4-dfdfa59ad720 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:36:45 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-70ecbc04-6979-41c4-9be3-1eed7a20b685 tempest-GroupSnapshotsTest-630474466 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-abaaab50-4275-4524-8eda-29e1444268fc.70ddd573-3d45-4e69-89d4-dfdfa59ad720" returned: 0 in 0.292s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:36:45 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-70ecbc04-6979-41c4-9be3-1eed7a20b685 tempest-GroupSnapshotsTest-630474466 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-abaaab50-4275-4524-8eda-29e1444268fc.70ddd573-3d45-4e69-89d4-dfdfa59ad720 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:36:46 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-70ecbc04-6979-41c4-9be3-1eed7a20b685 tempest-GroupSnapshotsTest-630474466 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-abaaab50-4275-4524-8eda-29e1444268fc.70ddd573-3d45-4e69-89d4-dfdfa59ad720" returned: 0 in 0.196s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:36:46 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-70ecbc04-6979-41c4-9be3-1eed7a20b685 tempest-GroupSnapshotsTest-630474466 None] Lock "cinder-quobyte-70ddd573-3d45-4e69-89d4-dfdfa59ad720" released by "_delete_snapshot" :: held 2.397s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:36:46 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-70ecbc04-6979-41c4-9be3-1eed7a20b685 tempest-GroupSnapshotsTest-630474466 None] Lock "cinder-quobyte-abaaab50-4275-4524-8eda-29e1444268fc" released by "delete_snapshot" :: held 2.444s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:36:46 devstack cinder-volume[82780]: WARNING cinder.quota [None req-70ecbc04-6979-41c4-9be3-1eed7a20b685 tempest-GroupSnapshotsTest-630474466 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1348046673 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1348046673, it is now deprecated. Please use the default quota class for default quota. Sep 10 21:36:46 devstack cinder-volume[82780]: WARNING cinder.quota [None req-70ecbc04-6979-41c4-9be3-1eed7a20b685 tempest-GroupSnapshotsTest-630474466 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1348046673 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1348046673, it is now deprecated. Please use the default quota class for default quota. Sep 10 21:36:46 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-70ecbc04-6979-41c4-9be3-1eed7a20b685 tempest-GroupSnapshotsTest-630474466 None] Created reservations ['ef38d6e5-88a7-4841-aff2-df9bc18f1fa0', '0b69dc10-1cba-4c7c-aee5-a92ce83ffca5', 'cd3a108a-ab13-4602-a903-b18e11756748', '87b05c60-e3d8-4621-b094-7094cfa9abc4'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:36:46 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-70ecbc04-6979-41c4-9be3-1eed7a20b685 tempest-GroupSnapshotsTest-630474466 None] group_snapshot 53f2e73d-14c5-44b4-9c5d-c3be84acc03e: deleted successfully Sep 10 21:36:47 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-10e9d117-cbb8-4ee0-bb13-c2921351dcc6 tempest-GroupSnapshotsTest-630474466 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:36:47 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-10e9d117-cbb8-4ee0-bb13-c2921351dcc6 tempest-GroupSnapshotsTest-630474466 None] Acquiring lock "cinder-quobyte-abaaab50-4275-4524-8eda-29e1444268fc" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:36:47 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-10e9d117-cbb8-4ee0-bb13-c2921351dcc6 tempest-GroupSnapshotsTest-630474466 None] Lock "cinder-quobyte-abaaab50-4275-4524-8eda-29e1444268fc" acquired by "delete_volume" :: waited 0.035s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:36:47 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[e24486a2-f427-48a3-8f79-c5349eb0c728]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:36:47 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-10e9d117-cbb8-4ee0-bb13-c2921351dcc6 tempest-GroupSnapshotsTest-630474466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-abaaab50-4275-4524-8eda-29e1444268fc {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:36:48 devstack quobyte-client[82807]: System call of process 99293 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:36:48 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-10e9d117-cbb8-4ee0-bb13-c2921351dcc6 tempest-GroupSnapshotsTest-630474466 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-abaaab50-4275-4524-8eda-29e1444268fc" returned: 0 in 0.523s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:36:48 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-10e9d117-cbb8-4ee0-bb13-c2921351dcc6 tempest-GroupSnapshotsTest-630474466 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-abaaab50-4275-4524-8eda-29e1444268fc {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:36:48 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-10e9d117-cbb8-4ee0-bb13-c2921351dcc6 tempest-GroupSnapshotsTest-630474466 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-abaaab50-4275-4524-8eda-29e1444268fc" returned: 0 in 0.091s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:36:48 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-10e9d117-cbb8-4ee0-bb13-c2921351dcc6 tempest-GroupSnapshotsTest-630474466 None] Lock "cinder-quobyte-abaaab50-4275-4524-8eda-29e1444268fc" released by "delete_volume" :: held 0.795s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:36:48 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-10e9d117-cbb8-4ee0-bb13-c2921351dcc6 tempest-GroupSnapshotsTest-630474466 None] Created reservations ['185e7f2c-0ef6-445c-badd-e0cff57b24f3'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:36:49 devstack cinder-volume[82780]: WARNING cinder.quota [None req-10e9d117-cbb8-4ee0-bb13-c2921351dcc6 tempest-GroupSnapshotsTest-630474466 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1348046673 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1348046673, it is now deprecated. Please use the default quota class for default quota. Sep 10 21:36:49 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-10e9d117-cbb8-4ee0-bb13-c2921351dcc6 tempest-GroupSnapshotsTest-630474466 None] Created reservations ['de739ba2-6f11-46e9-8597-572dc43f1060', 'fd7c1900-0105-487a-8834-4ac3f5583f4b', '9c5662e9-5598-4473-b417-f347aefc2f02', '86d9dffb-345d-4f7f-8210-6ec3ff8add7b'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:36:49 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-10e9d117-cbb8-4ee0-bb13-c2921351dcc6 tempest-GroupSnapshotsTest-630474466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:36:49 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-10e9d117-cbb8-4ee0-bb13-c2921351dcc6 tempest-GroupSnapshotsTest-630474466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:36:49 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-10e9d117-cbb8-4ee0-bb13-c2921351dcc6 tempest-GroupSnapshotsTest-630474466 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:36:49 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-10e9d117-cbb8-4ee0-bb13-c2921351dcc6 tempest-GroupSnapshotsTest-630474466 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:36:49 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-10e9d117-cbb8-4ee0-bb13-c2921351dcc6 tempest-GroupSnapshotsTest-630474466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:36:49 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-10e9d117-cbb8-4ee0-bb13-c2921351dcc6 tempest-GroupSnapshotsTest-630474466 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:36:49 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-10e9d117-cbb8-4ee0-bb13-c2921351dcc6 tempest-GroupSnapshotsTest-630474466 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.110s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:36:49 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-10e9d117-cbb8-4ee0-bb13-c2921351dcc6 tempest-GroupSnapshotsTest-630474466 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:36:49 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-10e9d117-cbb8-4ee0-bb13-c2921351dcc6 tempest-GroupSnapshotsTest-630474466 None] Delete group completed successfully. Sep 10 21:36:57 devstack cinder-volume[82780]: DEBUG oslo_service.periodic_task [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82780) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 21:36:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:36:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:36:57 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:36:57 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:36:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:36:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:36:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.253s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:36:57 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:36:59 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:UPDATE=81,cinder:SELECT=85,cinder:INSERT=23,cinder:DELETE=1 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:36:59 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=90,cinder:INSERT=12,cinder:UPDATE=82,cinder:DELETE=2 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:37:14 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-5b058efe-4a57-48d3-91d1-5a02cd3ef6da tempest-GroupsTest-1862271077 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:37:14 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-5b058efe-4a57-48d3-91d1-5a02cd3ef6da tempest-GroupsTest-1862271077 None] Group tempest-Group1-23921010: creating Sep 10 21:37:14 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-5b058efe-4a57-48d3-91d1-5a02cd3ef6da tempest-GroupsTest-1862271077 None] Group tempest-Group1-23921010: created successfully Sep 10 21:37:14 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-5b058efe-4a57-48d3-91d1-5a02cd3ef6da tempest-GroupsTest-1862271077 None] Create group completed successfully. Sep 10 21:37:15 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-7f87628e-6797-45a3-9b5a-06a7760d719d tempest-GroupsTest-1862271077 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:37:15 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-7f87628e-6797-45a3-9b5a-06a7760d719d tempest-GroupsTest-1862271077 None] Group tempest-Group2-1421078444: creating Sep 10 21:37:15 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-7f87628e-6797-45a3-9b5a-06a7760d719d tempest-GroupsTest-1862271077 None] Group tempest-Group2-1421078444: created successfully Sep 10 21:37:15 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-7f87628e-6797-45a3-9b5a-06a7760d719d tempest-GroupsTest-1862271077 None] Create group completed successfully. Sep 10 21:37:17 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-7f08634b-edce-4891-bee4-a6074cd260ec tempest-GroupsTest-1862271077 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:37:17 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f08634b-edce-4891-bee4-a6074cd260ec tempest-GroupsTest-1862271077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:37:17 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-7f08634b-edce-4891-bee4-a6074cd260ec tempest-GroupsTest-1862271077 None] Flow 'volume_create_manager' (dfa3e149-80e3-45ce-988e-36a3f48b94dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:37:17 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-7f08634b-edce-4891-bee4-a6074cd260ec tempest-GroupsTest-1862271077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b51b80d-17a2-48a2-9ae1-9f1217d68704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:37:17 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-7f08634b-edce-4891-bee4-a6074cd260ec tempest-GroupsTest-1862271077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b51b80d-17a2-48a2-9ae1-9f1217d68704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:37:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-444369124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=56fa97bc-c6dc-498b-b0b4-40ff6c14cb57,host='devstack@QuobyteHD#QuobyteHD',id=1bf304f9-9626-46a5-91a7-04a50a646a51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45732ae242004345afd1c746f42ae034',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:37:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:37:17Z,use_quota=True,user_id='e24c01b9fa9a4429bee357dd8a94b605',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a82448c6-a77c-4fdd-b23c-3863ef42a5ba),volume_type_id=a82448c6-a77c-4fdd-b23c-3863ef42a5ba)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:37:17 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-7f08634b-edce-4891-bee4-a6074cd260ec tempest-GroupsTest-1862271077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aef1f0ec-236d-4c3f-b23f-565bd2d0c86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:37:17 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-7f08634b-edce-4891-bee4-a6074cd260ec tempest-GroupsTest-1862271077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aef1f0ec-236d-4c3f-b23f-565bd2d0c86d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:37:17 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-7f08634b-edce-4891-bee4-a6074cd260ec tempest-GroupsTest-1862271077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39674973-83bb-432b-83df-f3dc888392dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:37:17 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-7f08634b-edce-4891-bee4-a6074cd260ec tempest-GroupsTest-1862271077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39674973-83bb-432b-83df-f3dc888392dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bf304f9-9626-46a5-91a7-04a50a646a51', 'volume_name': 'volume-1bf304f9-9626-46a5-91a7-04a50a646a51', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:37:17 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-7f08634b-edce-4891-bee4-a6074cd260ec tempest-GroupsTest-1862271077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf1f0688-8766-4a60-9cd9-7f9efb2bb51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:37:17 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-7f08634b-edce-4891-bee4-a6074cd260ec tempest-GroupsTest-1862271077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf1f0688-8766-4a60-9cd9-7f9efb2bb51d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:37:17 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-7f08634b-edce-4891-bee4-a6074cd260ec tempest-GroupsTest-1862271077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c378f9ca-92d1-43f7-a0ab-ac4e6f5ace81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:37:17 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-7f08634b-edce-4891-bee4-a6074cd260ec tempest-GroupsTest-1862271077 None] Volume 1bf304f9-9626-46a5-91a7-04a50a646a51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bf304f9-9626-46a5-91a7-04a50a646a51', 'volume_size': 1} Sep 10 21:37:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-7f08634b-edce-4891-bee4-a6074cd260ec tempest-GroupsTest-1862271077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:37:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-7f08634b-edce-4891-bee4-a6074cd260ec tempest-GroupsTest-1862271077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:37:17 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-7f08634b-edce-4891-bee4-a6074cd260ec tempest-GroupsTest-1862271077 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=56fa97bc-c6dc-498b-b0b4-40ff6c14cb57,created_at=2025-09-10T19:37:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-444369124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=56fa97bc-c6dc-498b-b0b4-40ff6c14cb57,host='devstack@QuobyteHD#QuobyteHD',id=1bf304f9-9626-46a5-91a7-04a50a646a51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45732ae242004345afd1c746f42ae034',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:37:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:37:17Z,use_quota=True,user_id='e24c01b9fa9a4429bee357dd8a94b605',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a82448c6-a77c-4fdd-b23c-3863ef42a5ba),volume_type_id=a82448c6-a77c-4fdd-b23c-3863ef42a5ba)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:37:17 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-7f08634b-edce-4891-bee4-a6074cd260ec tempest-GroupsTest-1862271077 None] Creating volume 1bf304f9-9626-46a5-91a7-04a50a646a51 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:37:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-7f08634b-edce-4891-bee4-a6074cd260ec tempest-GroupsTest-1862271077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:37:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-7f08634b-edce-4891-bee4-a6074cd260ec tempest-GroupsTest-1862271077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:37:17 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-7f08634b-edce-4891-bee4-a6074cd260ec tempest-GroupsTest-1862271077 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:37:17 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-7f08634b-edce-4891-bee4-a6074cd260ec tempest-GroupsTest-1862271077 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:37:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-7f08634b-edce-4891-bee4-a6074cd260ec tempest-GroupsTest-1862271077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:37:17 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-7f08634b-edce-4891-bee4-a6074cd260ec tempest-GroupsTest-1862271077 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:37:17 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-7f08634b-edce-4891-bee4-a6074cd260ec tempest-GroupsTest-1862271077 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:37:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-7f08634b-edce-4891-bee4-a6074cd260ec tempest-GroupsTest-1862271077 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1bf304f9-9626-46a5-91a7-04a50a646a51 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:37:17 devstack quobyte-client[82807]: System call of process 99375 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:37:17 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=107, name=volume-1bf304f9-9626-46a5-91a7-04a50a646a51, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:37:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-7f08634b-edce-4891-bee4-a6074cd260ec tempest-GroupsTest-1862271077 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1bf304f9-9626-46a5-91a7-04a50a646a51 1073741824" returned: 0 in 0.444s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:37:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-7f08634b-edce-4891-bee4-a6074cd260ec tempest-GroupsTest-1862271077 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1bf304f9-9626-46a5-91a7-04a50a646a51 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:37:18 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-7f08634b-edce-4891-bee4-a6074cd260ec tempest-GroupsTest-1862271077 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1bf304f9-9626-46a5-91a7-04a50a646a51" returned: 0 in 0.097s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:37:18 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-7f08634b-edce-4891-bee4-a6074cd260ec tempest-GroupsTest-1862271077 None] <== create_volume: return (651ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:37:18 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-7f08634b-edce-4891-bee4-a6074cd260ec tempest-GroupsTest-1862271077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.664s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:37:18 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-7f08634b-edce-4891-bee4-a6074cd260ec tempest-GroupsTest-1862271077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c378f9ca-92d1-43f7-a0ab-ac4e6f5ace81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bf304f9-9626-46a5-91a7-04a50a646a51', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:37:18 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-7f08634b-edce-4891-bee4-a6074cd260ec tempest-GroupsTest-1862271077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (243248fc-3f68-480d-a450-5c03a690e2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:37:18 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-7f08634b-edce-4891-bee4-a6074cd260ec tempest-GroupsTest-1862271077 None] Volume volume-1bf304f9-9626-46a5-91a7-04a50a646a51 (1bf304f9-9626-46a5-91a7-04a50a646a51): created successfully Sep 10 21:37:18 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-7f08634b-edce-4891-bee4-a6074cd260ec tempest-GroupsTest-1862271077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (243248fc-3f68-480d-a450-5c03a690e2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:37:18 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-7f08634b-edce-4891-bee4-a6074cd260ec tempest-GroupsTest-1862271077 None] Flow 'volume_create_manager' (dfa3e149-80e3-45ce-988e-36a3f48b94dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:37:18 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-7f08634b-edce-4891-bee4-a6074cd260ec tempest-GroupsTest-1862271077 None] Created volume successfully. Sep 10 21:37:20 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-12a82d45-1473-495d-b4fb-06ac5199d8d5 tempest-GroupsTest-1862271077 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:37:20 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-12a82d45-1473-495d-b4fb-06ac5199d8d5 tempest-GroupsTest-1862271077 None] Acquiring lock "cinder-quobyte-1bf304f9-9626-46a5-91a7-04a50a646a51" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:37:20 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-12a82d45-1473-495d-b4fb-06ac5199d8d5 tempest-GroupsTest-1862271077 None] Lock "cinder-quobyte-1bf304f9-9626-46a5-91a7-04a50a646a51" acquired by "delete_volume" :: waited 0.079s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:37:20 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d6f47c9-e663-4d98-9e44-e5cbb0993771]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:37:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-12a82d45-1473-495d-b4fb-06ac5199d8d5 tempest-GroupsTest-1862271077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1bf304f9-9626-46a5-91a7-04a50a646a51 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:37:21 devstack quobyte-client[82807]: System call of process 99380 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:37:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-12a82d45-1473-495d-b4fb-06ac5199d8d5 tempest-GroupsTest-1862271077 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1bf304f9-9626-46a5-91a7-04a50a646a51" returned: 0 in 0.503s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:37:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-12a82d45-1473-495d-b4fb-06ac5199d8d5 tempest-GroupsTest-1862271077 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1bf304f9-9626-46a5-91a7-04a50a646a51 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:37:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-12a82d45-1473-495d-b4fb-06ac5199d8d5 tempest-GroupsTest-1862271077 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1bf304f9-9626-46a5-91a7-04a50a646a51" returned: 0 in 0.160s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:37:21 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-12a82d45-1473-495d-b4fb-06ac5199d8d5 tempest-GroupsTest-1862271077 None] Lock "cinder-quobyte-1bf304f9-9626-46a5-91a7-04a50a646a51" released by "delete_volume" :: held 0.881s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:37:21 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-12a82d45-1473-495d-b4fb-06ac5199d8d5 tempest-GroupsTest-1862271077 None] Created reservations ['a32eff3b-1757-474b-888e-6533551073dd'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:37:22 devstack cinder-volume[82780]: WARNING cinder.quota [None req-12a82d45-1473-495d-b4fb-06ac5199d8d5 tempest-GroupsTest-1862271077 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1232024288 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1232024288, it is now deprecated. Please use the default quota class for default quota. Sep 10 21:37:22 devstack cinder-volume[82780]: WARNING cinder.quota [None req-12a82d45-1473-495d-b4fb-06ac5199d8d5 tempest-GroupsTest-1862271077 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1232024288 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1232024288, it is now deprecated. Please use the default quota class for default quota. Sep 10 21:37:22 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-12a82d45-1473-495d-b4fb-06ac5199d8d5 tempest-GroupsTest-1862271077 None] Created reservations ['9062f2ce-caf7-41b9-811c-646428cad5e4', 'd92e862b-a985-4711-8eb5-8b40bc409b85', '8c78b910-6543-4779-90a3-765893e85df1', 'fb24d75c-d480-4fe0-a3fb-ec0ec352254f'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:37:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-12a82d45-1473-495d-b4fb-06ac5199d8d5 tempest-GroupsTest-1862271077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:37:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-12a82d45-1473-495d-b4fb-06ac5199d8d5 tempest-GroupsTest-1862271077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:37:22 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-12a82d45-1473-495d-b4fb-06ac5199d8d5 tempest-GroupsTest-1862271077 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:37:22 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-12a82d45-1473-495d-b4fb-06ac5199d8d5 tempest-GroupsTest-1862271077 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:37:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-12a82d45-1473-495d-b4fb-06ac5199d8d5 tempest-GroupsTest-1862271077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:37:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-12a82d45-1473-495d-b4fb-06ac5199d8d5 tempest-GroupsTest-1862271077 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:37:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-12a82d45-1473-495d-b4fb-06ac5199d8d5 tempest-GroupsTest-1862271077 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.104s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:37:22 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-12a82d45-1473-495d-b4fb-06ac5199d8d5 tempest-GroupsTest-1862271077 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:37:22 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-12a82d45-1473-495d-b4fb-06ac5199d8d5 tempest-GroupsTest-1862271077 None] Delete group completed successfully. Sep 10 21:37:23 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-816fc9b7-0b7e-4fa0-a25c-87ec25bd946d tempest-GroupsTest-1862271077 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:37:23 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-816fc9b7-0b7e-4fa0-a25c-87ec25bd946d tempest-GroupsTest-1862271077 None] Created reservations ['ecf38630-29c9-4afd-a788-376bbb2150e3'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:37:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-816fc9b7-0b7e-4fa0-a25c-87ec25bd946d tempest-GroupsTest-1862271077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:37:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-816fc9b7-0b7e-4fa0-a25c-87ec25bd946d tempest-GroupsTest-1862271077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:37:23 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-816fc9b7-0b7e-4fa0-a25c-87ec25bd946d tempest-GroupsTest-1862271077 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:37:23 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-816fc9b7-0b7e-4fa0-a25c-87ec25bd946d tempest-GroupsTest-1862271077 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:37:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-816fc9b7-0b7e-4fa0-a25c-87ec25bd946d tempest-GroupsTest-1862271077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:37:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-816fc9b7-0b7e-4fa0-a25c-87ec25bd946d tempest-GroupsTest-1862271077 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:37:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-816fc9b7-0b7e-4fa0-a25c-87ec25bd946d tempest-GroupsTest-1862271077 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.178s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:37:23 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-816fc9b7-0b7e-4fa0-a25c-87ec25bd946d tempest-GroupsTest-1862271077 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:37:23 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-816fc9b7-0b7e-4fa0-a25c-87ec25bd946d tempest-GroupsTest-1862271077 None] Delete group completed successfully. Sep 10 21:37:25 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-72e503d8-36f3-4464-b7cd-178ba8d740e5 tempest-GroupsTest-1862271077 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:37:25 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-72e503d8-36f3-4464-b7cd-178ba8d740e5 tempest-GroupsTest-1862271077 None] Group tempest-GroupsTest-Group-240066941: creating Sep 10 21:37:25 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-72e503d8-36f3-4464-b7cd-178ba8d740e5 tempest-GroupsTest-1862271077 None] Group tempest-GroupsTest-Group-240066941: created successfully Sep 10 21:37:25 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-72e503d8-36f3-4464-b7cd-178ba8d740e5 tempest-GroupsTest-1862271077 None] Create group completed successfully. Sep 10 21:37:27 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-2429cf8e-140c-4660-8ca1-4c596324f482 tempest-GroupsTest-1862271077 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:37:27 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-2429cf8e-140c-4660-8ca1-4c596324f482 tempest-GroupsTest-1862271077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:37:27 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-2429cf8e-140c-4660-8ca1-4c596324f482 tempest-GroupsTest-1862271077 None] Flow 'volume_create_manager' (acb7d374-2c74-4b23-844f-640057354107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:37:27 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-2429cf8e-140c-4660-8ca1-4c596324f482 tempest-GroupsTest-1862271077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fa2fb35-3d9b-4d5b-ab08-55bb99bd9dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:37:27 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-2429cf8e-140c-4660-8ca1-4c596324f482 tempest-GroupsTest-1862271077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fa2fb35-3d9b-4d5b-ab08-55bb99bd9dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:37:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1579119028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=63e89cd1-9e87-4090-8c04-670a1f3d513a,host='devstack@QuobyteHD#QuobyteHD',id=e70be161-0555-4643-987f-47fff465ecf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45732ae242004345afd1c746f42ae034',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:37:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:37:27Z,use_quota=True,user_id='e24c01b9fa9a4429bee357dd8a94b605',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6d76867-d24f-4941-bbf6-6ed5d69739de),volume_type_id=d6d76867-d24f-4941-bbf6-6ed5d69739de)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:37:27 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-2429cf8e-140c-4660-8ca1-4c596324f482 tempest-GroupsTest-1862271077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (122312e6-bff9-4675-bfcc-c4de67156911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:37:27 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-2429cf8e-140c-4660-8ca1-4c596324f482 tempest-GroupsTest-1862271077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (122312e6-bff9-4675-bfcc-c4de67156911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:37:27 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-2429cf8e-140c-4660-8ca1-4c596324f482 tempest-GroupsTest-1862271077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38228829-2580-4941-ac84-d902ab6a9da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:37:27 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-2429cf8e-140c-4660-8ca1-4c596324f482 tempest-GroupsTest-1862271077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38228829-2580-4941-ac84-d902ab6a9da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e70be161-0555-4643-987f-47fff465ecf2', 'volume_name': 'volume-e70be161-0555-4643-987f-47fff465ecf2', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:37:27 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-2429cf8e-140c-4660-8ca1-4c596324f482 tempest-GroupsTest-1862271077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5383be7a-5721-448b-8c79-85f56ccb2796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:37:27 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-2429cf8e-140c-4660-8ca1-4c596324f482 tempest-GroupsTest-1862271077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5383be7a-5721-448b-8c79-85f56ccb2796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:37:27 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-2429cf8e-140c-4660-8ca1-4c596324f482 tempest-GroupsTest-1862271077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8dc0996-0d8a-4c13-a05a-574beb7c9677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:37:27 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-2429cf8e-140c-4660-8ca1-4c596324f482 tempest-GroupsTest-1862271077 None] Volume e70be161-0555-4643-987f-47fff465ecf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e70be161-0555-4643-987f-47fff465ecf2', 'volume_size': 1} Sep 10 21:37:27 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-2429cf8e-140c-4660-8ca1-4c596324f482 tempest-GroupsTest-1862271077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:37:27 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-2429cf8e-140c-4660-8ca1-4c596324f482 tempest-GroupsTest-1862271077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:37:27 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-2429cf8e-140c-4660-8ca1-4c596324f482 tempest-GroupsTest-1862271077 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=63e89cd1-9e87-4090-8c04-670a1f3d513a,created_at=2025-09-10T19:37:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1579119028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=63e89cd1-9e87-4090-8c04-670a1f3d513a,host='devstack@QuobyteHD#QuobyteHD',id=e70be161-0555-4643-987f-47fff465ecf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45732ae242004345afd1c746f42ae034',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:37:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:37:27Z,use_quota=True,user_id='e24c01b9fa9a4429bee357dd8a94b605',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6d76867-d24f-4941-bbf6-6ed5d69739de),volume_type_id=d6d76867-d24f-4941-bbf6-6ed5d69739de)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:37:27 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-2429cf8e-140c-4660-8ca1-4c596324f482 tempest-GroupsTest-1862271077 None] Creating volume e70be161-0555-4643-987f-47fff465ecf2 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:37:27 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-2429cf8e-140c-4660-8ca1-4c596324f482 tempest-GroupsTest-1862271077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:37:27 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-2429cf8e-140c-4660-8ca1-4c596324f482 tempest-GroupsTest-1862271077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:37:27 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-2429cf8e-140c-4660-8ca1-4c596324f482 tempest-GroupsTest-1862271077 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:37:27 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-2429cf8e-140c-4660-8ca1-4c596324f482 tempest-GroupsTest-1862271077 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:37:27 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-2429cf8e-140c-4660-8ca1-4c596324f482 tempest-GroupsTest-1862271077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:37:27 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-2429cf8e-140c-4660-8ca1-4c596324f482 tempest-GroupsTest-1862271077 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:37:27 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-2429cf8e-140c-4660-8ca1-4c596324f482 tempest-GroupsTest-1862271077 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:37:27 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-2429cf8e-140c-4660-8ca1-4c596324f482 tempest-GroupsTest-1862271077 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-e70be161-0555-4643-987f-47fff465ecf2 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:37:27 devstack quobyte-client[82807]: System call of process 99387 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:37:27 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=108, name=volume-e70be161-0555-4643-987f-47fff465ecf2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:37:27 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-2429cf8e-140c-4660-8ca1-4c596324f482 tempest-GroupsTest-1862271077 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-e70be161-0555-4643-987f-47fff465ecf2 1073741824" returned: 0 in 0.349s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:37:27 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-2429cf8e-140c-4660-8ca1-4c596324f482 tempest-GroupsTest-1862271077 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-e70be161-0555-4643-987f-47fff465ecf2 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:37:27 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-2429cf8e-140c-4660-8ca1-4c596324f482 tempest-GroupsTest-1862271077 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-e70be161-0555-4643-987f-47fff465ecf2" returned: 0 in 0.096s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:37:27 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-2429cf8e-140c-4660-8ca1-4c596324f482 tempest-GroupsTest-1862271077 None] <== create_volume: return (535ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:37:27 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-2429cf8e-140c-4660-8ca1-4c596324f482 tempest-GroupsTest-1862271077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.546s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:37:27 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-2429cf8e-140c-4660-8ca1-4c596324f482 tempest-GroupsTest-1862271077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8dc0996-0d8a-4c13-a05a-574beb7c9677) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e70be161-0555-4643-987f-47fff465ecf2', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:37:27 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-2429cf8e-140c-4660-8ca1-4c596324f482 tempest-GroupsTest-1862271077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24f1648f-9451-4154-85da-63b56396c69b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:37:28 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-2429cf8e-140c-4660-8ca1-4c596324f482 tempest-GroupsTest-1862271077 None] Volume volume-e70be161-0555-4643-987f-47fff465ecf2 (e70be161-0555-4643-987f-47fff465ecf2): created successfully Sep 10 21:37:28 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-2429cf8e-140c-4660-8ca1-4c596324f482 tempest-GroupsTest-1862271077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24f1648f-9451-4154-85da-63b56396c69b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:37:28 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-2429cf8e-140c-4660-8ca1-4c596324f482 tempest-GroupsTest-1862271077 None] Flow 'volume_create_manager' (acb7d374-2c74-4b23-844f-640057354107) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:37:28 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-2429cf8e-140c-4660-8ca1-4c596324f482 tempest-GroupsTest-1862271077 None] Created volume successfully. Sep 10 21:37:29 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-48323b4b-085a-4dec-883a-24440a4f0ea6 tempest-GroupsTest-1862271077 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:37:29 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-48323b4b-085a-4dec-883a-24440a4f0ea6 tempest-GroupsTest-1862271077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:37:29 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-48323b4b-085a-4dec-883a-24440a4f0ea6 tempest-GroupsTest-1862271077 None] Flow 'volume_create_manager' (5447bd64-58c8-4352-beb9-dff66f222f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:37:29 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-48323b4b-085a-4dec-883a-24440a4f0ea6 tempest-GroupsTest-1862271077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19af1a3e-333f-4252-a0c3-74007fa2934b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:37:29 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-48323b4b-085a-4dec-883a-24440a4f0ea6 tempest-GroupsTest-1862271077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19af1a3e-333f-4252-a0c3-74007fa2934b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:37:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1977528565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=63e89cd1-9e87-4090-8c04-670a1f3d513a,host='devstack@QuobyteHD#QuobyteHD',id=b66ca558-b577-43ec-aec3-46ab47d1c463,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45732ae242004345afd1c746f42ae034',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:37:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:37:30Z,use_quota=True,user_id='e24c01b9fa9a4429bee357dd8a94b605',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6d76867-d24f-4941-bbf6-6ed5d69739de),volume_type_id=d6d76867-d24f-4941-bbf6-6ed5d69739de)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:37:29 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-48323b4b-085a-4dec-883a-24440a4f0ea6 tempest-GroupsTest-1862271077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3ef499b-10f6-41a8-9e92-166b3cc38894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:37:29 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-48323b4b-085a-4dec-883a-24440a4f0ea6 tempest-GroupsTest-1862271077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3ef499b-10f6-41a8-9e92-166b3cc38894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:37:29 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-48323b4b-085a-4dec-883a-24440a4f0ea6 tempest-GroupsTest-1862271077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (770ddd21-e488-4c7e-aeb2-64b3e4f6cd43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:37:29 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-48323b4b-085a-4dec-883a-24440a4f0ea6 tempest-GroupsTest-1862271077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (770ddd21-e488-4c7e-aeb2-64b3e4f6cd43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b66ca558-b577-43ec-aec3-46ab47d1c463', 'volume_name': 'volume-b66ca558-b577-43ec-aec3-46ab47d1c463', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:37:30 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-48323b4b-085a-4dec-883a-24440a4f0ea6 tempest-GroupsTest-1862271077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59218d7f-976f-46a7-9daa-f22d3c14aa4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:37:30 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-48323b4b-085a-4dec-883a-24440a4f0ea6 tempest-GroupsTest-1862271077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59218d7f-976f-46a7-9daa-f22d3c14aa4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:37:30 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-48323b4b-085a-4dec-883a-24440a4f0ea6 tempest-GroupsTest-1862271077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e93a533-2174-467e-9e73-10c7e45a00ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:37:30 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-48323b4b-085a-4dec-883a-24440a4f0ea6 tempest-GroupsTest-1862271077 None] Volume b66ca558-b577-43ec-aec3-46ab47d1c463: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b66ca558-b577-43ec-aec3-46ab47d1c463', 'volume_size': 1} Sep 10 21:37:30 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-48323b4b-085a-4dec-883a-24440a4f0ea6 tempest-GroupsTest-1862271077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:37:30 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-48323b4b-085a-4dec-883a-24440a4f0ea6 tempest-GroupsTest-1862271077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:37:30 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-48323b4b-085a-4dec-883a-24440a4f0ea6 tempest-GroupsTest-1862271077 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=63e89cd1-9e87-4090-8c04-670a1f3d513a,created_at=2025-09-10T19:37:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1977528565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=63e89cd1-9e87-4090-8c04-670a1f3d513a,host='devstack@QuobyteHD#QuobyteHD',id=b66ca558-b577-43ec-aec3-46ab47d1c463,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45732ae242004345afd1c746f42ae034',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:37:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:37:30Z,use_quota=True,user_id='e24c01b9fa9a4429bee357dd8a94b605',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6d76867-d24f-4941-bbf6-6ed5d69739de),volume_type_id=d6d76867-d24f-4941-bbf6-6ed5d69739de)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:37:30 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-48323b4b-085a-4dec-883a-24440a4f0ea6 tempest-GroupsTest-1862271077 None] Creating volume b66ca558-b577-43ec-aec3-46ab47d1c463 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:37:30 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-48323b4b-085a-4dec-883a-24440a4f0ea6 tempest-GroupsTest-1862271077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:37:30 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-48323b4b-085a-4dec-883a-24440a4f0ea6 tempest-GroupsTest-1862271077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:37:30 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-48323b4b-085a-4dec-883a-24440a4f0ea6 tempest-GroupsTest-1862271077 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:37:30 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-48323b4b-085a-4dec-883a-24440a4f0ea6 tempest-GroupsTest-1862271077 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:37:30 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-48323b4b-085a-4dec-883a-24440a4f0ea6 tempest-GroupsTest-1862271077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:37:30 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-48323b4b-085a-4dec-883a-24440a4f0ea6 tempest-GroupsTest-1862271077 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:37:30 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-48323b4b-085a-4dec-883a-24440a4f0ea6 tempest-GroupsTest-1862271077 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:37:30 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-48323b4b-085a-4dec-883a-24440a4f0ea6 tempest-GroupsTest-1862271077 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b66ca558-b577-43ec-aec3-46ab47d1c463 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:37:30 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=109, name=volume-b66ca558-b577-43ec-aec3-46ab47d1c463, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:37:30 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-48323b4b-085a-4dec-883a-24440a4f0ea6 tempest-GroupsTest-1862271077 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b66ca558-b577-43ec-aec3-46ab47d1c463 1073741824" returned: 0 in 0.339s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:37:30 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-48323b4b-085a-4dec-883a-24440a4f0ea6 tempest-GroupsTest-1862271077 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b66ca558-b577-43ec-aec3-46ab47d1c463 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:37:30 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-48323b4b-085a-4dec-883a-24440a4f0ea6 tempest-GroupsTest-1862271077 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b66ca558-b577-43ec-aec3-46ab47d1c463" returned: 0 in 0.095s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:37:30 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-48323b4b-085a-4dec-883a-24440a4f0ea6 tempest-GroupsTest-1862271077 None] <== create_volume: return (498ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:37:30 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-48323b4b-085a-4dec-883a-24440a4f0ea6 tempest-GroupsTest-1862271077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.510s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:37:30 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-48323b4b-085a-4dec-883a-24440a4f0ea6 tempest-GroupsTest-1862271077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e93a533-2174-467e-9e73-10c7e45a00ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b66ca558-b577-43ec-aec3-46ab47d1c463', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:37:30 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-48323b4b-085a-4dec-883a-24440a4f0ea6 tempest-GroupsTest-1862271077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9ea6725-831a-4cd4-aef9-6ee392c880d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:37:30 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-48323b4b-085a-4dec-883a-24440a4f0ea6 tempest-GroupsTest-1862271077 None] Volume volume-b66ca558-b577-43ec-aec3-46ab47d1c463 (b66ca558-b577-43ec-aec3-46ab47d1c463): created successfully Sep 10 21:37:30 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-48323b4b-085a-4dec-883a-24440a4f0ea6 tempest-GroupsTest-1862271077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9ea6725-831a-4cd4-aef9-6ee392c880d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:37:30 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-48323b4b-085a-4dec-883a-24440a4f0ea6 tempest-GroupsTest-1862271077 None] Flow 'volume_create_manager' (5447bd64-58c8-4352-beb9-dff66f222f70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:37:30 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-48323b4b-085a-4dec-883a-24440a4f0ea6 tempest-GroupsTest-1862271077 None] Created volume successfully. Sep 10 21:37:31 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-1c268c3d-b0f4-43e2-bfcc-3994b04f7548 tempest-GroupsTest-1862271077 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:37:31 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-1c268c3d-b0f4-43e2-bfcc-3994b04f7548 tempest-GroupsTest-1862271077 None] Update group completed successfully. Sep 10 21:37:32 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-f53524e0-2744-4e3b-9cba-14ba0e41bc24 tempest-GroupsTest-1862271077 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:37:32 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-f53524e0-2744-4e3b-9cba-14ba0e41bc24 tempest-GroupsTest-1862271077 None] Update group completed successfully. Sep 10 21:37:34 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-b7475f49-5614-4cc4-b35e-57c01b083c49 tempest-GroupsTest-1862271077 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:37:34 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-b7475f49-5614-4cc4-b35e-57c01b083c49 tempest-GroupsTest-1862271077 None] Acquiring lock "cinder-quobyte-b66ca558-b577-43ec-aec3-46ab47d1c463" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:37:34 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-b7475f49-5614-4cc4-b35e-57c01b083c49 tempest-GroupsTest-1862271077 None] Lock "cinder-quobyte-b66ca558-b577-43ec-aec3-46ab47d1c463" acquired by "delete_volume" :: waited 0.050s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:37:34 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0b6287-ba5a-4886-9857-5a45f96a519e]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:37:34 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b7475f49-5614-4cc4-b35e-57c01b083c49 tempest-GroupsTest-1862271077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b66ca558-b577-43ec-aec3-46ab47d1c463 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:37:34 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b7475f49-5614-4cc4-b35e-57c01b083c49 tempest-GroupsTest-1862271077 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b66ca558-b577-43ec-aec3-46ab47d1c463" returned: 0 in 0.479s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:37:34 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b7475f49-5614-4cc4-b35e-57c01b083c49 tempest-GroupsTest-1862271077 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b66ca558-b577-43ec-aec3-46ab47d1c463 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:37:34 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b7475f49-5614-4cc4-b35e-57c01b083c49 tempest-GroupsTest-1862271077 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b66ca558-b577-43ec-aec3-46ab47d1c463" returned: 0 in 0.116s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:37:34 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-b7475f49-5614-4cc4-b35e-57c01b083c49 tempest-GroupsTest-1862271077 None] Lock "cinder-quobyte-b66ca558-b577-43ec-aec3-46ab47d1c463" released by "delete_volume" :: held 0.783s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:37:35 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-b7475f49-5614-4cc4-b35e-57c01b083c49 tempest-GroupsTest-1862271077 None] Acquiring lock "cinder-quobyte-e70be161-0555-4643-987f-47fff465ecf2" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:37:35 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-b7475f49-5614-4cc4-b35e-57c01b083c49 tempest-GroupsTest-1862271077 None] Lock "cinder-quobyte-e70be161-0555-4643-987f-47fff465ecf2" acquired by "delete_volume" :: waited 0.030s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:37:35 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe7dfcf-c943-4c50-b930-68827fdfb7cc]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:37:35 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b7475f49-5614-4cc4-b35e-57c01b083c49 tempest-GroupsTest-1862271077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-e70be161-0555-4643-987f-47fff465ecf2 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:37:35 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b7475f49-5614-4cc4-b35e-57c01b083c49 tempest-GroupsTest-1862271077 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-e70be161-0555-4643-987f-47fff465ecf2" returned: 0 in 0.549s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:37:35 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b7475f49-5614-4cc4-b35e-57c01b083c49 tempest-GroupsTest-1862271077 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-e70be161-0555-4643-987f-47fff465ecf2 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:37:35 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b7475f49-5614-4cc4-b35e-57c01b083c49 tempest-GroupsTest-1862271077 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-e70be161-0555-4643-987f-47fff465ecf2" returned: 0 in 0.103s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:37:35 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-b7475f49-5614-4cc4-b35e-57c01b083c49 tempest-GroupsTest-1862271077 None] Lock "cinder-quobyte-e70be161-0555-4643-987f-47fff465ecf2" released by "delete_volume" :: held 0.832s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:37:36 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-b7475f49-5614-4cc4-b35e-57c01b083c49 tempest-GroupsTest-1862271077 None] Created reservations ['d43f05b1-74a9-4077-8a92-91a3e892ea5d'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:37:36 devstack cinder-volume[82780]: WARNING cinder.quota [None req-b7475f49-5614-4cc4-b35e-57c01b083c49 tempest-GroupsTest-1862271077 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1535137697 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1535137697, it is now deprecated. Please use the default quota class for default quota. Sep 10 21:37:36 devstack cinder-volume[82780]: WARNING cinder.quota [None req-b7475f49-5614-4cc4-b35e-57c01b083c49 tempest-GroupsTest-1862271077 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1535137697 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1535137697, it is now deprecated. Please use the default quota class for default quota. Sep 10 21:37:36 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-b7475f49-5614-4cc4-b35e-57c01b083c49 tempest-GroupsTest-1862271077 None] Created reservations ['12210fe9-6810-421c-bc68-54bb4441dcac', 'e62d580f-a8dc-46b6-ba88-7df18b5dc01e', '9d96bee4-0807-47b8-9ae3-2ef82579dd11', '6d62aeb1-375b-4fe6-896a-2c5e27478c8a'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:37:36 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-b7475f49-5614-4cc4-b35e-57c01b083c49 tempest-GroupsTest-1862271077 None] Created reservations ['857f0ec1-c624-4f54-b301-44efcdf4bebe', 'bb1bc55f-ec08-4505-921d-f258ddd8e810', '511627e9-8f2b-46b0-bc21-7becf184c929', '2e62fefb-d791-4463-8063-c746311aa6c3'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:37:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-b7475f49-5614-4cc4-b35e-57c01b083c49 tempest-GroupsTest-1862271077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:37:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-b7475f49-5614-4cc4-b35e-57c01b083c49 tempest-GroupsTest-1862271077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:37:36 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-b7475f49-5614-4cc4-b35e-57c01b083c49 tempest-GroupsTest-1862271077 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:37:36 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-b7475f49-5614-4cc4-b35e-57c01b083c49 tempest-GroupsTest-1862271077 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:37:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-b7475f49-5614-4cc4-b35e-57c01b083c49 tempest-GroupsTest-1862271077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:37:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b7475f49-5614-4cc4-b35e-57c01b083c49 tempest-GroupsTest-1862271077 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:37:37 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b7475f49-5614-4cc4-b35e-57c01b083c49 tempest-GroupsTest-1862271077 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.109s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:37:37 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-b7475f49-5614-4cc4-b35e-57c01b083c49 tempest-GroupsTest-1862271077 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:37:37 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-b7475f49-5614-4cc4-b35e-57c01b083c49 tempest-GroupsTest-1862271077 None] Delete group completed successfully. Sep 10 21:37:44 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-d16e189a-32ba-47cc-8e58-6cac11c8a2db tempest-GroupsV320Test-397440971 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:37:44 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-d16e189a-32ba-47cc-8e58-6cac11c8a2db tempest-GroupsV320Test-397440971 None] Group tempest-GroupsV320Test-Group-2100933987: creating Sep 10 21:37:44 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-d16e189a-32ba-47cc-8e58-6cac11c8a2db tempest-GroupsV320Test-397440971 None] Group tempest-GroupsV320Test-Group-2100933987: created successfully Sep 10 21:37:44 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-d16e189a-32ba-47cc-8e58-6cac11c8a2db tempest-GroupsV320Test-397440971 None] Create group completed successfully. Sep 10 21:37:46 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-fb0540eb-a5d1-45f7-9add-15b1157240c9 tempest-GroupsV320Test-397440971 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:37:46 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-fb0540eb-a5d1-45f7-9add-15b1157240c9 tempest-GroupsV320Test-397440971 None] Created reservations ['31bcdcb2-e985-44c3-ad8c-8b518e734a18'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:37:46 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-fb0540eb-a5d1-45f7-9add-15b1157240c9 tempest-GroupsV320Test-397440971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:37:46 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-fb0540eb-a5d1-45f7-9add-15b1157240c9 tempest-GroupsV320Test-397440971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:37:46 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-fb0540eb-a5d1-45f7-9add-15b1157240c9 tempest-GroupsV320Test-397440971 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:37:46 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-fb0540eb-a5d1-45f7-9add-15b1157240c9 tempest-GroupsV320Test-397440971 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:37:46 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-fb0540eb-a5d1-45f7-9add-15b1157240c9 tempest-GroupsV320Test-397440971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:37:46 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-fb0540eb-a5d1-45f7-9add-15b1157240c9 tempest-GroupsV320Test-397440971 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:37:46 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-fb0540eb-a5d1-45f7-9add-15b1157240c9 tempest-GroupsV320Test-397440971 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.130s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:37:46 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-fb0540eb-a5d1-45f7-9add-15b1157240c9 tempest-GroupsV320Test-397440971 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:37:46 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-fb0540eb-a5d1-45f7-9add-15b1157240c9 tempest-GroupsV320Test-397440971 None] Delete group completed successfully. Sep 10 21:37:57 devstack cinder-volume[82780]: DEBUG oslo_service.periodic_task [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82780) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 21:37:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:37:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:37:57 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:37:57 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:37:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:37:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:37:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.203s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:37:57 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:37:59 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=56,cinder:UPDATE=53,cinder:INSERT=8 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:37:59 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=38,cinder:UPDATE=40,cinder:DELETE=3,cinder:INSERT=8 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:38:02 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-fbce03b0-bfa6-4f43-a1c9-5c48fb056ef6 req-9c1737b0-0609-4903-8c59-f8008732bdad tempest-TestShelveInstance-1183991641 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:38:02 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-fbce03b0-bfa6-4f43-a1c9-5c48fb056ef6 req-9c1737b0-0609-4903-8c59-f8008732bdad tempest-TestShelveInstance-1183991641 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:38:02 devstack cinder-volume[82780]: INFO cinder.volume.manager [req-fbce03b0-bfa6-4f43-a1c9-5c48fb056ef6 req-9c1737b0-0609-4903-8c59-f8008732bdad tempest-TestShelveInstance-1183991641 None] Terminate volume connection completed successfully. Sep 10 21:38:02 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-fbce03b0-bfa6-4f43-a1c9-5c48fb056ef6 req-9c1737b0-0609-4903-8c59-f8008732bdad tempest-TestShelveInstance-1183991641 None] Deleting attachment 7f982fe9-c752-4713-8d75-a2f52afd850d. {{(pid=82780) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 21:38:03 devstack cinder-volume[82780]: DEBUG cinder.coordination [req-fbce03b0-bfa6-4f43-a1c9-5c48fb056ef6 req-f9eb9973-0fb2-405b-b895-88e2f9f34119 tempest-TestShelveInstance-1183991641 None] Acquiring lock "cinder-4981e10c-be5f-49d8-9abb-009ee0cac6b6-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:38:03 devstack cinder-volume[82780]: DEBUG cinder.coordination [req-fbce03b0-bfa6-4f43-a1c9-5c48fb056ef6 req-f9eb9973-0fb2-405b-b895-88e2f9f34119 tempest-TestShelveInstance-1183991641 None] Lock "cinder-4981e10c-be5f-49d8-9abb-009ee0cac6b6-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:38:03 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-fbce03b0-bfa6-4f43-a1c9-5c48fb056ef6 req-f9eb9973-0fb2-405b-b895-88e2f9f34119 tempest-TestShelveInstance-1183991641 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:38:03 devstack cinder-volume[82780]: DEBUG cinder.coordination [req-fbce03b0-bfa6-4f43-a1c9-5c48fb056ef6 req-f9eb9973-0fb2-405b-b895-88e2f9f34119 tempest-TestShelveInstance-1183991641 None] Acquiring lock "cinder-quobyte-4981e10c-be5f-49d8-9abb-009ee0cac6b6" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:38:03 devstack cinder-volume[82780]: DEBUG cinder.coordination [req-fbce03b0-bfa6-4f43-a1c9-5c48fb056ef6 req-f9eb9973-0fb2-405b-b895-88e2f9f34119 tempest-TestShelveInstance-1183991641 None] Lock "cinder-quobyte-4981e10c-be5f-49d8-9abb-009ee0cac6b6" acquired by "delete_volume" :: waited 0.022s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:38:03 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eeae2f5-78aa-461b-bfd8-88b911017f77]: (4, 'raw') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:38:03 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-fbce03b0-bfa6-4f43-a1c9-5c48fb056ef6 req-f9eb9973-0fb2-405b-b895-88e2f9f34119 tempest-TestShelveInstance-1183991641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-4981e10c-be5f-49d8-9abb-009ee0cac6b6 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:04 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-fbce03b0-bfa6-4f43-a1c9-5c48fb056ef6 req-f9eb9973-0fb2-405b-b895-88e2f9f34119 tempest-TestShelveInstance-1183991641 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-4981e10c-be5f-49d8-9abb-009ee0cac6b6" returned: 0 in 0.554s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:04 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-fbce03b0-bfa6-4f43-a1c9-5c48fb056ef6 req-f9eb9973-0fb2-405b-b895-88e2f9f34119 tempest-TestShelveInstance-1183991641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-4981e10c-be5f-49d8-9abb-009ee0cac6b6 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:04 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-fbce03b0-bfa6-4f43-a1c9-5c48fb056ef6 req-f9eb9973-0fb2-405b-b895-88e2f9f34119 tempest-TestShelveInstance-1183991641 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-4981e10c-be5f-49d8-9abb-009ee0cac6b6" returned: 1 in 0.450s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:04 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-fbce03b0-bfa6-4f43-a1c9-5c48fb056ef6 req-f9eb9973-0fb2-405b-b895-88e2f9f34119 tempest-TestShelveInstance-1183991641 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-4981e10c-be5f-49d8-9abb-009ee0cac6b6' failed. Not Retrying. {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 21:38:04 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-fbce03b0-bfa6-4f43-a1c9-5c48fb056ef6 req-f9eb9973-0fb2-405b-b895-88e2f9f34119 tempest-TestShelveInstance-1183991641 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-4981e10c-be5f-49d8-9abb-009ee0cac6b6 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:04 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-fbce03b0-bfa6-4f43-a1c9-5c48fb056ef6 req-f9eb9973-0fb2-405b-b895-88e2f9f34119 tempest-TestShelveInstance-1183991641 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-4981e10c-be5f-49d8-9abb-009ee0cac6b6" returned: 0 in 0.107s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:04 devstack cinder-volume[82780]: DEBUG cinder.coordination [req-fbce03b0-bfa6-4f43-a1c9-5c48fb056ef6 req-f9eb9973-0fb2-405b-b895-88e2f9f34119 tempest-TestShelveInstance-1183991641 None] Lock "cinder-quobyte-4981e10c-be5f-49d8-9abb-009ee0cac6b6" released by "delete_volume" :: held 1.406s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:38:05 devstack cinder-volume[82780]: DEBUG cinder.quota [req-fbce03b0-bfa6-4f43-a1c9-5c48fb056ef6 req-f9eb9973-0fb2-405b-b895-88e2f9f34119 tempest-TestShelveInstance-1183991641 None] Created reservations ['2ef55caf-c2ef-423e-b6dd-992e3e8235a2', 'd8c6dbc5-a99d-424e-8698-331a754d9f70', '5745e992-5c8b-43eb-b8eb-5e6ce8335232', 'b4c01ed6-6fe2-4887-a923-96b7e6cc52f1'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:38:05 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-fbce03b0-bfa6-4f43-a1c9-5c48fb056ef6 req-f9eb9973-0fb2-405b-b895-88e2f9f34119 tempest-TestShelveInstance-1183991641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:38:05 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-fbce03b0-bfa6-4f43-a1c9-5c48fb056ef6 req-f9eb9973-0fb2-405b-b895-88e2f9f34119 tempest-TestShelveInstance-1183991641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:38:05 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [req-fbce03b0-bfa6-4f43-a1c9-5c48fb056ef6 req-f9eb9973-0fb2-405b-b895-88e2f9f34119 tempest-TestShelveInstance-1183991641 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:38:05 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [req-fbce03b0-bfa6-4f43-a1c9-5c48fb056ef6 req-f9eb9973-0fb2-405b-b895-88e2f9f34119 tempest-TestShelveInstance-1183991641 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:38:05 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-fbce03b0-bfa6-4f43-a1c9-5c48fb056ef6 req-f9eb9973-0fb2-405b-b895-88e2f9f34119 tempest-TestShelveInstance-1183991641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:38:05 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-fbce03b0-bfa6-4f43-a1c9-5c48fb056ef6 req-f9eb9973-0fb2-405b-b895-88e2f9f34119 tempest-TestShelveInstance-1183991641 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:05 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-fbce03b0-bfa6-4f43-a1c9-5c48fb056ef6 req-f9eb9973-0fb2-405b-b895-88e2f9f34119 tempest-TestShelveInstance-1183991641 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.146s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:05 devstack cinder-volume[82780]: DEBUG cinder.manager [req-fbce03b0-bfa6-4f43-a1c9-5c48fb056ef6 req-f9eb9973-0fb2-405b-b895-88e2f9f34119 tempest-TestShelveInstance-1183991641 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:38:05 devstack cinder-volume[82780]: INFO cinder.volume.manager [req-fbce03b0-bfa6-4f43-a1c9-5c48fb056ef6 req-f9eb9973-0fb2-405b-b895-88e2f9f34119 tempest-TestShelveInstance-1183991641 None] Deleted volume successfully. Sep 10 21:38:06 devstack cinder-volume[82780]: DEBUG cinder.coordination [req-fbce03b0-bfa6-4f43-a1c9-5c48fb056ef6 req-f9eb9973-0fb2-405b-b895-88e2f9f34119 tempest-TestShelveInstance-1183991641 None] Lock "cinder-4981e10c-be5f-49d8-9abb-009ee0cac6b6-delete_volume" released by "delete_volume" :: held 2.670s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:38:09 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-f76a5491-d289-49ed-be96-5b0accfe25ef tempest-SnapshotsActionsTest-898806204 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:38:09 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-f76a5491-d289-49ed-be96-5b0accfe25ef tempest-SnapshotsActionsTest-898806204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:38:09 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-f76a5491-d289-49ed-be96-5b0accfe25ef tempest-SnapshotsActionsTest-898806204 None] Flow 'volume_create_manager' (c213beee-9489-485d-99e2-bc32d45d8f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:38:09 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-f76a5491-d289-49ed-be96-5b0accfe25ef tempest-SnapshotsActionsTest-898806204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9345ca92-9468-4913-807f-db9059f39a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:38:09 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-f76a5491-d289-49ed-be96-5b0accfe25ef tempest-SnapshotsActionsTest-898806204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9345ca92-9468-4913-807f-db9059f39a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:38:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-910219618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9e88b77-4d0d-42ab-a29e-f4c453b5123b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aec82ed04a4d4e7f84599378bcb90d88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:38:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:38:09Z,use_quota=True,user_id='1d6f1cab67ea46b7987a28a79e4bfa28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:38:09 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-f76a5491-d289-49ed-be96-5b0accfe25ef tempest-SnapshotsActionsTest-898806204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eff7e2e9-ae7c-4d16-9d5a-2addefb56f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:38:09 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-f76a5491-d289-49ed-be96-5b0accfe25ef tempest-SnapshotsActionsTest-898806204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eff7e2e9-ae7c-4d16-9d5a-2addefb56f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:38:09 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-f76a5491-d289-49ed-be96-5b0accfe25ef tempest-SnapshotsActionsTest-898806204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (805ee97f-af2d-4b6e-9ed0-e85c49c48026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:38:09 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-f76a5491-d289-49ed-be96-5b0accfe25ef tempest-SnapshotsActionsTest-898806204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (805ee97f-af2d-4b6e-9ed0-e85c49c48026) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9e88b77-4d0d-42ab-a29e-f4c453b5123b', 'volume_name': 'volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:38:09 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-f76a5491-d289-49ed-be96-5b0accfe25ef tempest-SnapshotsActionsTest-898806204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33c4af1f-50e2-4bcc-8581-5d0f6129abee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:38:09 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-f76a5491-d289-49ed-be96-5b0accfe25ef tempest-SnapshotsActionsTest-898806204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33c4af1f-50e2-4bcc-8581-5d0f6129abee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:38:09 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-f76a5491-d289-49ed-be96-5b0accfe25ef tempest-SnapshotsActionsTest-898806204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1cae493-740e-4b00-b69c-cec4be069669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:38:09 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-f76a5491-d289-49ed-be96-5b0accfe25ef tempest-SnapshotsActionsTest-898806204 None] Volume b9e88b77-4d0d-42ab-a29e-f4c453b5123b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b', 'volume_size': 1} Sep 10 21:38:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-f76a5491-d289-49ed-be96-5b0accfe25ef tempest-SnapshotsActionsTest-898806204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:38:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-f76a5491-d289-49ed-be96-5b0accfe25ef tempest-SnapshotsActionsTest-898806204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:38:09 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-f76a5491-d289-49ed-be96-5b0accfe25ef tempest-SnapshotsActionsTest-898806204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:38:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-910219618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9e88b77-4d0d-42ab-a29e-f4c453b5123b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aec82ed04a4d4e7f84599378bcb90d88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:38:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:38:09Z,use_quota=True,user_id='1d6f1cab67ea46b7987a28a79e4bfa28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:38:09 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-f76a5491-d289-49ed-be96-5b0accfe25ef tempest-SnapshotsActionsTest-898806204 None] Creating volume b9e88b77-4d0d-42ab-a29e-f4c453b5123b {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:38:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-f76a5491-d289-49ed-be96-5b0accfe25ef tempest-SnapshotsActionsTest-898806204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:38:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-f76a5491-d289-49ed-be96-5b0accfe25ef tempest-SnapshotsActionsTest-898806204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:38:09 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-f76a5491-d289-49ed-be96-5b0accfe25ef tempest-SnapshotsActionsTest-898806204 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:38:09 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-f76a5491-d289-49ed-be96-5b0accfe25ef tempest-SnapshotsActionsTest-898806204 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:38:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-f76a5491-d289-49ed-be96-5b0accfe25ef tempest-SnapshotsActionsTest-898806204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:38:09 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-f76a5491-d289-49ed-be96-5b0accfe25ef tempest-SnapshotsActionsTest-898806204 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:38:09 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-f76a5491-d289-49ed-be96-5b0accfe25ef tempest-SnapshotsActionsTest-898806204 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:38:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f76a5491-d289-49ed-be96-5b0accfe25ef tempest-SnapshotsActionsTest-898806204 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:09 devstack quobyte-client[82807]: System call of process 99521 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:38:09 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=110, name=volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:38:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f76a5491-d289-49ed-be96-5b0accfe25ef tempest-SnapshotsActionsTest-898806204 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b 1073741824" returned: 0 in 0.533s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f76a5491-d289-49ed-be96-5b0accfe25ef tempest-SnapshotsActionsTest-898806204 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f76a5491-d289-49ed-be96-5b0accfe25ef tempest-SnapshotsActionsTest-898806204 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b" returned: 0 in 0.144s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:10 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-f76a5491-d289-49ed-be96-5b0accfe25ef tempest-SnapshotsActionsTest-898806204 None] <== create_volume: return (756ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:38:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-f76a5491-d289-49ed-be96-5b0accfe25ef tempest-SnapshotsActionsTest-898806204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:38:10 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-f76a5491-d289-49ed-be96-5b0accfe25ef tempest-SnapshotsActionsTest-898806204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1cae493-740e-4b00-b69c-cec4be069669) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:38:10 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-f76a5491-d289-49ed-be96-5b0accfe25ef tempest-SnapshotsActionsTest-898806204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0cfbe0c-9996-4264-92ce-0c78f07b1137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:38:10 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-f76a5491-d289-49ed-be96-5b0accfe25ef tempest-SnapshotsActionsTest-898806204 None] Volume volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b (b9e88b77-4d0d-42ab-a29e-f4c453b5123b): created successfully Sep 10 21:38:10 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-f76a5491-d289-49ed-be96-5b0accfe25ef tempest-SnapshotsActionsTest-898806204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0cfbe0c-9996-4264-92ce-0c78f07b1137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:38:10 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-f76a5491-d289-49ed-be96-5b0accfe25ef tempest-SnapshotsActionsTest-898806204 None] Flow 'volume_create_manager' (c213beee-9489-485d-99e2-bc32d45d8f24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:38:10 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-f76a5491-d289-49ed-be96-5b0accfe25ef tempest-SnapshotsActionsTest-898806204 None] Created volume successfully. Sep 10 21:38:11 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-4b825a4b-c26b-4654-a770-5b57a5402c5d tempest-SnapshotsActionsTest-898806204 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:38:11 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-4b825a4b-c26b-4654-a770-5b57a5402c5d tempest-SnapshotsActionsTest-898806204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:38:11 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-4b825a4b-c26b-4654-a770-5b57a5402c5d tempest-SnapshotsActionsTest-898806204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:38:11 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-4b825a4b-c26b-4654-a770-5b57a5402c5d tempest-SnapshotsActionsTest-898806204 None] Creating offline snapshot fbeac7e8-7f56-40ff-8d2b-56f61fa8460b of volume b9e88b77-4d0d-42ab-a29e-f4c453b5123b {{(pid=82780) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 21:38:11 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d49febd-10c6-4a23-8d8a-1e261b864558]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:38:11 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4b825a4b-c26b-4654-a770-5b57a5402c5d tempest-SnapshotsActionsTest-898806204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:12 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4b825a4b-c26b-4654-a770-5b57a5402c5d tempest-SnapshotsActionsTest-898806204 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b" returned: 0 in 0.530s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:12 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4b825a4b-c26b-4654-a770-5b57a5402c5d tempest-SnapshotsActionsTest-898806204 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.fbeac7e8-7f56-40ff-8d2b-56f61fa8460b 1G {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:12 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=111, name=volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.fbeac7e8-7f56-40ff-8d2b-56f61fa8460b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:38:12 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4b825a4b-c26b-4654-a770-5b57a5402c5d tempest-SnapshotsActionsTest-898806204 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.fbeac7e8-7f56-40ff-8d2b-56f61fa8460b 1G" returned: 0 in 0.358s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:12 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4b825a4b-c26b-4654-a770-5b57a5402c5d tempest-SnapshotsActionsTest-898806204 None] Running cmd (subprocess): qemu-img rebase -u -b volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b -F qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.fbeac7e8-7f56-40ff-8d2b-56f61fa8460b {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:13 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4b825a4b-c26b-4654-a770-5b57a5402c5d tempest-SnapshotsActionsTest-898806204 None] CMD "qemu-img rebase -u -b volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b -F qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.fbeac7e8-7f56-40ff-8d2b-56f61fa8460b" returned: 0 in 0.206s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:13 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-4b825a4b-c26b-4654-a770-5b57a5402c5d tempest-SnapshotsActionsTest-898806204 None] File path /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.fbeac7e8-7f56-40ff-8d2b-56f61fa8460b is being set with permissions: 660 {{(pid=82780) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 21:38:13 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4b825a4b-c26b-4654-a770-5b57a5402c5d tempest-SnapshotsActionsTest-898806204 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.fbeac7e8-7f56-40ff-8d2b-56f61fa8460b {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:13 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4b825a4b-c26b-4654-a770-5b57a5402c5d tempest-SnapshotsActionsTest-898806204 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.fbeac7e8-7f56-40ff-8d2b-56f61fa8460b" returned: 0 in 0.270s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:13 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-4b825a4b-c26b-4654-a770-5b57a5402c5d tempest-SnapshotsActionsTest-898806204 None] Setting permissions: /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b -> 1000:1000 {{(pid=82780) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 21:38:13 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4b825a4b-c26b-4654-a770-5b57a5402c5d tempest-SnapshotsActionsTest-898806204 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.fbeac7e8-7f56-40ff-8d2b-56f61fa8460b {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:13 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4b825a4b-c26b-4654-a770-5b57a5402c5d tempest-SnapshotsActionsTest-898806204 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.fbeac7e8-7f56-40ff-8d2b-56f61fa8460b" returned: 0 in 0.149s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:13 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4b825a4b-c26b-4654-a770-5b57a5402c5d tempest-SnapshotsActionsTest-898806204 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.info {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:13 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4b825a4b-c26b-4654-a770-5b57a5402c5d tempest-SnapshotsActionsTest-898806204 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.info" returned: 0 in 0.147s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:13 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-4b825a4b-c26b-4654-a770-5b57a5402c5d tempest-SnapshotsActionsTest-898806204 None] File path /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.info is being set with permissions: 660 {{(pid=82780) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 21:38:13 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4b825a4b-c26b-4654-a770-5b57a5402c5d tempest-SnapshotsActionsTest-898806204 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.info {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4b825a4b-c26b-4654-a770-5b57a5402c5d tempest-SnapshotsActionsTest-898806204 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.info" returned: 0 in 0.126s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-4b825a4b-c26b-4654-a770-5b57a5402c5d tempest-SnapshotsActionsTest-898806204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.237s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:38:14 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-4b825a4b-c26b-4654-a770-5b57a5402c5d tempest-SnapshotsActionsTest-898806204 None] Create snapshot completed successfully Sep 10 21:38:16 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-eea29247-f60b-49ac-a3f2-785d18b0fe15 tempest-SnapshotsActionsTest-898806204 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:38:16 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-eea29247-f60b-49ac-a3f2-785d18b0fe15 tempest-SnapshotsActionsTest-898806204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:38:16 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-eea29247-f60b-49ac-a3f2-785d18b0fe15 tempest-SnapshotsActionsTest-898806204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:38:16 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-eea29247-f60b-49ac-a3f2-785d18b0fe15 tempest-SnapshotsActionsTest-898806204 None] Creating offline snapshot 745b8e05-d83b-465d-9b14-4f8f9df8f6a9 of volume b9e88b77-4d0d-42ab-a29e-f4c453b5123b {{(pid=82780) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 21:38:16 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26077d8-e22b-4f28-9378-143eb2c94477]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:38:16 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-eea29247-f60b-49ac-a3f2-785d18b0fe15 tempest-SnapshotsActionsTest-898806204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.fbeac7e8-7f56-40ff-8d2b-56f61fa8460b {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:16 devstack quobyte-client[82807]: System call of process 99540 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:38:16 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-eea29247-f60b-49ac-a3f2-785d18b0fe15 tempest-SnapshotsActionsTest-898806204 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.fbeac7e8-7f56-40ff-8d2b-56f61fa8460b" returned: 0 in 0.543s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:16 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-eea29247-f60b-49ac-a3f2-785d18b0fe15 tempest-SnapshotsActionsTest-898806204 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82780) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 21:38:16 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-eea29247-f60b-49ac-a3f2-785d18b0fe15 tempest-SnapshotsActionsTest-898806204 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.fbeac7e8-7f56-40ff-8d2b-56f61fa8460b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.745b8e05-d83b-465d-9b14-4f8f9df8f6a9 1G {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:17 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=113, name=volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.745b8e05-d83b-465d-9b14-4f8f9df8f6a9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:38:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-eea29247-f60b-49ac-a3f2-785d18b0fe15 tempest-SnapshotsActionsTest-898806204 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.fbeac7e8-7f56-40ff-8d2b-56f61fa8460b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.745b8e05-d83b-465d-9b14-4f8f9df8f6a9 1G" returned: 0 in 0.412s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-eea29247-f60b-49ac-a3f2-785d18b0fe15 tempest-SnapshotsActionsTest-898806204 None] Running cmd (subprocess): qemu-img rebase -u -b volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.fbeac7e8-7f56-40ff-8d2b-56f61fa8460b -F qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.745b8e05-d83b-465d-9b14-4f8f9df8f6a9 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-eea29247-f60b-49ac-a3f2-785d18b0fe15 tempest-SnapshotsActionsTest-898806204 None] CMD "qemu-img rebase -u -b volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.fbeac7e8-7f56-40ff-8d2b-56f61fa8460b -F qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.745b8e05-d83b-465d-9b14-4f8f9df8f6a9" returned: 0 in 0.180s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:17 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-eea29247-f60b-49ac-a3f2-785d18b0fe15 tempest-SnapshotsActionsTest-898806204 None] File path /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.745b8e05-d83b-465d-9b14-4f8f9df8f6a9 is being set with permissions: 660 {{(pid=82780) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 21:38:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-eea29247-f60b-49ac-a3f2-785d18b0fe15 tempest-SnapshotsActionsTest-898806204 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.745b8e05-d83b-465d-9b14-4f8f9df8f6a9 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-eea29247-f60b-49ac-a3f2-785d18b0fe15 tempest-SnapshotsActionsTest-898806204 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.745b8e05-d83b-465d-9b14-4f8f9df8f6a9" returned: 0 in 0.098s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:17 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-eea29247-f60b-49ac-a3f2-785d18b0fe15 tempest-SnapshotsActionsTest-898806204 None] Setting permissions: /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.fbeac7e8-7f56-40ff-8d2b-56f61fa8460b -> 1000:1000 {{(pid=82780) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 21:38:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-eea29247-f60b-49ac-a3f2-785d18b0fe15 tempest-SnapshotsActionsTest-898806204 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.fbeac7e8-7f56-40ff-8d2b-56f61fa8460b /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.745b8e05-d83b-465d-9b14-4f8f9df8f6a9 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-eea29247-f60b-49ac-a3f2-785d18b0fe15 tempest-SnapshotsActionsTest-898806204 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.fbeac7e8-7f56-40ff-8d2b-56f61fa8460b /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.745b8e05-d83b-465d-9b14-4f8f9df8f6a9" returned: 0 in 0.102s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-eea29247-f60b-49ac-a3f2-785d18b0fe15 tempest-SnapshotsActionsTest-898806204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.693s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:38:18 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-eea29247-f60b-49ac-a3f2-785d18b0fe15 tempest-SnapshotsActionsTest-898806204 None] Create snapshot completed successfully Sep 10 21:38:19 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-2510ffd0-5b74-4451-9d7c-1700ee076273 tempest-SnapshotsActionsTest-1337509060 None] Acquiring lock "cinder-745b8e05-d83b-465d-9b14-4f8f9df8f6a9-delete_snapshot" by "delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:38:19 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-2510ffd0-5b74-4451-9d7c-1700ee076273 tempest-SnapshotsActionsTest-1337509060 None] Lock "cinder-745b8e05-d83b-465d-9b14-4f8f9df8f6a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.079s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:38:19 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-2510ffd0-5b74-4451-9d7c-1700ee076273 tempest-SnapshotsActionsTest-1337509060 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:38:19 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-2510ffd0-5b74-4451-9d7c-1700ee076273 tempest-SnapshotsActionsTest-1337509060 None] Acquiring lock "cinder-quobyte-b9e88b77-4d0d-42ab-a29e-f4c453b5123b" by "delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:38:19 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-2510ffd0-5b74-4451-9d7c-1700ee076273 tempest-SnapshotsActionsTest-1337509060 None] Lock "cinder-quobyte-b9e88b77-4d0d-42ab-a29e-f4c453b5123b" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:38:19 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-2510ffd0-5b74-4451-9d7c-1700ee076273 tempest-SnapshotsActionsTest-1337509060 None] Acquiring lock "cinder-quobyte-745b8e05-d83b-465d-9b14-4f8f9df8f6a9" by "_delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:38:19 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-2510ffd0-5b74-4451-9d7c-1700ee076273 tempest-SnapshotsActionsTest-1337509060 None] Lock "cinder-quobyte-745b8e05-d83b-465d-9b14-4f8f9df8f6a9" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:38:19 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-2510ffd0-5b74-4451-9d7c-1700ee076273 tempest-SnapshotsActionsTest-1337509060 None] Deleting offline snapshot 745b8e05-d83b-465d-9b14-4f8f9df8f6a9 of volume b9e88b77-4d0d-42ab-a29e-f4c453b5123b {{(pid=82780) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 21:38:19 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-2510ffd0-5b74-4451-9d7c-1700ee076273 tempest-SnapshotsActionsTest-1337509060 None] snapshot_file for this snap is: volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.745b8e05-d83b-465d-9b14-4f8f9df8f6a9 {{(pid=82780) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 21:38:19 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[de44c398-6154-4339-a9e3-47696bce80e8]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:38:19 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-2510ffd0-5b74-4451-9d7c-1700ee076273 tempest-SnapshotsActionsTest-1337509060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.745b8e05-d83b-465d-9b14-4f8f9df8f6a9 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-2510ffd0-5b74-4451-9d7c-1700ee076273 tempest-SnapshotsActionsTest-1337509060 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.745b8e05-d83b-465d-9b14-4f8f9df8f6a9" returned: 0 in 0.599s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:20 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-2510ffd0-5b74-4451-9d7c-1700ee076273 tempest-SnapshotsActionsTest-1337509060 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82780) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 21:38:20 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c0ff25-d39e-4d33-90bc-ff84e1a5d6ff]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:38:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-2510ffd0-5b74-4451-9d7c-1700ee076273 tempest-SnapshotsActionsTest-1337509060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.fbeac7e8-7f56-40ff-8d2b-56f61fa8460b {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:21 devstack quobyte-client[82807]: System call of process 99556 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:38:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-2510ffd0-5b74-4451-9d7c-1700ee076273 tempest-SnapshotsActionsTest-1337509060 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.fbeac7e8-7f56-40ff-8d2b-56f61fa8460b" returned: 0 in 0.671s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:21 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-2510ffd0-5b74-4451-9d7c-1700ee076273 tempest-SnapshotsActionsTest-1337509060 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82780) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 21:38:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-2510ffd0-5b74-4451-9d7c-1700ee076273 tempest-SnapshotsActionsTest-1337509060 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.745b8e05-d83b-465d-9b14-4f8f9df8f6a9 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-2510ffd0-5b74-4451-9d7c-1700ee076273 tempest-SnapshotsActionsTest-1337509060 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.745b8e05-d83b-465d-9b14-4f8f9df8f6a9" returned: 0 in 0.356s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-2510ffd0-5b74-4451-9d7c-1700ee076273 tempest-SnapshotsActionsTest-1337509060 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.745b8e05-d83b-465d-9b14-4f8f9df8f6a9 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-2510ffd0-5b74-4451-9d7c-1700ee076273 tempest-SnapshotsActionsTest-1337509060 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.745b8e05-d83b-465d-9b14-4f8f9df8f6a9" returned: 0 in 0.160s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:21 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-2510ffd0-5b74-4451-9d7c-1700ee076273 tempest-SnapshotsActionsTest-1337509060 None] Lock "cinder-quobyte-745b8e05-d83b-465d-9b14-4f8f9df8f6a9" released by "_delete_snapshot" :: held 2.179s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:38:21 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-2510ffd0-5b74-4451-9d7c-1700ee076273 tempest-SnapshotsActionsTest-1337509060 None] Lock "cinder-quobyte-b9e88b77-4d0d-42ab-a29e-f4c453b5123b" released by "delete_snapshot" :: held 2.248s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:38:22 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-2510ffd0-5b74-4451-9d7c-1700ee076273 tempest-SnapshotsActionsTest-1337509060 None] Created reservations ['92ab6197-471a-49b8-8edc-973c17c5a0bc', '311e4c4e-d346-4d30-868f-173ceb30a2d5', 'd69c3ce8-c3f0-4d15-90df-e1f23088f0e7', '7e32fcfa-eb8e-4b49-85e9-88fdcefe60ce'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:38:22 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-2510ffd0-5b74-4451-9d7c-1700ee076273 tempest-SnapshotsActionsTest-1337509060 None] Delete snapshot completed successfully. Sep 10 21:38:22 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-2510ffd0-5b74-4451-9d7c-1700ee076273 tempest-SnapshotsActionsTest-1337509060 None] Lock "cinder-745b8e05-d83b-465d-9b14-4f8f9df8f6a9-delete_snapshot" released by "delete_snapshot" :: held 2.853s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:38:23 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-914b4f6e-697e-4697-af1b-c2aa8789295e tempest-SnapshotsActionsTest-898806204 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:38:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-914b4f6e-697e-4697-af1b-c2aa8789295e tempest-SnapshotsActionsTest-898806204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:38:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-914b4f6e-697e-4697-af1b-c2aa8789295e tempest-SnapshotsActionsTest-898806204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:38:23 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-914b4f6e-697e-4697-af1b-c2aa8789295e tempest-SnapshotsActionsTest-898806204 None] Creating offline snapshot 5f760851-8717-45f2-9b98-5bd1b75e41b4 of volume b9e88b77-4d0d-42ab-a29e-f4c453b5123b {{(pid=82780) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 21:38:23 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[512ef4b8-fc3a-4ccd-9778-9de7c34e9a28]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:38:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-914b4f6e-697e-4697-af1b-c2aa8789295e tempest-SnapshotsActionsTest-898806204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.fbeac7e8-7f56-40ff-8d2b-56f61fa8460b {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-914b4f6e-697e-4697-af1b-c2aa8789295e tempest-SnapshotsActionsTest-898806204 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.fbeac7e8-7f56-40ff-8d2b-56f61fa8460b" returned: 0 in 0.537s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:24 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-914b4f6e-697e-4697-af1b-c2aa8789295e tempest-SnapshotsActionsTest-898806204 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82780) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 21:38:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-914b4f6e-697e-4697-af1b-c2aa8789295e tempest-SnapshotsActionsTest-898806204 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.fbeac7e8-7f56-40ff-8d2b-56f61fa8460b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.5f760851-8717-45f2-9b98-5bd1b75e41b4 1G {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:24 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=114, name=volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.5f760851-8717-45f2-9b98-5bd1b75e41b4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:38:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-914b4f6e-697e-4697-af1b-c2aa8789295e tempest-SnapshotsActionsTest-898806204 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.fbeac7e8-7f56-40ff-8d2b-56f61fa8460b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.5f760851-8717-45f2-9b98-5bd1b75e41b4 1G" returned: 0 in 0.357s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-914b4f6e-697e-4697-af1b-c2aa8789295e tempest-SnapshotsActionsTest-898806204 None] Running cmd (subprocess): qemu-img rebase -u -b volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.fbeac7e8-7f56-40ff-8d2b-56f61fa8460b -F qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.5f760851-8717-45f2-9b98-5bd1b75e41b4 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-914b4f6e-697e-4697-af1b-c2aa8789295e tempest-SnapshotsActionsTest-898806204 None] CMD "qemu-img rebase -u -b volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.fbeac7e8-7f56-40ff-8d2b-56f61fa8460b -F qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.5f760851-8717-45f2-9b98-5bd1b75e41b4" returned: 0 in 0.166s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:24 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-914b4f6e-697e-4697-af1b-c2aa8789295e tempest-SnapshotsActionsTest-898806204 None] File path /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.5f760851-8717-45f2-9b98-5bd1b75e41b4 is being set with permissions: 660 {{(pid=82780) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 21:38:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-914b4f6e-697e-4697-af1b-c2aa8789295e tempest-SnapshotsActionsTest-898806204 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.5f760851-8717-45f2-9b98-5bd1b75e41b4 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:25 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-914b4f6e-697e-4697-af1b-c2aa8789295e tempest-SnapshotsActionsTest-898806204 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.5f760851-8717-45f2-9b98-5bd1b75e41b4" returned: 0 in 0.115s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:25 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-914b4f6e-697e-4697-af1b-c2aa8789295e tempest-SnapshotsActionsTest-898806204 None] Setting permissions: /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.fbeac7e8-7f56-40ff-8d2b-56f61fa8460b -> 1000:1000 {{(pid=82780) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 21:38:25 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-914b4f6e-697e-4697-af1b-c2aa8789295e tempest-SnapshotsActionsTest-898806204 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.fbeac7e8-7f56-40ff-8d2b-56f61fa8460b /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.5f760851-8717-45f2-9b98-5bd1b75e41b4 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:25 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-914b4f6e-697e-4697-af1b-c2aa8789295e tempest-SnapshotsActionsTest-898806204 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.fbeac7e8-7f56-40ff-8d2b-56f61fa8460b /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.5f760851-8717-45f2-9b98-5bd1b75e41b4" returned: 0 in 0.116s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:25 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-914b4f6e-697e-4697-af1b-c2aa8789295e tempest-SnapshotsActionsTest-898806204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.667s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:38:25 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-914b4f6e-697e-4697-af1b-c2aa8789295e tempest-SnapshotsActionsTest-898806204 None] Create snapshot completed successfully Sep 10 21:38:25 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-e6fec0e4-4bd7-4c0d-afaf-a7ea116faeb3 tempest-SnapshotsActionsTest-1337509060 None] Acquiring lock "cinder-5f760851-8717-45f2-9b98-5bd1b75e41b4-delete_snapshot" by "delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:38:25 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-e6fec0e4-4bd7-4c0d-afaf-a7ea116faeb3 tempest-SnapshotsActionsTest-1337509060 None] Lock "cinder-5f760851-8717-45f2-9b98-5bd1b75e41b4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.079s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:38:25 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-e6fec0e4-4bd7-4c0d-afaf-a7ea116faeb3 tempest-SnapshotsActionsTest-1337509060 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:38:25 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-e6fec0e4-4bd7-4c0d-afaf-a7ea116faeb3 tempest-SnapshotsActionsTest-1337509060 None] Acquiring lock "cinder-quobyte-b9e88b77-4d0d-42ab-a29e-f4c453b5123b" by "delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:38:26 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-e6fec0e4-4bd7-4c0d-afaf-a7ea116faeb3 tempest-SnapshotsActionsTest-1337509060 None] Lock "cinder-quobyte-b9e88b77-4d0d-42ab-a29e-f4c453b5123b" acquired by "delete_snapshot" :: waited 0.051s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:38:26 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-e6fec0e4-4bd7-4c0d-afaf-a7ea116faeb3 tempest-SnapshotsActionsTest-1337509060 None] Acquiring lock "cinder-quobyte-5f760851-8717-45f2-9b98-5bd1b75e41b4" by "_delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:38:26 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-e6fec0e4-4bd7-4c0d-afaf-a7ea116faeb3 tempest-SnapshotsActionsTest-1337509060 None] Lock "cinder-quobyte-5f760851-8717-45f2-9b98-5bd1b75e41b4" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:38:26 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-e6fec0e4-4bd7-4c0d-afaf-a7ea116faeb3 tempest-SnapshotsActionsTest-1337509060 None] Deleting offline snapshot 5f760851-8717-45f2-9b98-5bd1b75e41b4 of volume b9e88b77-4d0d-42ab-a29e-f4c453b5123b {{(pid=82780) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 21:38:26 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-e6fec0e4-4bd7-4c0d-afaf-a7ea116faeb3 tempest-SnapshotsActionsTest-1337509060 None] snapshot_file for this snap is: volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.5f760851-8717-45f2-9b98-5bd1b75e41b4 {{(pid=82780) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 21:38:26 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[2403a268-6566-4188-a076-7c763ff4885e]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:38:26 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e6fec0e4-4bd7-4c0d-afaf-a7ea116faeb3 tempest-SnapshotsActionsTest-1337509060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.5f760851-8717-45f2-9b98-5bd1b75e41b4 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:26 devstack quobyte-client[82807]: System call of process 99575 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:38:26 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e6fec0e4-4bd7-4c0d-afaf-a7ea116faeb3 tempest-SnapshotsActionsTest-1337509060 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.5f760851-8717-45f2-9b98-5bd1b75e41b4" returned: 0 in 0.565s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:26 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-e6fec0e4-4bd7-4c0d-afaf-a7ea116faeb3 tempest-SnapshotsActionsTest-1337509060 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82780) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 21:38:26 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[005b07e0-ef36-4c4b-87e3-f7c4d827d3c3]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:38:26 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e6fec0e4-4bd7-4c0d-afaf-a7ea116faeb3 tempest-SnapshotsActionsTest-1337509060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.fbeac7e8-7f56-40ff-8d2b-56f61fa8460b {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:27 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e6fec0e4-4bd7-4c0d-afaf-a7ea116faeb3 tempest-SnapshotsActionsTest-1337509060 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.fbeac7e8-7f56-40ff-8d2b-56f61fa8460b" returned: 0 in 0.502s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:27 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-e6fec0e4-4bd7-4c0d-afaf-a7ea116faeb3 tempest-SnapshotsActionsTest-1337509060 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82780) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 21:38:27 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e6fec0e4-4bd7-4c0d-afaf-a7ea116faeb3 tempest-SnapshotsActionsTest-1337509060 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.5f760851-8717-45f2-9b98-5bd1b75e41b4 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:27 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e6fec0e4-4bd7-4c0d-afaf-a7ea116faeb3 tempest-SnapshotsActionsTest-1337509060 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.5f760851-8717-45f2-9b98-5bd1b75e41b4" returned: 0 in 0.258s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:27 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e6fec0e4-4bd7-4c0d-afaf-a7ea116faeb3 tempest-SnapshotsActionsTest-1337509060 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.5f760851-8717-45f2-9b98-5bd1b75e41b4 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:27 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e6fec0e4-4bd7-4c0d-afaf-a7ea116faeb3 tempest-SnapshotsActionsTest-1337509060 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.5f760851-8717-45f2-9b98-5bd1b75e41b4" returned: 0 in 0.145s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:28 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-e6fec0e4-4bd7-4c0d-afaf-a7ea116faeb3 tempest-SnapshotsActionsTest-1337509060 None] Lock "cinder-quobyte-5f760851-8717-45f2-9b98-5bd1b75e41b4" released by "_delete_snapshot" :: held 1.990s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:38:28 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-e6fec0e4-4bd7-4c0d-afaf-a7ea116faeb3 tempest-SnapshotsActionsTest-1337509060 None] Lock "cinder-quobyte-b9e88b77-4d0d-42ab-a29e-f4c453b5123b" released by "delete_snapshot" :: held 2.046s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:38:28 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-e6fec0e4-4bd7-4c0d-afaf-a7ea116faeb3 tempest-SnapshotsActionsTest-1337509060 None] Created reservations ['37273c39-be29-4ac0-8d49-57661bcb9ab2', 'b291a5a2-c553-4a15-9da6-2027bab2d0b2', 'ad402855-81c6-4afc-83e4-d02210ceb450', '3400ad68-9909-4647-bb05-d878eca11980'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:38:28 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-e6fec0e4-4bd7-4c0d-afaf-a7ea116faeb3 tempest-SnapshotsActionsTest-1337509060 None] Delete snapshot completed successfully. Sep 10 21:38:28 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-e6fec0e4-4bd7-4c0d-afaf-a7ea116faeb3 tempest-SnapshotsActionsTest-1337509060 None] Lock "cinder-5f760851-8717-45f2-9b98-5bd1b75e41b4-delete_snapshot" released by "delete_snapshot" :: held 2.659s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:38:29 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-e557dde9-7cc7-4e40-9459-a63f6c1484cb tempest-SnapshotsActionsTest-898806204 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:38:29 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-e557dde9-7cc7-4e40-9459-a63f6c1484cb tempest-SnapshotsActionsTest-898806204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:38:29 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-e557dde9-7cc7-4e40-9459-a63f6c1484cb tempest-SnapshotsActionsTest-898806204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:38:29 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-e557dde9-7cc7-4e40-9459-a63f6c1484cb tempest-SnapshotsActionsTest-898806204 None] Creating offline snapshot 6cccde1b-7334-4760-a68f-c419321d972f of volume b9e88b77-4d0d-42ab-a29e-f4c453b5123b {{(pid=82780) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 21:38:29 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-5b8f16bb-5e0a-4f52-856f-7f72e89678f3 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:38:29 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b8f16bb-5e0a-4f52-856f-7f72e89678f3 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:38:29 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-5b8f16bb-5e0a-4f52-856f-7f72e89678f3 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Flow 'volume_create_manager' (2fe906eb-a472-417e-acca-11ddda22877f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:38:29 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-5b8f16bb-5e0a-4f52-856f-7f72e89678f3 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce447852-2723-44d7-a71c-9f10baf216f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:38:29 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[97598dd7-6260-45db-82a6-060719cc776a]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:38:29 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e557dde9-7cc7-4e40-9459-a63f6c1484cb tempest-SnapshotsActionsTest-898806204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.fbeac7e8-7f56-40ff-8d2b-56f61fa8460b {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:30 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-5b8f16bb-5e0a-4f52-856f-7f72e89678f3 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce447852-2723-44d7-a71c-9f10baf216f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:38:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-591814673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76b79227-34b8-43e2-a468-278aa6893ddb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af63d2d3e4c84b6286873d6921cda01f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:38:30Z,use_quota=True,user_id='b6bdfddc8c894f5f9e366f2a7a69a68c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:38:30 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-5b8f16bb-5e0a-4f52-856f-7f72e89678f3 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d456604-37ea-4c24-b58a-b00ab6384163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:38:30 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-5b8f16bb-5e0a-4f52-856f-7f72e89678f3 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d456604-37ea-4c24-b58a-b00ab6384163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:38:30 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-5b8f16bb-5e0a-4f52-856f-7f72e89678f3 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (668cb61a-a58c-4f23-aaa4-aaee7934058a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:38:30 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-5b8f16bb-5e0a-4f52-856f-7f72e89678f3 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (668cb61a-a58c-4f23-aaa4-aaee7934058a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76b79227-34b8-43e2-a468-278aa6893ddb', 'volume_name': 'volume-76b79227-34b8-43e2-a468-278aa6893ddb', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:38:30 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-5b8f16bb-5e0a-4f52-856f-7f72e89678f3 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ff37021-d450-44eb-84ae-1b1e176c79d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:38:30 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-5b8f16bb-5e0a-4f52-856f-7f72e89678f3 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ff37021-d450-44eb-84ae-1b1e176c79d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:38:30 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-5b8f16bb-5e0a-4f52-856f-7f72e89678f3 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e7b83db-d69c-4bbf-b4d7-4a728537c655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:38:30 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-5b8f16bb-5e0a-4f52-856f-7f72e89678f3 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Volume 76b79227-34b8-43e2-a468-278aa6893ddb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76b79227-34b8-43e2-a468-278aa6893ddb', 'volume_size': 1} Sep 10 21:38:30 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-5b8f16bb-5e0a-4f52-856f-7f72e89678f3 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:38:30 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e557dde9-7cc7-4e40-9459-a63f6c1484cb tempest-SnapshotsActionsTest-898806204 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.fbeac7e8-7f56-40ff-8d2b-56f61fa8460b" returned: 0 in 0.500s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:30 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-e557dde9-7cc7-4e40-9459-a63f6c1484cb tempest-SnapshotsActionsTest-898806204 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82780) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 21:38:30 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e557dde9-7cc7-4e40-9459-a63f6c1484cb tempest-SnapshotsActionsTest-898806204 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.fbeac7e8-7f56-40ff-8d2b-56f61fa8460b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.6cccde1b-7334-4760-a68f-c419321d972f 1G {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:30 devstack quobyte-client[82807]: System call of process 99592 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:38:30 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=115, name=volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.6cccde1b-7334-4760-a68f-c419321d972f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:38:30 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e557dde9-7cc7-4e40-9459-a63f6c1484cb tempest-SnapshotsActionsTest-898806204 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.fbeac7e8-7f56-40ff-8d2b-56f61fa8460b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.6cccde1b-7334-4760-a68f-c419321d972f 1G" returned: 0 in 0.293s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:30 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e557dde9-7cc7-4e40-9459-a63f6c1484cb tempest-SnapshotsActionsTest-898806204 None] Running cmd (subprocess): qemu-img rebase -u -b volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.fbeac7e8-7f56-40ff-8d2b-56f61fa8460b -F qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.6cccde1b-7334-4760-a68f-c419321d972f {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:30 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e557dde9-7cc7-4e40-9459-a63f6c1484cb tempest-SnapshotsActionsTest-898806204 None] CMD "qemu-img rebase -u -b volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.fbeac7e8-7f56-40ff-8d2b-56f61fa8460b -F qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.6cccde1b-7334-4760-a68f-c419321d972f" returned: 0 in 0.156s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:30 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-e557dde9-7cc7-4e40-9459-a63f6c1484cb tempest-SnapshotsActionsTest-898806204 None] File path /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.6cccde1b-7334-4760-a68f-c419321d972f is being set with permissions: 660 {{(pid=82780) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 21:38:30 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e557dde9-7cc7-4e40-9459-a63f6c1484cb tempest-SnapshotsActionsTest-898806204 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.6cccde1b-7334-4760-a68f-c419321d972f {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e557dde9-7cc7-4e40-9459-a63f6c1484cb tempest-SnapshotsActionsTest-898806204 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.6cccde1b-7334-4760-a68f-c419321d972f" returned: 0 in 0.093s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:31 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-e557dde9-7cc7-4e40-9459-a63f6c1484cb tempest-SnapshotsActionsTest-898806204 None] Setting permissions: /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.fbeac7e8-7f56-40ff-8d2b-56f61fa8460b -> 1000:1000 {{(pid=82780) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 21:38:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e557dde9-7cc7-4e40-9459-a63f6c1484cb tempest-SnapshotsActionsTest-898806204 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.fbeac7e8-7f56-40ff-8d2b-56f61fa8460b /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.6cccde1b-7334-4760-a68f-c419321d972f {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e557dde9-7cc7-4e40-9459-a63f6c1484cb tempest-SnapshotsActionsTest-898806204 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.fbeac7e8-7f56-40ff-8d2b-56f61fa8460b /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.6cccde1b-7334-4760-a68f-c419321d972f" returned: 0 in 0.099s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-e557dde9-7cc7-4e40-9459-a63f6c1484cb tempest-SnapshotsActionsTest-898806204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.457s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:38:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-5b8f16bb-5e0a-4f52-856f-7f72e89678f3 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.054s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:38:31 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-5b8f16bb-5e0a-4f52-856f-7f72e89678f3 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:38:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-591814673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76b79227-34b8-43e2-a468-278aa6893ddb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af63d2d3e4c84b6286873d6921cda01f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:38:30Z,use_quota=True,user_id='b6bdfddc8c894f5f9e366f2a7a69a68c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:38:31 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-5b8f16bb-5e0a-4f52-856f-7f72e89678f3 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Creating volume 76b79227-34b8-43e2-a468-278aa6893ddb {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:38:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-5b8f16bb-5e0a-4f52-856f-7f72e89678f3 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:38:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-5b8f16bb-5e0a-4f52-856f-7f72e89678f3 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.019s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:38:31 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-5b8f16bb-5e0a-4f52-856f-7f72e89678f3 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:38:31 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-5b8f16bb-5e0a-4f52-856f-7f72e89678f3 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:38:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-5b8f16bb-5e0a-4f52-856f-7f72e89678f3 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:38:31 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-5b8f16bb-5e0a-4f52-856f-7f72e89678f3 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:38:31 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-5b8f16bb-5e0a-4f52-856f-7f72e89678f3 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:38:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-5b8f16bb-5e0a-4f52-856f-7f72e89678f3 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-76b79227-34b8-43e2-a468-278aa6893ddb 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:31 devstack quobyte-client[82807]: System call of process 99600 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:38:31 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=116, name=volume-76b79227-34b8-43e2-a468-278aa6893ddb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:38:31 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-e557dde9-7cc7-4e40-9459-a63f6c1484cb tempest-SnapshotsActionsTest-898806204 None] Create snapshot completed successfully Sep 10 21:38:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-5b8f16bb-5e0a-4f52-856f-7f72e89678f3 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-76b79227-34b8-43e2-a468-278aa6893ddb 1073741824" returned: 0 in 0.478s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-5b8f16bb-5e0a-4f52-856f-7f72e89678f3 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-76b79227-34b8-43e2-a468-278aa6893ddb {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:32 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-5b8f16bb-5e0a-4f52-856f-7f72e89678f3 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-76b79227-34b8-43e2-a468-278aa6893ddb" returned: 0 in 0.147s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:32 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-5b8f16bb-5e0a-4f52-856f-7f72e89678f3 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] <== create_volume: return (693ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:38:32 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-5b8f16bb-5e0a-4f52-856f-7f72e89678f3 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:38:32 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-5b8f16bb-5e0a-4f52-856f-7f72e89678f3 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e7b83db-d69c-4bbf-b4d7-4a728537c655) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76b79227-34b8-43e2-a468-278aa6893ddb', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:38:32 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-5b8f16bb-5e0a-4f52-856f-7f72e89678f3 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24dd0786-fde7-4c2b-81d3-6d7511b72f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:38:32 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-5b8f16bb-5e0a-4f52-856f-7f72e89678f3 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Volume volume-76b79227-34b8-43e2-a468-278aa6893ddb (76b79227-34b8-43e2-a468-278aa6893ddb): created successfully Sep 10 21:38:32 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-5b8f16bb-5e0a-4f52-856f-7f72e89678f3 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24dd0786-fde7-4c2b-81d3-6d7511b72f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:38:32 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-5b8f16bb-5e0a-4f52-856f-7f72e89678f3 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Flow 'volume_create_manager' (2fe906eb-a472-417e-acca-11ddda22877f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:38:32 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-5b8f16bb-5e0a-4f52-856f-7f72e89678f3 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Created volume successfully. Sep 10 21:38:32 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-d8e1eb7e-3839-4361-8505-0e51073bf117 tempest-SnapshotsActionsTest-1337509060 None] Acquiring lock "cinder-6cccde1b-7334-4760-a68f-c419321d972f-delete_snapshot" by "delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:38:33 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-d8e1eb7e-3839-4361-8505-0e51073bf117 tempest-SnapshotsActionsTest-1337509060 None] Lock "cinder-6cccde1b-7334-4760-a68f-c419321d972f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.068s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:38:33 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-d8e1eb7e-3839-4361-8505-0e51073bf117 tempest-SnapshotsActionsTest-1337509060 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:38:33 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-d8e1eb7e-3839-4361-8505-0e51073bf117 tempest-SnapshotsActionsTest-1337509060 None] Acquiring lock "cinder-quobyte-b9e88b77-4d0d-42ab-a29e-f4c453b5123b" by "delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:38:33 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-d8e1eb7e-3839-4361-8505-0e51073bf117 tempest-SnapshotsActionsTest-1337509060 None] Lock "cinder-quobyte-b9e88b77-4d0d-42ab-a29e-f4c453b5123b" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:38:33 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-d8e1eb7e-3839-4361-8505-0e51073bf117 tempest-SnapshotsActionsTest-1337509060 None] Acquiring lock "cinder-quobyte-6cccde1b-7334-4760-a68f-c419321d972f" by "_delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:38:33 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-d8e1eb7e-3839-4361-8505-0e51073bf117 tempest-SnapshotsActionsTest-1337509060 None] Lock "cinder-quobyte-6cccde1b-7334-4760-a68f-c419321d972f" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:38:33 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-d8e1eb7e-3839-4361-8505-0e51073bf117 tempest-SnapshotsActionsTest-1337509060 None] Deleting offline snapshot 6cccde1b-7334-4760-a68f-c419321d972f of volume b9e88b77-4d0d-42ab-a29e-f4c453b5123b {{(pid=82780) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 21:38:33 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-d8e1eb7e-3839-4361-8505-0e51073bf117 tempest-SnapshotsActionsTest-1337509060 None] snapshot_file for this snap is: volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.6cccde1b-7334-4760-a68f-c419321d972f {{(pid=82780) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 21:38:33 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21f46d9-ff3b-4b58-8c50-d76fb2057e86]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:38:33 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-d8e1eb7e-3839-4361-8505-0e51073bf117 tempest-SnapshotsActionsTest-1337509060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.6cccde1b-7334-4760-a68f-c419321d972f {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:33 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-d8e1eb7e-3839-4361-8505-0e51073bf117 tempest-SnapshotsActionsTest-1337509060 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.6cccde1b-7334-4760-a68f-c419321d972f" returned: 0 in 0.675s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:33 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-d8e1eb7e-3839-4361-8505-0e51073bf117 tempest-SnapshotsActionsTest-1337509060 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82780) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 21:38:33 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-1809d4db-4e53-40aa-aa14-f1eb57569297 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:38:33 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-1809d4db-4e53-40aa-aa14-f1eb57569297 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:38:33 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1809d4db-4e53-40aa-aa14-f1eb57569297 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Flow 'volume_create_manager' (4e8b60ed-bfa6-4547-8fe0-dc872c1b588d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:38:33 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1809d4db-4e53-40aa-aa14-f1eb57569297 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1004012c-006f-48fc-9f5b-edc368f278b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:38:34 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ee2149-536c-4c2e-a166-9787f759bfb9]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:38:34 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1809d4db-4e53-40aa-aa14-f1eb57569297 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1004012c-006f-48fc-9f5b-edc368f278b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-531303845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75db8dc4-8f54-4354-bc5a-2fb6b61d6078,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af63d2d3e4c84b6286873d6921cda01f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:38:34Z,use_quota=True,user_id='b6bdfddc8c894f5f9e366f2a7a69a68c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:38:34 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1809d4db-4e53-40aa-aa14-f1eb57569297 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd4b67e4-5e8a-4d0d-86e6-fa945ca54bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:38:34 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1809d4db-4e53-40aa-aa14-f1eb57569297 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd4b67e4-5e8a-4d0d-86e6-fa945ca54bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:38:34 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1809d4db-4e53-40aa-aa14-f1eb57569297 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feb3a32a-8733-40c0-9d07-b12831672e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:38:34 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1809d4db-4e53-40aa-aa14-f1eb57569297 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feb3a32a-8733-40c0-9d07-b12831672e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75db8dc4-8f54-4354-bc5a-2fb6b61d6078', 'volume_name': 'volume-75db8dc4-8f54-4354-bc5a-2fb6b61d6078', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:38:34 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1809d4db-4e53-40aa-aa14-f1eb57569297 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc7c95ad-68ed-4194-ae27-1edb9c72d717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:38:34 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1809d4db-4e53-40aa-aa14-f1eb57569297 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc7c95ad-68ed-4194-ae27-1edb9c72d717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:38:34 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1809d4db-4e53-40aa-aa14-f1eb57569297 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88aee912-9fa5-47a6-9188-c66cea9c7e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:38:34 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-1809d4db-4e53-40aa-aa14-f1eb57569297 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Volume 75db8dc4-8f54-4354-bc5a-2fb6b61d6078: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75db8dc4-8f54-4354-bc5a-2fb6b61d6078', 'volume_size': 1} Sep 10 21:38:34 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-1809d4db-4e53-40aa-aa14-f1eb57569297 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:38:34 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-1809d4db-4e53-40aa-aa14-f1eb57569297 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.010s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:38:34 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-1809d4db-4e53-40aa-aa14-f1eb57569297 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-531303845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75db8dc4-8f54-4354-bc5a-2fb6b61d6078,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af63d2d3e4c84b6286873d6921cda01f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:38:34Z,use_quota=True,user_id='b6bdfddc8c894f5f9e366f2a7a69a68c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:38:34 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-1809d4db-4e53-40aa-aa14-f1eb57569297 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Creating volume 75db8dc4-8f54-4354-bc5a-2fb6b61d6078 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:38:34 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-1809d4db-4e53-40aa-aa14-f1eb57569297 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:38:34 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-1809d4db-4e53-40aa-aa14-f1eb57569297 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:38:34 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-1809d4db-4e53-40aa-aa14-f1eb57569297 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:38:34 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-1809d4db-4e53-40aa-aa14-f1eb57569297 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:38:34 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-1809d4db-4e53-40aa-aa14-f1eb57569297 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:38:34 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-1809d4db-4e53-40aa-aa14-f1eb57569297 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:38:34 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-1809d4db-4e53-40aa-aa14-f1eb57569297 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:38:34 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1809d4db-4e53-40aa-aa14-f1eb57569297 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-75db8dc4-8f54-4354-bc5a-2fb6b61d6078 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:34 devstack quobyte-client[82807]: System call of process 99607 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:38:34 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=117, name=volume-75db8dc4-8f54-4354-bc5a-2fb6b61d6078, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:38:34 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-d8e1eb7e-3839-4361-8505-0e51073bf117 tempest-SnapshotsActionsTest-1337509060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.fbeac7e8-7f56-40ff-8d2b-56f61fa8460b {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:34 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1809d4db-4e53-40aa-aa14-f1eb57569297 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-75db8dc4-8f54-4354-bc5a-2fb6b61d6078 1073741824" returned: 0 in 0.873s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:34 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1809d4db-4e53-40aa-aa14-f1eb57569297 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-75db8dc4-8f54-4354-bc5a-2fb6b61d6078 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:35 devstack quobyte-client[82807]: System call of process 99610 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:38:35 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-e19eb7d5-d7d4-413a-808e-c677fda0a330 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:38:35 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-e19eb7d5-d7d4-413a-808e-c677fda0a330 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:38:35 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-e19eb7d5-d7d4-413a-808e-c677fda0a330 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Flow 'volume_create_manager' (a25843f8-cdc6-433b-9713-93e5c618db7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:38:35 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-e19eb7d5-d7d4-413a-808e-c677fda0a330 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a1fa45a-8b92-47ec-a65c-5fdcb9070f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:38:35 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-e19eb7d5-d7d4-413a-808e-c677fda0a330 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a1fa45a-8b92-47ec-a65c-5fdcb9070f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:38:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1481594871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=911a6b2c-073d-4cf9-bf39-c479b9ac27e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af63d2d3e4c84b6286873d6921cda01f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:38:34Z,use_quota=True,user_id='b6bdfddc8c894f5f9e366f2a7a69a68c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:38:35 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-e19eb7d5-d7d4-413a-808e-c677fda0a330 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b124e64e-f95d-4810-8300-5de018a5e6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:38:35 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-e19eb7d5-d7d4-413a-808e-c677fda0a330 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b124e64e-f95d-4810-8300-5de018a5e6b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:38:35 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-e19eb7d5-d7d4-413a-808e-c677fda0a330 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e0a044b-dcdf-471a-8197-d36e42ddd877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:38:35 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-e19eb7d5-d7d4-413a-808e-c677fda0a330 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e0a044b-dcdf-471a-8197-d36e42ddd877) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '911a6b2c-073d-4cf9-bf39-c479b9ac27e9', 'volume_name': 'volume-911a6b2c-073d-4cf9-bf39-c479b9ac27e9', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:38:35 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-e19eb7d5-d7d4-413a-808e-c677fda0a330 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08c89069-fae9-41c8-9e4c-100e182c41e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:38:35 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-e19eb7d5-d7d4-413a-808e-c677fda0a330 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08c89069-fae9-41c8-9e4c-100e182c41e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:38:35 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-e19eb7d5-d7d4-413a-808e-c677fda0a330 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8663665a-251c-469d-a672-50c646ee532b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:38:35 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-e19eb7d5-d7d4-413a-808e-c677fda0a330 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Volume 911a6b2c-073d-4cf9-bf39-c479b9ac27e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-911a6b2c-073d-4cf9-bf39-c479b9ac27e9', 'volume_size': 1} Sep 10 21:38:35 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-e19eb7d5-d7d4-413a-808e-c677fda0a330 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:38:35 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-014da41d-95fe-431c-a406-38eb3ac7056b tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:38:35 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-014da41d-95fe-431c-a406-38eb3ac7056b tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:38:35 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-014da41d-95fe-431c-a406-38eb3ac7056b tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Flow 'volume_create_manager' (ff78c3fb-9341-4b85-8c4c-2c96c0b462c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:38:35 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-014da41d-95fe-431c-a406-38eb3ac7056b tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8836605-9f86-45e7-a740-f2451b7d6e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:38:35 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-d8e1eb7e-3839-4361-8505-0e51073bf117 tempest-SnapshotsActionsTest-1337509060 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.fbeac7e8-7f56-40ff-8d2b-56f61fa8460b" returned: 0 in 1.722s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:35 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-d8e1eb7e-3839-4361-8505-0e51073bf117 tempest-SnapshotsActionsTest-1337509060 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82780) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 21:38:35 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-d8e1eb7e-3839-4361-8505-0e51073bf117 tempest-SnapshotsActionsTest-1337509060 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.6cccde1b-7334-4760-a68f-c419321d972f {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1809d4db-4e53-40aa-aa14-f1eb57569297 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-75db8dc4-8f54-4354-bc5a-2fb6b61d6078" returned: 0 in 1.063s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:36 devstack quobyte-client[82807]: System call of process 99614 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:38:36 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-daa31f6c-6183-44b9-ac08-8cb6a86c1967 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:38:36 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-daa31f6c-6183-44b9-ac08-8cb6a86c1967 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:38:36 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-daa31f6c-6183-44b9-ac08-8cb6a86c1967 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Flow 'volume_create_manager' (87757514-bb8b-4860-a9ae-3b18d7f13cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:38:36 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-daa31f6c-6183-44b9-ac08-8cb6a86c1967 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8663a2e2-57b4-44c5-930e-e659a378a29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:38:36 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-1809d4db-4e53-40aa-aa14-f1eb57569297 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] <== create_volume: return (2302ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:38:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-1809d4db-4e53-40aa-aa14-f1eb57569297 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.313s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:38:36 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-77b5366d-4ab9-461e-b0b6-a3312477b5bd tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:38:36 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-77b5366d-4ab9-461e-b0b6-a3312477b5bd tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:38:36 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-77b5366d-4ab9-461e-b0b6-a3312477b5bd tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Flow 'volume_create_manager' (b4bb3bdd-14e3-4188-9344-907fc288490f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:38:36 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-77b5366d-4ab9-461e-b0b6-a3312477b5bd tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59eb31d1-e8c6-486e-a2ab-b030749fe207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:38:36 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-014da41d-95fe-431c-a406-38eb3ac7056b tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8836605-9f86-45e7-a740-f2451b7d6e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:38:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1762117619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d63e5afa-29f1-4f21-9d07-75fd192ff789,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af63d2d3e4c84b6286873d6921cda01f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:38:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:38:35Z,use_quota=True,user_id='b6bdfddc8c894f5f9e366f2a7a69a68c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:38:36 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-014da41d-95fe-431c-a406-38eb3ac7056b tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df04c2f3-4df7-419f-bdb3-0d0f8d7f6b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:38:36 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-014da41d-95fe-431c-a406-38eb3ac7056b tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df04c2f3-4df7-419f-bdb3-0d0f8d7f6b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:38:36 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-014da41d-95fe-431c-a406-38eb3ac7056b tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e528818-27d2-4743-9277-8902d88b0103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:38:36 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-014da41d-95fe-431c-a406-38eb3ac7056b tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e528818-27d2-4743-9277-8902d88b0103) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd63e5afa-29f1-4f21-9d07-75fd192ff789', 'volume_name': 'volume-d63e5afa-29f1-4f21-9d07-75fd192ff789', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:38:36 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-014da41d-95fe-431c-a406-38eb3ac7056b tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39c284d1-a460-4c8f-9bac-6d7066786166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:38:36 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-014da41d-95fe-431c-a406-38eb3ac7056b tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39c284d1-a460-4c8f-9bac-6d7066786166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:38:36 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-014da41d-95fe-431c-a406-38eb3ac7056b tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a443bca-36af-4eee-a3a7-a9e626ffa6fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:38:36 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-014da41d-95fe-431c-a406-38eb3ac7056b tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Volume d63e5afa-29f1-4f21-9d07-75fd192ff789: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d63e5afa-29f1-4f21-9d07-75fd192ff789', 'volume_size': 1} Sep 10 21:38:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-014da41d-95fe-431c-a406-38eb3ac7056b tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:38:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-014da41d-95fe-431c-a406-38eb3ac7056b tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:38:36 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-014da41d-95fe-431c-a406-38eb3ac7056b tempest-CreateVolumesFromSourceVolumeTest-345054220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:38:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1762117619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d63e5afa-29f1-4f21-9d07-75fd192ff789,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af63d2d3e4c84b6286873d6921cda01f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:38:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:38:35Z,use_quota=True,user_id='b6bdfddc8c894f5f9e366f2a7a69a68c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:38:36 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-014da41d-95fe-431c-a406-38eb3ac7056b tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Creating volume d63e5afa-29f1-4f21-9d07-75fd192ff789 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:38:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-014da41d-95fe-431c-a406-38eb3ac7056b tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:38:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-014da41d-95fe-431c-a406-38eb3ac7056b tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:38:36 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-014da41d-95fe-431c-a406-38eb3ac7056b tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:38:36 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-014da41d-95fe-431c-a406-38eb3ac7056b tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:38:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-014da41d-95fe-431c-a406-38eb3ac7056b tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:38:36 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-014da41d-95fe-431c-a406-38eb3ac7056b tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:38:36 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-014da41d-95fe-431c-a406-38eb3ac7056b tempest-CreateVolumesFromSourceVolumeTest-345054220 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:38:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-014da41d-95fe-431c-a406-38eb3ac7056b tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d63e5afa-29f1-4f21-9d07-75fd192ff789 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:36 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=118, name=volume-d63e5afa-29f1-4f21-9d07-75fd192ff789, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:38:37 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-77b5366d-4ab9-461e-b0b6-a3312477b5bd tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59eb31d1-e8c6-486e-a2ab-b030749fe207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:38:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1521473314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b13002a0-d4de-4718-b9ab-3cd5d1207961,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af63d2d3e4c84b6286873d6921cda01f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:38:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:38:36Z,use_quota=True,user_id='b6bdfddc8c894f5f9e366f2a7a69a68c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:38:37 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-77b5366d-4ab9-461e-b0b6-a3312477b5bd tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6e536ef-7e6d-4694-8e58-eb60e2d7228c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:38:37 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-77b5366d-4ab9-461e-b0b6-a3312477b5bd tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6e536ef-7e6d-4694-8e58-eb60e2d7228c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:38:37 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-77b5366d-4ab9-461e-b0b6-a3312477b5bd tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07c2cd88-82c6-42a4-8b71-e33f9bab7cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:38:37 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-77b5366d-4ab9-461e-b0b6-a3312477b5bd tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07c2cd88-82c6-42a4-8b71-e33f9bab7cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b13002a0-d4de-4718-b9ab-3cd5d1207961', 'volume_name': 'volume-b13002a0-d4de-4718-b9ab-3cd5d1207961', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:38:37 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-77b5366d-4ab9-461e-b0b6-a3312477b5bd tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20e34ab4-bfdd-4d94-8857-9d2ec8f7efba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:38:37 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-77b5366d-4ab9-461e-b0b6-a3312477b5bd tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20e34ab4-bfdd-4d94-8857-9d2ec8f7efba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:38:37 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-77b5366d-4ab9-461e-b0b6-a3312477b5bd tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (513b83e5-6d3d-4af1-a032-417f16204d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:38:37 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-77b5366d-4ab9-461e-b0b6-a3312477b5bd tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Volume b13002a0-d4de-4718-b9ab-3cd5d1207961: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b13002a0-d4de-4718-b9ab-3cd5d1207961', 'volume_size': 1} Sep 10 21:38:37 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-77b5366d-4ab9-461e-b0b6-a3312477b5bd tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:38:37 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-daa31f6c-6183-44b9-ac08-8cb6a86c1967 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8663a2e2-57b4-44c5-930e-e659a378a29d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:38:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2124551772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f4c33ee-4940-4933-875c-eba65aa0323e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af63d2d3e4c84b6286873d6921cda01f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:38:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:38:35Z,use_quota=True,user_id='b6bdfddc8c894f5f9e366f2a7a69a68c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:38:37 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-daa31f6c-6183-44b9-ac08-8cb6a86c1967 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8776de22-6fe1-4bdf-a9b1-b5fff50a7cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:38:37 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-daa31f6c-6183-44b9-ac08-8cb6a86c1967 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8776de22-6fe1-4bdf-a9b1-b5fff50a7cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:38:37 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-daa31f6c-6183-44b9-ac08-8cb6a86c1967 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2460d18b-64bc-47a8-a04d-1402cebdc65d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:38:37 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-daa31f6c-6183-44b9-ac08-8cb6a86c1967 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2460d18b-64bc-47a8-a04d-1402cebdc65d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f4c33ee-4940-4933-875c-eba65aa0323e', 'volume_name': 'volume-5f4c33ee-4940-4933-875c-eba65aa0323e', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:38:37 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-daa31f6c-6183-44b9-ac08-8cb6a86c1967 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c5f5f53-3dc7-4e40-a0de-fd0dfc5093f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:38:37 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-daa31f6c-6183-44b9-ac08-8cb6a86c1967 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c5f5f53-3dc7-4e40-a0de-fd0dfc5093f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:38:37 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-daa31f6c-6183-44b9-ac08-8cb6a86c1967 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c7bd2ff-40e5-4207-ba16-0ddfba8a47ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:38:37 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-daa31f6c-6183-44b9-ac08-8cb6a86c1967 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Volume 5f4c33ee-4940-4933-875c-eba65aa0323e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f4c33ee-4940-4933-875c-eba65aa0323e', 'volume_size': 1} Sep 10 21:38:37 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-daa31f6c-6183-44b9-ac08-8cb6a86c1967 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:38:37 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1809d4db-4e53-40aa-aa14-f1eb57569297 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88aee912-9fa5-47a6-9188-c66cea9c7e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75db8dc4-8f54-4354-bc5a-2fb6b61d6078', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:38:37 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1809d4db-4e53-40aa-aa14-f1eb57569297 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d3d08a0-f916-4f62-9f03-8f5887011d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:38:37 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-014da41d-95fe-431c-a406-38eb3ac7056b tempest-CreateVolumesFromSourceVolumeTest-345054220 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d63e5afa-29f1-4f21-9d07-75fd192ff789 1073741824" returned: 0 in 0.621s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:37 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-d8e1eb7e-3839-4361-8505-0e51073bf117 tempest-SnapshotsActionsTest-1337509060 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.6cccde1b-7334-4760-a68f-c419321d972f" returned: 0 in 1.239s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:37 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-014da41d-95fe-431c-a406-38eb3ac7056b tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d63e5afa-29f1-4f21-9d07-75fd192ff789 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:37 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-d8e1eb7e-3839-4361-8505-0e51073bf117 tempest-SnapshotsActionsTest-1337509060 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.6cccde1b-7334-4760-a68f-c419321d972f {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:37 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-1809d4db-4e53-40aa-aa14-f1eb57569297 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Volume volume-75db8dc4-8f54-4354-bc5a-2fb6b61d6078 (75db8dc4-8f54-4354-bc5a-2fb6b61d6078): created successfully Sep 10 21:38:37 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1809d4db-4e53-40aa-aa14-f1eb57569297 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d3d08a0-f916-4f62-9f03-8f5887011d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:38:37 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1809d4db-4e53-40aa-aa14-f1eb57569297 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Flow 'volume_create_manager' (4e8b60ed-bfa6-4547-8fe0-dc872c1b588d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:38:37 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-014da41d-95fe-431c-a406-38eb3ac7056b tempest-CreateVolumesFromSourceVolumeTest-345054220 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d63e5afa-29f1-4f21-9d07-75fd192ff789" returned: 0 in 0.464s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:37 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-014da41d-95fe-431c-a406-38eb3ac7056b tempest-CreateVolumesFromSourceVolumeTest-345054220 None] <== create_volume: return (1129ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:38:37 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-014da41d-95fe-431c-a406-38eb3ac7056b tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:38:37 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-d8e1eb7e-3839-4361-8505-0e51073bf117 tempest-SnapshotsActionsTest-1337509060 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.6cccde1b-7334-4760-a68f-c419321d972f" returned: 0 in 0.420s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:37 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-e19eb7d5-d7d4-413a-808e-c677fda0a330 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.859s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:38:37 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-e19eb7d5-d7d4-413a-808e-c677fda0a330 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:38:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1481594871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=911a6b2c-073d-4cf9-bf39-c479b9ac27e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af63d2d3e4c84b6286873d6921cda01f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:38:34Z,use_quota=True,user_id='b6bdfddc8c894f5f9e366f2a7a69a68c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:38:37 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-e19eb7d5-d7d4-413a-808e-c677fda0a330 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Creating volume 911a6b2c-073d-4cf9-bf39-c479b9ac27e9 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:38:37 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-e19eb7d5-d7d4-413a-808e-c677fda0a330 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:38:37 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-e19eb7d5-d7d4-413a-808e-c677fda0a330 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:38:37 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-e19eb7d5-d7d4-413a-808e-c677fda0a330 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:38:37 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-e19eb7d5-d7d4-413a-808e-c677fda0a330 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:38:37 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-e19eb7d5-d7d4-413a-808e-c677fda0a330 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:38:37 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-e19eb7d5-d7d4-413a-808e-c677fda0a330 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:38:37 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-e19eb7d5-d7d4-413a-808e-c677fda0a330 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:38:37 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e19eb7d5-d7d4-413a-808e-c677fda0a330 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-911a6b2c-073d-4cf9-bf39-c479b9ac27e9 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:37 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=119, name=volume-911a6b2c-073d-4cf9-bf39-c479b9ac27e9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:38:38 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-1809d4db-4e53-40aa-aa14-f1eb57569297 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Created volume successfully. Sep 10 21:38:38 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-014da41d-95fe-431c-a406-38eb3ac7056b tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a443bca-36af-4eee-a3a7-a9e626ffa6fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d63e5afa-29f1-4f21-9d07-75fd192ff789', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:38:38 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-014da41d-95fe-431c-a406-38eb3ac7056b tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fd6a800-27e4-4e4b-ba0a-2f72006805ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:38:38 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-d8e1eb7e-3839-4361-8505-0e51073bf117 tempest-SnapshotsActionsTest-1337509060 None] Lock "cinder-quobyte-6cccde1b-7334-4760-a68f-c419321d972f" released by "_delete_snapshot" :: held 5.180s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:38:38 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e19eb7d5-d7d4-413a-808e-c677fda0a330 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-911a6b2c-073d-4cf9-bf39-c479b9ac27e9 1073741824" returned: 0 in 0.570s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:38 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e19eb7d5-d7d4-413a-808e-c677fda0a330 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-911a6b2c-073d-4cf9-bf39-c479b9ac27e9 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:38 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-d8e1eb7e-3839-4361-8505-0e51073bf117 tempest-SnapshotsActionsTest-1337509060 None] Lock "cinder-quobyte-b9e88b77-4d0d-42ab-a29e-f4c453b5123b" released by "delete_snapshot" :: held 5.360s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:38:38 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-014da41d-95fe-431c-a406-38eb3ac7056b tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Volume volume-d63e5afa-29f1-4f21-9d07-75fd192ff789 (d63e5afa-29f1-4f21-9d07-75fd192ff789): created successfully Sep 10 21:38:38 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-014da41d-95fe-431c-a406-38eb3ac7056b tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fd6a800-27e4-4e4b-ba0a-2f72006805ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:38:38 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-014da41d-95fe-431c-a406-38eb3ac7056b tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Flow 'volume_create_manager' (ff78c3fb-9341-4b85-8c4c-2c96c0b462c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:38:38 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e19eb7d5-d7d4-413a-808e-c677fda0a330 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-911a6b2c-073d-4cf9-bf39-c479b9ac27e9" returned: 0 in 0.470s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:38 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-e19eb7d5-d7d4-413a-808e-c677fda0a330 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] <== create_volume: return (1069ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:38:38 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-e19eb7d5-d7d4-413a-808e-c677fda0a330 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:38:38 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-77b5366d-4ab9-461e-b0b6-a3312477b5bd tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.714s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:38:38 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-77b5366d-4ab9-461e-b0b6-a3312477b5bd tempest-CreateVolumesFromSourceVolumeTest-345054220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:38:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1521473314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b13002a0-d4de-4718-b9ab-3cd5d1207961,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af63d2d3e4c84b6286873d6921cda01f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:38:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:38:36Z,use_quota=True,user_id='b6bdfddc8c894f5f9e366f2a7a69a68c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:38:38 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-77b5366d-4ab9-461e-b0b6-a3312477b5bd tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Creating volume b13002a0-d4de-4718-b9ab-3cd5d1207961 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:38:38 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-77b5366d-4ab9-461e-b0b6-a3312477b5bd tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:38:38 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-77b5366d-4ab9-461e-b0b6-a3312477b5bd tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:38:38 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-77b5366d-4ab9-461e-b0b6-a3312477b5bd tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:38:38 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-77b5366d-4ab9-461e-b0b6-a3312477b5bd tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:38:38 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-77b5366d-4ab9-461e-b0b6-a3312477b5bd tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:38:38 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-77b5366d-4ab9-461e-b0b6-a3312477b5bd tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:38:38 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-77b5366d-4ab9-461e-b0b6-a3312477b5bd tempest-CreateVolumesFromSourceVolumeTest-345054220 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:38:38 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-77b5366d-4ab9-461e-b0b6-a3312477b5bd tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b13002a0-d4de-4718-b9ab-3cd5d1207961 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:39 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=120, name=volume-b13002a0-d4de-4718-b9ab-3cd5d1207961, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:38:39 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-014da41d-95fe-431c-a406-38eb3ac7056b tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Created volume successfully. Sep 10 21:38:39 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-e19eb7d5-d7d4-413a-808e-c677fda0a330 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8663665a-251c-469d-a672-50c646ee532b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-911a6b2c-073d-4cf9-bf39-c479b9ac27e9', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:38:39 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-e19eb7d5-d7d4-413a-808e-c677fda0a330 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a9268f0-29e8-41fa-9b3c-984a9abe93a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:38:39 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-77b5366d-4ab9-461e-b0b6-a3312477b5bd tempest-CreateVolumesFromSourceVolumeTest-345054220 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b13002a0-d4de-4718-b9ab-3cd5d1207961 1073741824" returned: 0 in 0.585s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:39 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-77b5366d-4ab9-461e-b0b6-a3312477b5bd tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b13002a0-d4de-4718-b9ab-3cd5d1207961 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:39 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-e19eb7d5-d7d4-413a-808e-c677fda0a330 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Volume volume-911a6b2c-073d-4cf9-bf39-c479b9ac27e9 (911a6b2c-073d-4cf9-bf39-c479b9ac27e9): created successfully Sep 10 21:38:39 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-e19eb7d5-d7d4-413a-808e-c677fda0a330 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a9268f0-29e8-41fa-9b3c-984a9abe93a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:38:39 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-e19eb7d5-d7d4-413a-808e-c677fda0a330 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Flow 'volume_create_manager' (a25843f8-cdc6-433b-9713-93e5c618db7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:38:39 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-77b5366d-4ab9-461e-b0b6-a3312477b5bd tempest-CreateVolumesFromSourceVolumeTest-345054220 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b13002a0-d4de-4718-b9ab-3cd5d1207961" returned: 0 in 0.450s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:39 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-77b5366d-4ab9-461e-b0b6-a3312477b5bd tempest-CreateVolumesFromSourceVolumeTest-345054220 None] <== create_volume: return (1057ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:38:39 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-77b5366d-4ab9-461e-b0b6-a3312477b5bd tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:38:39 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-daa31f6c-6183-44b9-ac08-8cb6a86c1967 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.753s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:38:39 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-daa31f6c-6183-44b9-ac08-8cb6a86c1967 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:38:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2124551772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f4c33ee-4940-4933-875c-eba65aa0323e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af63d2d3e4c84b6286873d6921cda01f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:38:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:38:35Z,use_quota=True,user_id='b6bdfddc8c894f5f9e366f2a7a69a68c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:38:39 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-daa31f6c-6183-44b9-ac08-8cb6a86c1967 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Creating volume 5f4c33ee-4940-4933-875c-eba65aa0323e {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:38:39 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-daa31f6c-6183-44b9-ac08-8cb6a86c1967 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:38:39 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-daa31f6c-6183-44b9-ac08-8cb6a86c1967 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:38:39 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-daa31f6c-6183-44b9-ac08-8cb6a86c1967 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:38:39 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-daa31f6c-6183-44b9-ac08-8cb6a86c1967 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:38:39 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-daa31f6c-6183-44b9-ac08-8cb6a86c1967 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:38:39 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-daa31f6c-6183-44b9-ac08-8cb6a86c1967 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:38:39 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-daa31f6c-6183-44b9-ac08-8cb6a86c1967 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:38:39 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-daa31f6c-6183-44b9-ac08-8cb6a86c1967 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5f4c33ee-4940-4933-875c-eba65aa0323e 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:40 devstack quobyte-client[82807]: System call of process 99631 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:38:40 devstack quobyte-client[82807]: System call of process 99631 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:38:40 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=121, name=volume-5f4c33ee-4940-4933-875c-eba65aa0323e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:38:40 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-e19eb7d5-d7d4-413a-808e-c677fda0a330 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Created volume successfully. Sep 10 21:38:40 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-77b5366d-4ab9-461e-b0b6-a3312477b5bd tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (513b83e5-6d3d-4af1-a032-417f16204d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b13002a0-d4de-4718-b9ab-3cd5d1207961', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:38:40 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-77b5366d-4ab9-461e-b0b6-a3312477b5bd tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50a038fc-a3ac-4897-a865-588f85759829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:38:40 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-daa31f6c-6183-44b9-ac08-8cb6a86c1967 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5f4c33ee-4940-4933-875c-eba65aa0323e 1073741824" returned: 0 in 0.457s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:40 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-daa31f6c-6183-44b9-ac08-8cb6a86c1967 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5f4c33ee-4940-4933-875c-eba65aa0323e {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:40 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-d8e1eb7e-3839-4361-8505-0e51073bf117 tempest-SnapshotsActionsTest-1337509060 None] Created reservations ['86d42b1b-8ed5-4a71-b9c2-cbf4fd38fa79', 'e23148bd-4bb7-4c2a-a14c-b2eb93b745d0', '6d4fc6dc-4b0b-44c1-ba9c-b416093ea994', 'a1f7c34d-2735-4b8f-a88e-7b09bdd7e53e'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:38:40 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-77b5366d-4ab9-461e-b0b6-a3312477b5bd tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Volume volume-b13002a0-d4de-4718-b9ab-3cd5d1207961 (b13002a0-d4de-4718-b9ab-3cd5d1207961): created successfully Sep 10 21:38:40 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-77b5366d-4ab9-461e-b0b6-a3312477b5bd tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50a038fc-a3ac-4897-a865-588f85759829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:38:40 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-77b5366d-4ab9-461e-b0b6-a3312477b5bd tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Flow 'volume_create_manager' (b4bb3bdd-14e3-4188-9344-907fc288490f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:38:40 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-daa31f6c-6183-44b9-ac08-8cb6a86c1967 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5f4c33ee-4940-4933-875c-eba65aa0323e" returned: 0 in 0.479s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:40 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-daa31f6c-6183-44b9-ac08-8cb6a86c1967 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] <== create_volume: return (965ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:38:40 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-daa31f6c-6183-44b9-ac08-8cb6a86c1967 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:38:40 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-77b5366d-4ab9-461e-b0b6-a3312477b5bd tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Created volume successfully. Sep 10 21:38:40 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-daa31f6c-6183-44b9-ac08-8cb6a86c1967 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c7bd2ff-40e5-4207-ba16-0ddfba8a47ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f4c33ee-4940-4933-875c-eba65aa0323e', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:38:40 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-daa31f6c-6183-44b9-ac08-8cb6a86c1967 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8f67bcf-f7dd-4d2d-8e9f-6f35c268a720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:38:40 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-d8e1eb7e-3839-4361-8505-0e51073bf117 tempest-SnapshotsActionsTest-1337509060 None] Delete snapshot completed successfully. Sep 10 21:38:41 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-d8e1eb7e-3839-4361-8505-0e51073bf117 tempest-SnapshotsActionsTest-1337509060 None] Lock "cinder-6cccde1b-7334-4760-a68f-c419321d972f-delete_snapshot" released by "delete_snapshot" :: held 7.961s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:38:41 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-daa31f6c-6183-44b9-ac08-8cb6a86c1967 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Volume volume-5f4c33ee-4940-4933-875c-eba65aa0323e (5f4c33ee-4940-4933-875c-eba65aa0323e): created successfully Sep 10 21:38:41 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-daa31f6c-6183-44b9-ac08-8cb6a86c1967 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8f67bcf-f7dd-4d2d-8e9f-6f35c268a720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:38:41 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-daa31f6c-6183-44b9-ac08-8cb6a86c1967 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Flow 'volume_create_manager' (87757514-bb8b-4860-a9ae-3b18d7f13cfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:38:41 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-daa31f6c-6183-44b9-ac08-8cb6a86c1967 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Created volume successfully. Sep 10 21:38:41 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-a61adb88-8939-4b84-8d9c-c8d5e7fad263 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Acquiring lock "cinder-b13002a0-d4de-4718-b9ab-3cd5d1207961-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:38:41 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-a61adb88-8939-4b84-8d9c-c8d5e7fad263 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Lock "cinder-b13002a0-d4de-4718-b9ab-3cd5d1207961-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:38:41 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-a61adb88-8939-4b84-8d9c-c8d5e7fad263 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:38:41 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-a61adb88-8939-4b84-8d9c-c8d5e7fad263 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Acquiring lock "cinder-quobyte-b13002a0-d4de-4718-b9ab-3cd5d1207961" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:38:42 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-a61adb88-8939-4b84-8d9c-c8d5e7fad263 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Lock "cinder-quobyte-b13002a0-d4de-4718-b9ab-3cd5d1207961" acquired by "delete_volume" :: waited 0.015s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:38:42 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0376ff9-9ee9-41f7-aebc-70944aa7a1e7]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:38:42 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a61adb88-8939-4b84-8d9c-c8d5e7fad263 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b13002a0-d4de-4718-b9ab-3cd5d1207961 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:42 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-eb067524-db45-4d3c-b4d4-96468332237d tempest-SnapshotsActionsTest-898806204 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:38:42 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-eb067524-db45-4d3c-b4d4-96468332237d tempest-SnapshotsActionsTest-898806204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:38:42 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-eb067524-db45-4d3c-b4d4-96468332237d tempest-SnapshotsActionsTest-898806204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:38:42 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-eb067524-db45-4d3c-b4d4-96468332237d tempest-SnapshotsActionsTest-898806204 None] Creating offline snapshot 21e843b2-6d30-476a-a353-1c2c462fcb1b of volume b9e88b77-4d0d-42ab-a29e-f4c453b5123b {{(pid=82780) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 21:38:42 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a61adb88-8939-4b84-8d9c-c8d5e7fad263 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b13002a0-d4de-4718-b9ab-3cd5d1207961" returned: 0 in 0.604s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:42 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a61adb88-8939-4b84-8d9c-c8d5e7fad263 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b13002a0-d4de-4718-b9ab-3cd5d1207961 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:42 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a23d7ec-aae3-4d51-be90-ebac872e1619]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:38:42 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-eb067524-db45-4d3c-b4d4-96468332237d tempest-SnapshotsActionsTest-898806204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.fbeac7e8-7f56-40ff-8d2b-56f61fa8460b {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:42 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a61adb88-8939-4b84-8d9c-c8d5e7fad263 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b13002a0-d4de-4718-b9ab-3cd5d1207961" returned: 0 in 0.222s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:43 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-a61adb88-8939-4b84-8d9c-c8d5e7fad263 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Lock "cinder-quobyte-b13002a0-d4de-4718-b9ab-3cd5d1207961" released by "delete_volume" :: held 0.995s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:38:43 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-a61adb88-8939-4b84-8d9c-c8d5e7fad263 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Created reservations ['73fe1190-1ce8-4dd2-8096-033035bbce7a', 'f9753d0e-a08f-4efa-a08b-04539d3adc62', 'c102c404-8a87-4cc9-a4f7-d36aef82340f', 'a9f02e85-0032-41ab-8bf4-815cd3e5a39a'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:38:43 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-eb067524-db45-4d3c-b4d4-96468332237d tempest-SnapshotsActionsTest-898806204 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.fbeac7e8-7f56-40ff-8d2b-56f61fa8460b" returned: 0 in 0.592s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:43 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-eb067524-db45-4d3c-b4d4-96468332237d tempest-SnapshotsActionsTest-898806204 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82780) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 21:38:43 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-eb067524-db45-4d3c-b4d4-96468332237d tempest-SnapshotsActionsTest-898806204 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.fbeac7e8-7f56-40ff-8d2b-56f61fa8460b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.21e843b2-6d30-476a-a353-1c2c462fcb1b 1G {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:43 devstack quobyte-client[82807]: System call of process 99642 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:38:43 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=122, name=volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.21e843b2-6d30-476a-a353-1c2c462fcb1b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:38:43 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-eb067524-db45-4d3c-b4d4-96468332237d tempest-SnapshotsActionsTest-898806204 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.fbeac7e8-7f56-40ff-8d2b-56f61fa8460b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.21e843b2-6d30-476a-a353-1c2c462fcb1b 1G" returned: 0 in 0.449s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:43 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-eb067524-db45-4d3c-b4d4-96468332237d tempest-SnapshotsActionsTest-898806204 None] Running cmd (subprocess): qemu-img rebase -u -b volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.fbeac7e8-7f56-40ff-8d2b-56f61fa8460b -F qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.21e843b2-6d30-476a-a353-1c2c462fcb1b {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:44 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-eb067524-db45-4d3c-b4d4-96468332237d tempest-SnapshotsActionsTest-898806204 None] CMD "qemu-img rebase -u -b volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.fbeac7e8-7f56-40ff-8d2b-56f61fa8460b -F qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.21e843b2-6d30-476a-a353-1c2c462fcb1b" returned: 0 in 0.266s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:44 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-eb067524-db45-4d3c-b4d4-96468332237d tempest-SnapshotsActionsTest-898806204 None] File path /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.21e843b2-6d30-476a-a353-1c2c462fcb1b is being set with permissions: 660 {{(pid=82780) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 21:38:44 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-eb067524-db45-4d3c-b4d4-96468332237d tempest-SnapshotsActionsTest-898806204 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.21e843b2-6d30-476a-a353-1c2c462fcb1b {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:44 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-069ce5fc-7a86-4ff8-9794-0a23c9ebbedc tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Acquiring lock "cinder-5f4c33ee-4940-4933-875c-eba65aa0323e-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:38:44 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-eb067524-db45-4d3c-b4d4-96468332237d tempest-SnapshotsActionsTest-898806204 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.21e843b2-6d30-476a-a353-1c2c462fcb1b" returned: 0 in 0.391s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:44 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-eb067524-db45-4d3c-b4d4-96468332237d tempest-SnapshotsActionsTest-898806204 None] Setting permissions: /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.fbeac7e8-7f56-40ff-8d2b-56f61fa8460b -> 1000:1000 {{(pid=82780) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 21:38:44 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-eb067524-db45-4d3c-b4d4-96468332237d tempest-SnapshotsActionsTest-898806204 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.fbeac7e8-7f56-40ff-8d2b-56f61fa8460b /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.21e843b2-6d30-476a-a353-1c2c462fcb1b {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:44 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-069ce5fc-7a86-4ff8-9794-0a23c9ebbedc tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Lock "cinder-5f4c33ee-4940-4933-875c-eba65aa0323e-delete_volume" acquired by "delete_volume" :: waited 0.357s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:38:44 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-eb067524-db45-4d3c-b4d4-96468332237d tempest-SnapshotsActionsTest-898806204 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.fbeac7e8-7f56-40ff-8d2b-56f61fa8460b /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.21e843b2-6d30-476a-a353-1c2c462fcb1b" returned: 0 in 0.405s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:44 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-eb067524-db45-4d3c-b4d4-96468332237d tempest-SnapshotsActionsTest-898806204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.439s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:38:44 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a61adb88-8939-4b84-8d9c-c8d5e7fad263 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:38:45 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a61adb88-8939-4b84-8d9c-c8d5e7fad263 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:38:45 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a61adb88-8939-4b84-8d9c-c8d5e7fad263 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:38:45 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a61adb88-8939-4b84-8d9c-c8d5e7fad263 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:38:45 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a61adb88-8939-4b84-8d9c-c8d5e7fad263 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:38:45 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a61adb88-8939-4b84-8d9c-c8d5e7fad263 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:45 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-069ce5fc-7a86-4ff8-9794-0a23c9ebbedc tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:38:45 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-069ce5fc-7a86-4ff8-9794-0a23c9ebbedc tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Acquiring lock "cinder-quobyte-5f4c33ee-4940-4933-875c-eba65aa0323e" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:38:45 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a61adb88-8939-4b84-8d9c-c8d5e7fad263 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.453s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:45 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-a61adb88-8939-4b84-8d9c-c8d5e7fad263 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:38:45 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-eb067524-db45-4d3c-b4d4-96468332237d tempest-SnapshotsActionsTest-898806204 None] Create snapshot completed successfully Sep 10 21:38:45 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-069ce5fc-7a86-4ff8-9794-0a23c9ebbedc tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Lock "cinder-quobyte-5f4c33ee-4940-4933-875c-eba65aa0323e" acquired by "delete_volume" :: waited 0.116s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:38:45 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-a61adb88-8939-4b84-8d9c-c8d5e7fad263 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Deleted volume successfully. Sep 10 21:38:45 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f469cb36-07da-448d-9dac-be247458f346]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:38:45 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-069ce5fc-7a86-4ff8-9794-0a23c9ebbedc tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5f4c33ee-4940-4933-875c-eba65aa0323e {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:45 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-a61adb88-8939-4b84-8d9c-c8d5e7fad263 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Lock "cinder-b13002a0-d4de-4718-b9ab-3cd5d1207961-delete_volume" released by "delete_volume" :: held 3.940s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:38:46 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-069ce5fc-7a86-4ff8-9794-0a23c9ebbedc tempest-CreateVolumesFromSourceVolumeTest-345054220 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5f4c33ee-4940-4933-875c-eba65aa0323e" returned: 0 in 0.512s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:46 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-069ce5fc-7a86-4ff8-9794-0a23c9ebbedc tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5f4c33ee-4940-4933-875c-eba65aa0323e {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:46 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-069ce5fc-7a86-4ff8-9794-0a23c9ebbedc tempest-CreateVolumesFromSourceVolumeTest-345054220 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5f4c33ee-4940-4933-875c-eba65aa0323e" returned: 0 in 0.093s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:46 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-069ce5fc-7a86-4ff8-9794-0a23c9ebbedc tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Lock "cinder-quobyte-5f4c33ee-4940-4933-875c-eba65aa0323e" released by "delete_volume" :: held 0.753s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:38:46 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-069ce5fc-7a86-4ff8-9794-0a23c9ebbedc tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Created reservations ['efa1d113-34fa-423c-9762-c57cc6f23202', '300435b1-bfc1-4360-ab41-d7f10146b923', '5362aded-711f-4b83-874a-b83788d12554', '4955bceb-6425-4f0e-bf3e-0ab6735e6f11'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:38:46 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-1682f17e-68e7-4e82-bf27-a9f9025dc670 tempest-SnapshotsActionsTest-1337509060 None] Acquiring lock "cinder-21e843b2-6d30-476a-a353-1c2c462fcb1b-delete_snapshot" by "delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:38:46 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-1682f17e-68e7-4e82-bf27-a9f9025dc670 tempest-SnapshotsActionsTest-1337509060 None] Lock "cinder-21e843b2-6d30-476a-a353-1c2c462fcb1b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:38:46 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-1682f17e-68e7-4e82-bf27-a9f9025dc670 tempest-SnapshotsActionsTest-1337509060 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:38:46 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-1682f17e-68e7-4e82-bf27-a9f9025dc670 tempest-SnapshotsActionsTest-1337509060 None] Acquiring lock "cinder-quobyte-b9e88b77-4d0d-42ab-a29e-f4c453b5123b" by "delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:38:46 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-1682f17e-68e7-4e82-bf27-a9f9025dc670 tempest-SnapshotsActionsTest-1337509060 None] Lock "cinder-quobyte-b9e88b77-4d0d-42ab-a29e-f4c453b5123b" acquired by "delete_snapshot" :: waited 0.052s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:38:46 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-1682f17e-68e7-4e82-bf27-a9f9025dc670 tempest-SnapshotsActionsTest-1337509060 None] Acquiring lock "cinder-quobyte-21e843b2-6d30-476a-a353-1c2c462fcb1b" by "_delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:38:46 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-1682f17e-68e7-4e82-bf27-a9f9025dc670 tempest-SnapshotsActionsTest-1337509060 None] Lock "cinder-quobyte-21e843b2-6d30-476a-a353-1c2c462fcb1b" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:38:46 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-1682f17e-68e7-4e82-bf27-a9f9025dc670 tempest-SnapshotsActionsTest-1337509060 None] Deleting offline snapshot 21e843b2-6d30-476a-a353-1c2c462fcb1b of volume b9e88b77-4d0d-42ab-a29e-f4c453b5123b {{(pid=82780) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 21:38:46 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-1682f17e-68e7-4e82-bf27-a9f9025dc670 tempest-SnapshotsActionsTest-1337509060 None] snapshot_file for this snap is: volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.21e843b2-6d30-476a-a353-1c2c462fcb1b {{(pid=82780) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 21:38:47 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[2acc0cf8-d501-49c5-a446-29cfc888f17f]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:38:47 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1682f17e-68e7-4e82-bf27-a9f9025dc670 tempest-SnapshotsActionsTest-1337509060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.21e843b2-6d30-476a-a353-1c2c462fcb1b {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:47 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-069ce5fc-7a86-4ff8-9794-0a23c9ebbedc tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:38:47 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-069ce5fc-7a86-4ff8-9794-0a23c9ebbedc tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.030s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:38:47 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-069ce5fc-7a86-4ff8-9794-0a23c9ebbedc tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:38:47 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-069ce5fc-7a86-4ff8-9794-0a23c9ebbedc tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:38:47 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-069ce5fc-7a86-4ff8-9794-0a23c9ebbedc tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:38:47 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-069ce5fc-7a86-4ff8-9794-0a23c9ebbedc tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:47 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-069ce5fc-7a86-4ff8-9794-0a23c9ebbedc tempest-CreateVolumesFromSourceVolumeTest-345054220 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.157s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:47 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-069ce5fc-7a86-4ff8-9794-0a23c9ebbedc tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:38:47 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-069ce5fc-7a86-4ff8-9794-0a23c9ebbedc tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Deleted volume successfully. Sep 10 21:38:47 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1682f17e-68e7-4e82-bf27-a9f9025dc670 tempest-SnapshotsActionsTest-1337509060 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.21e843b2-6d30-476a-a353-1c2c462fcb1b" returned: 0 in 0.620s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:47 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-1682f17e-68e7-4e82-bf27-a9f9025dc670 tempest-SnapshotsActionsTest-1337509060 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82780) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 21:38:47 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1fe4012-df66-48d9-ad10-28d7bf992e71]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:38:47 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1682f17e-68e7-4e82-bf27-a9f9025dc670 tempest-SnapshotsActionsTest-1337509060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.fbeac7e8-7f56-40ff-8d2b-56f61fa8460b {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:47 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-069ce5fc-7a86-4ff8-9794-0a23c9ebbedc tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Lock "cinder-5f4c33ee-4940-4933-875c-eba65aa0323e-delete_volume" released by "delete_volume" :: held 3.036s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:38:48 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-a06cf410-8f63-43d8-b34b-85646867398c tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Acquiring lock "cinder-d63e5afa-29f1-4f21-9d07-75fd192ff789-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:38:48 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-a06cf410-8f63-43d8-b34b-85646867398c tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Lock "cinder-d63e5afa-29f1-4f21-9d07-75fd192ff789-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:38:48 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-a06cf410-8f63-43d8-b34b-85646867398c tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:38:48 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-a06cf410-8f63-43d8-b34b-85646867398c tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Acquiring lock "cinder-quobyte-d63e5afa-29f1-4f21-9d07-75fd192ff789" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:38:48 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1682f17e-68e7-4e82-bf27-a9f9025dc670 tempest-SnapshotsActionsTest-1337509060 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.fbeac7e8-7f56-40ff-8d2b-56f61fa8460b" returned: 0 in 0.666s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:48 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-1682f17e-68e7-4e82-bf27-a9f9025dc670 tempest-SnapshotsActionsTest-1337509060 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82780) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 21:38:48 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1682f17e-68e7-4e82-bf27-a9f9025dc670 tempest-SnapshotsActionsTest-1337509060 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.21e843b2-6d30-476a-a353-1c2c462fcb1b {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:48 devstack quobyte-client[82807]: System call of process 99665 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:38:48 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-a06cf410-8f63-43d8-b34b-85646867398c tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Lock "cinder-quobyte-d63e5afa-29f1-4f21-9d07-75fd192ff789" acquired by "delete_volume" :: waited 0.210s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:38:48 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf2f803f-a9c6-4a6f-b23b-a3f2a00eac24]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:38:48 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a06cf410-8f63-43d8-b34b-85646867398c tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d63e5afa-29f1-4f21-9d07-75fd192ff789 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:48 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1682f17e-68e7-4e82-bf27-a9f9025dc670 tempest-SnapshotsActionsTest-1337509060 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.21e843b2-6d30-476a-a353-1c2c462fcb1b" returned: 0 in 0.391s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:48 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1682f17e-68e7-4e82-bf27-a9f9025dc670 tempest-SnapshotsActionsTest-1337509060 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.21e843b2-6d30-476a-a353-1c2c462fcb1b {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:48 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1682f17e-68e7-4e82-bf27-a9f9025dc670 tempest-SnapshotsActionsTest-1337509060 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.21e843b2-6d30-476a-a353-1c2c462fcb1b" returned: 0 in 0.123s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:49 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-1682f17e-68e7-4e82-bf27-a9f9025dc670 tempest-SnapshotsActionsTest-1337509060 None] Lock "cinder-quobyte-21e843b2-6d30-476a-a353-1c2c462fcb1b" released by "_delete_snapshot" :: held 2.163s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:38:49 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-1682f17e-68e7-4e82-bf27-a9f9025dc670 tempest-SnapshotsActionsTest-1337509060 None] Lock "cinder-quobyte-b9e88b77-4d0d-42ab-a29e-f4c453b5123b" released by "delete_snapshot" :: held 2.210s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:38:49 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a06cf410-8f63-43d8-b34b-85646867398c tempest-CreateVolumesFromSourceVolumeTest-345054220 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d63e5afa-29f1-4f21-9d07-75fd192ff789" returned: 0 in 0.767s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:49 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a06cf410-8f63-43d8-b34b-85646867398c tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d63e5afa-29f1-4f21-9d07-75fd192ff789 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:49 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a06cf410-8f63-43d8-b34b-85646867398c tempest-CreateVolumesFromSourceVolumeTest-345054220 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-d63e5afa-29f1-4f21-9d07-75fd192ff789" returned: 0 in 0.258s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:49 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-a06cf410-8f63-43d8-b34b-85646867398c tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Lock "cinder-quobyte-d63e5afa-29f1-4f21-9d07-75fd192ff789" released by "delete_volume" :: held 1.208s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:38:49 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-a06cf410-8f63-43d8-b34b-85646867398c tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Created reservations ['4545b713-f30c-46c9-a070-2f52fd23c2f1', '9ec0b3de-66ec-4a7b-92d2-5ff6bf60ba99', '6995f1cf-4635-49e3-9c57-491cb69794ad', '74e1d414-5568-4bb5-b524-89553ee6d9f5'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:38:49 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-1682f17e-68e7-4e82-bf27-a9f9025dc670 tempest-SnapshotsActionsTest-1337509060 None] Created reservations ['4e121561-b846-4acf-91fb-3fb22b33d686', '085f4060-c85e-436f-89c8-903db7950fec', '529c7c78-5953-4c24-be0a-394a7388480e', '2987aa4d-7816-472e-a94c-de5d07b591d9'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:38:50 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a06cf410-8f63-43d8-b34b-85646867398c tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:38:50 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a06cf410-8f63-43d8-b34b-85646867398c tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:38:50 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a06cf410-8f63-43d8-b34b-85646867398c tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:38:50 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a06cf410-8f63-43d8-b34b-85646867398c tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:38:50 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a06cf410-8f63-43d8-b34b-85646867398c tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:38:50 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a06cf410-8f63-43d8-b34b-85646867398c tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:50 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-1682f17e-68e7-4e82-bf27-a9f9025dc670 tempest-SnapshotsActionsTest-1337509060 None] Delete snapshot completed successfully. Sep 10 21:38:50 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a06cf410-8f63-43d8-b34b-85646867398c tempest-CreateVolumesFromSourceVolumeTest-345054220 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.195s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:50 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-a06cf410-8f63-43d8-b34b-85646867398c tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:38:50 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-1682f17e-68e7-4e82-bf27-a9f9025dc670 tempest-SnapshotsActionsTest-1337509060 None] Lock "cinder-21e843b2-6d30-476a-a353-1c2c462fcb1b-delete_snapshot" released by "delete_snapshot" :: held 3.486s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:38:50 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-a06cf410-8f63-43d8-b34b-85646867398c tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Deleted volume successfully. Sep 10 21:38:50 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-11f2e749-8e63-4474-916c-7ff1413dd330 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Acquiring lock "cinder-911a6b2c-073d-4cf9-bf39-c479b9ac27e9-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:38:50 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-a06cf410-8f63-43d8-b34b-85646867398c tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Lock "cinder-d63e5afa-29f1-4f21-9d07-75fd192ff789-delete_volume" released by "delete_volume" :: held 2.436s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:38:50 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-11f2e749-8e63-4474-916c-7ff1413dd330 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Lock "cinder-911a6b2c-073d-4cf9-bf39-c479b9ac27e9-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:38:50 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-11f2e749-8e63-4474-916c-7ff1413dd330 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:38:50 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-11f2e749-8e63-4474-916c-7ff1413dd330 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Acquiring lock "cinder-quobyte-911a6b2c-073d-4cf9-bf39-c479b9ac27e9" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:38:50 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-11f2e749-8e63-4474-916c-7ff1413dd330 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Lock "cinder-quobyte-911a6b2c-073d-4cf9-bf39-c479b9ac27e9" acquired by "delete_volume" :: waited 0.016s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:38:50 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cecac0f-a897-45ec-b84c-0bd3c9fe9bf8]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:38:50 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-11f2e749-8e63-4474-916c-7ff1413dd330 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-911a6b2c-073d-4cf9-bf39-c479b9ac27e9 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:51 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-11f2e749-8e63-4474-916c-7ff1413dd330 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-911a6b2c-073d-4cf9-bf39-c479b9ac27e9" returned: 0 in 0.434s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:51 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-11f2e749-8e63-4474-916c-7ff1413dd330 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-911a6b2c-073d-4cf9-bf39-c479b9ac27e9 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:51 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-11f2e749-8e63-4474-916c-7ff1413dd330 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-911a6b2c-073d-4cf9-bf39-c479b9ac27e9" returned: 0 in 0.118s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:51 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-11f2e749-8e63-4474-916c-7ff1413dd330 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Lock "cinder-quobyte-911a6b2c-073d-4cf9-bf39-c479b9ac27e9" released by "delete_volume" :: held 0.820s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:38:51 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-11f2e749-8e63-4474-916c-7ff1413dd330 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Created reservations ['c229d167-2170-422e-ae68-020ff7eba9fd', '55993efa-bf8d-45a1-b646-71d86dcff65f', '6ca680b2-7252-4f2b-bb69-ad8296a97fbb', '13a8aedd-c969-40d1-972d-2428d28e3b5e'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:38:52 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-76c111d6-2d86-4a9f-ac25-dbff77f8b2ed tempest-SnapshotsActionsTest-898806204 None] Acquiring lock "cinder-fbeac7e8-7f56-40ff-8d2b-56f61fa8460b-delete_snapshot" by "delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:38:52 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-76c111d6-2d86-4a9f-ac25-dbff77f8b2ed tempest-SnapshotsActionsTest-898806204 None] Lock "cinder-fbeac7e8-7f56-40ff-8d2b-56f61fa8460b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:38:52 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-76c111d6-2d86-4a9f-ac25-dbff77f8b2ed tempest-SnapshotsActionsTest-898806204 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:38:52 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-76c111d6-2d86-4a9f-ac25-dbff77f8b2ed tempest-SnapshotsActionsTest-898806204 None] Acquiring lock "cinder-quobyte-b9e88b77-4d0d-42ab-a29e-f4c453b5123b" by "delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:38:52 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-11f2e749-8e63-4474-916c-7ff1413dd330 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:38:52 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-11f2e749-8e63-4474-916c-7ff1413dd330 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:38:52 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-11f2e749-8e63-4474-916c-7ff1413dd330 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:38:52 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-11f2e749-8e63-4474-916c-7ff1413dd330 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:38:52 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-11f2e749-8e63-4474-916c-7ff1413dd330 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:38:52 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-11f2e749-8e63-4474-916c-7ff1413dd330 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:52 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-76c111d6-2d86-4a9f-ac25-dbff77f8b2ed tempest-SnapshotsActionsTest-898806204 None] Lock "cinder-quobyte-b9e88b77-4d0d-42ab-a29e-f4c453b5123b" acquired by "delete_snapshot" :: waited 0.140s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:38:52 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-76c111d6-2d86-4a9f-ac25-dbff77f8b2ed tempest-SnapshotsActionsTest-898806204 None] Acquiring lock "cinder-quobyte-fbeac7e8-7f56-40ff-8d2b-56f61fa8460b" by "_delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:38:52 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-76c111d6-2d86-4a9f-ac25-dbff77f8b2ed tempest-SnapshotsActionsTest-898806204 None] Lock "cinder-quobyte-fbeac7e8-7f56-40ff-8d2b-56f61fa8460b" acquired by "_delete_snapshot" :: waited 0.081s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:38:52 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-76c111d6-2d86-4a9f-ac25-dbff77f8b2ed tempest-SnapshotsActionsTest-898806204 None] Deleting offline snapshot fbeac7e8-7f56-40ff-8d2b-56f61fa8460b of volume b9e88b77-4d0d-42ab-a29e-f4c453b5123b {{(pid=82780) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 21:38:52 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-76c111d6-2d86-4a9f-ac25-dbff77f8b2ed tempest-SnapshotsActionsTest-898806204 None] snapshot_file for this snap is: volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.fbeac7e8-7f56-40ff-8d2b-56f61fa8460b {{(pid=82780) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 21:38:52 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-11f2e749-8e63-4474-916c-7ff1413dd330 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.267s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:52 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-11f2e749-8e63-4474-916c-7ff1413dd330 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:38:52 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-11f2e749-8e63-4474-916c-7ff1413dd330 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Deleted volume successfully. Sep 10 21:38:52 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89b099e-124f-4c5c-8ef9-6631069a8619]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:38:52 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-76c111d6-2d86-4a9f-ac25-dbff77f8b2ed tempest-SnapshotsActionsTest-898806204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.fbeac7e8-7f56-40ff-8d2b-56f61fa8460b {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:53 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-35d98ca3-3712-4211-a5ce-43666047cbbc tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Acquiring lock "cinder-75db8dc4-8f54-4354-bc5a-2fb6b61d6078-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:38:53 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-11f2e749-8e63-4474-916c-7ff1413dd330 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Lock "cinder-911a6b2c-073d-4cf9-bf39-c479b9ac27e9-delete_volume" released by "delete_volume" :: held 2.513s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:38:53 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-35d98ca3-3712-4211-a5ce-43666047cbbc tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Lock "cinder-75db8dc4-8f54-4354-bc5a-2fb6b61d6078-delete_volume" acquired by "delete_volume" :: waited 0.098s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:38:53 devstack quobyte-client[82807]: System call of process 99679 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:38:53 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-76c111d6-2d86-4a9f-ac25-dbff77f8b2ed tempest-SnapshotsActionsTest-898806204 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.fbeac7e8-7f56-40ff-8d2b-56f61fa8460b" returned: 0 in 0.652s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:53 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-76c111d6-2d86-4a9f-ac25-dbff77f8b2ed tempest-SnapshotsActionsTest-898806204 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82780) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 21:38:53 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c42c3aa-811d-42b2-baa1-d80a2f39b259]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:38:53 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-76c111d6-2d86-4a9f-ac25-dbff77f8b2ed tempest-SnapshotsActionsTest-898806204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:53 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-35d98ca3-3712-4211-a5ce-43666047cbbc tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:38:53 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-35d98ca3-3712-4211-a5ce-43666047cbbc tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Acquiring lock "cinder-quobyte-75db8dc4-8f54-4354-bc5a-2fb6b61d6078" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:38:53 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-35d98ca3-3712-4211-a5ce-43666047cbbc tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Lock "cinder-quobyte-75db8dc4-8f54-4354-bc5a-2fb6b61d6078" acquired by "delete_volume" :: waited 0.074s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:38:53 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb44747-cda1-4199-86ad-7b2a44b5b831]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:38:53 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-35d98ca3-3712-4211-a5ce-43666047cbbc tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-75db8dc4-8f54-4354-bc5a-2fb6b61d6078 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:54 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-76c111d6-2d86-4a9f-ac25-dbff77f8b2ed tempest-SnapshotsActionsTest-898806204 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b" returned: 0 in 0.813s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:54 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-76c111d6-2d86-4a9f-ac25-dbff77f8b2ed tempest-SnapshotsActionsTest-898806204 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.fbeac7e8-7f56-40ff-8d2b-56f61fa8460b {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:54 devstack quobyte-client[82807]: System call of process 99688 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:38:54 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-76c111d6-2d86-4a9f-ac25-dbff77f8b2ed tempest-SnapshotsActionsTest-898806204 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.fbeac7e8-7f56-40ff-8d2b-56f61fa8460b" returned: 0 in 0.345s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:54 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-76c111d6-2d86-4a9f-ac25-dbff77f8b2ed tempest-SnapshotsActionsTest-898806204 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.fbeac7e8-7f56-40ff-8d2b-56f61fa8460b {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:54 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-35d98ca3-3712-4211-a5ce-43666047cbbc tempest-CreateVolumesFromSourceVolumeTest-345054220 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-75db8dc4-8f54-4354-bc5a-2fb6b61d6078" returned: 0 in 0.828s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:54 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-35d98ca3-3712-4211-a5ce-43666047cbbc tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-75db8dc4-8f54-4354-bc5a-2fb6b61d6078 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:54 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-76c111d6-2d86-4a9f-ac25-dbff77f8b2ed tempest-SnapshotsActionsTest-898806204 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b.fbeac7e8-7f56-40ff-8d2b-56f61fa8460b" returned: 0 in 0.207s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:55 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-76c111d6-2d86-4a9f-ac25-dbff77f8b2ed tempest-SnapshotsActionsTest-898806204 None] Lock "cinder-quobyte-fbeac7e8-7f56-40ff-8d2b-56f61fa8460b" released by "_delete_snapshot" :: held 2.628s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:38:55 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-35d98ca3-3712-4211-a5ce-43666047cbbc tempest-CreateVolumesFromSourceVolumeTest-345054220 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-75db8dc4-8f54-4354-bc5a-2fb6b61d6078" returned: 0 in 0.227s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:55 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-76c111d6-2d86-4a9f-ac25-dbff77f8b2ed tempest-SnapshotsActionsTest-898806204 None] Lock "cinder-quobyte-b9e88b77-4d0d-42ab-a29e-f4c453b5123b" released by "delete_snapshot" :: held 2.768s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:38:55 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-35d98ca3-3712-4211-a5ce-43666047cbbc tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Lock "cinder-quobyte-75db8dc4-8f54-4354-bc5a-2fb6b61d6078" released by "delete_volume" :: held 1.397s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:38:55 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-76c111d6-2d86-4a9f-ac25-dbff77f8b2ed tempest-SnapshotsActionsTest-898806204 None] Created reservations ['6d833138-3f4c-4e15-a97b-8f23a2df160c', '3c205731-28bc-40b0-87ca-00114bcd5890', 'f8014b03-1a05-4223-9e31-6b94e1b93147', '91be4196-cb42-48a0-8ed1-039aec4b31e2'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:38:55 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-35d98ca3-3712-4211-a5ce-43666047cbbc tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Created reservations ['08272f35-e945-470d-8d0e-c2e760f0ce48', '62a7d9bd-b508-4042-b816-fa6680a18483', '63694f16-6b70-4a50-8dca-30faa0d93e35', '597dd2b6-e85a-4030-a37b-b8d0145fa35c'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:38:55 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-35d98ca3-3712-4211-a5ce-43666047cbbc tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:38:55 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-35d98ca3-3712-4211-a5ce-43666047cbbc tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:38:55 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-35d98ca3-3712-4211-a5ce-43666047cbbc tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:38:55 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-35d98ca3-3712-4211-a5ce-43666047cbbc tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:38:55 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-35d98ca3-3712-4211-a5ce-43666047cbbc tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:38:55 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-35d98ca3-3712-4211-a5ce-43666047cbbc tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:55 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-35d98ca3-3712-4211-a5ce-43666047cbbc tempest-CreateVolumesFromSourceVolumeTest-345054220 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.248s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:55 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-35d98ca3-3712-4211-a5ce-43666047cbbc tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:38:55 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-35d98ca3-3712-4211-a5ce-43666047cbbc tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Deleted volume successfully. Sep 10 21:38:56 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-76c111d6-2d86-4a9f-ac25-dbff77f8b2ed tempest-SnapshotsActionsTest-898806204 None] Delete snapshot completed successfully. Sep 10 21:38:56 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-76c111d6-2d86-4a9f-ac25-dbff77f8b2ed tempest-SnapshotsActionsTest-898806204 None] Lock "cinder-fbeac7e8-7f56-40ff-8d2b-56f61fa8460b-delete_snapshot" released by "delete_snapshot" :: held 3.957s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:38:56 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-35d98ca3-3712-4211-a5ce-43666047cbbc tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Lock "cinder-75db8dc4-8f54-4354-bc5a-2fb6b61d6078-delete_volume" released by "delete_volume" :: held 3.001s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:38:56 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-b00b45e7-b51d-4ad5-bca4-a91c72420a84 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Acquiring lock "cinder-76b79227-34b8-43e2-a468-278aa6893ddb-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:38:56 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-4018ef3b-a2f8-489d-8a9a-ad8cf86876bc tempest-SnapshotsActionsTest-898806204 None] Acquiring lock "cinder-b9e88b77-4d0d-42ab-a29e-f4c453b5123b-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:38:56 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-b00b45e7-b51d-4ad5-bca4-a91c72420a84 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Lock "cinder-76b79227-34b8-43e2-a468-278aa6893ddb-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:38:56 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-4018ef3b-a2f8-489d-8a9a-ad8cf86876bc tempest-SnapshotsActionsTest-898806204 None] Lock "cinder-b9e88b77-4d0d-42ab-a29e-f4c453b5123b-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:38:56 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-b00b45e7-b51d-4ad5-bca4-a91c72420a84 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:38:56 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-b00b45e7-b51d-4ad5-bca4-a91c72420a84 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Acquiring lock "cinder-quobyte-76b79227-34b8-43e2-a468-278aa6893ddb" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:38:56 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-b00b45e7-b51d-4ad5-bca4-a91c72420a84 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Lock "cinder-quobyte-76b79227-34b8-43e2-a468-278aa6893ddb" acquired by "delete_volume" :: waited 0.024s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:38:56 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-4018ef3b-a2f8-489d-8a9a-ad8cf86876bc tempest-SnapshotsActionsTest-898806204 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:38:56 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-4018ef3b-a2f8-489d-8a9a-ad8cf86876bc tempest-SnapshotsActionsTest-898806204 None] Acquiring lock "cinder-quobyte-b9e88b77-4d0d-42ab-a29e-f4c453b5123b" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:38:56 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de448bf-efd3-45a7-93a5-554fe201937e]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:38:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b00b45e7-b51d-4ad5-bca4-a91c72420a84 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-76b79227-34b8-43e2-a468-278aa6893ddb {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:56 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-4018ef3b-a2f8-489d-8a9a-ad8cf86876bc tempest-SnapshotsActionsTest-898806204 None] Lock "cinder-quobyte-b9e88b77-4d0d-42ab-a29e-f4c453b5123b" acquired by "delete_volume" :: waited 0.219s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:38:57 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b80118-9709-40d9-883b-860db044364c]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:38:57 devstack cinder-volume[82780]: DEBUG oslo_service.periodic_task [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82780) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 21:38:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:38:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:38:57 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:38:57 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:38:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:38:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4018ef3b-a2f8-489d-8a9a-ad8cf86876bc tempest-SnapshotsActionsTest-898806204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.197s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:57 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:38:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b00b45e7-b51d-4ad5-bca4-a91c72420a84 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-76b79227-34b8-43e2-a468-278aa6893ddb" returned: 0 in 0.690s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b00b45e7-b51d-4ad5-bca4-a91c72420a84 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-76b79227-34b8-43e2-a468-278aa6893ddb {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b00b45e7-b51d-4ad5-bca4-a91c72420a84 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-76b79227-34b8-43e2-a468-278aa6893ddb" returned: 0 in 0.107s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:57 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-b00b45e7-b51d-4ad5-bca4-a91c72420a84 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Lock "cinder-quobyte-76b79227-34b8-43e2-a468-278aa6893ddb" released by "delete_volume" :: held 1.063s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:38:58 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4018ef3b-a2f8-489d-8a9a-ad8cf86876bc tempest-SnapshotsActionsTest-898806204 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b" returned: 0 in 0.860s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:58 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4018ef3b-a2f8-489d-8a9a-ad8cf86876bc tempest-SnapshotsActionsTest-898806204 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:58 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4018ef3b-a2f8-489d-8a9a-ad8cf86876bc tempest-SnapshotsActionsTest-898806204 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b9e88b77-4d0d-42ab-a29e-f4c453b5123b" returned: 0 in 0.258s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:58 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-4018ef3b-a2f8-489d-8a9a-ad8cf86876bc tempest-SnapshotsActionsTest-898806204 None] Lock "cinder-quobyte-b9e88b77-4d0d-42ab-a29e-f4c453b5123b" released by "delete_volume" :: held 1.392s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:38:58 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-b00b45e7-b51d-4ad5-bca4-a91c72420a84 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Created reservations ['c874ba2c-d43c-4b3d-9f3e-d720c8b6f832', '6675450c-ca20-49b4-a208-ba41d098269b', '90e97d1f-a340-49ff-9c98-dff77e4a0f0a', 'eac10719-d6fc-4ede-9756-bb528a2efef9'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:38:58 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-4018ef3b-a2f8-489d-8a9a-ad8cf86876bc tempest-SnapshotsActionsTest-898806204 None] Created reservations ['6edb6003-4dd1-4203-b389-bcb7293a1ede', '13e1ae90-f9d9-431e-a5ce-f0781725b5a8', '2d39ee3c-185b-4d0c-8db4-ba86d18a074e', 'f815979b-623f-4850-bb92-2320362ecd19'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:38:58 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-4018ef3b-a2f8-489d-8a9a-ad8cf86876bc tempest-SnapshotsActionsTest-898806204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:38:58 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-4018ef3b-a2f8-489d-8a9a-ad8cf86876bc tempest-SnapshotsActionsTest-898806204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:38:58 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-4018ef3b-a2f8-489d-8a9a-ad8cf86876bc tempest-SnapshotsActionsTest-898806204 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:38:58 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-4018ef3b-a2f8-489d-8a9a-ad8cf86876bc tempest-SnapshotsActionsTest-898806204 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:38:58 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-4018ef3b-a2f8-489d-8a9a-ad8cf86876bc tempest-SnapshotsActionsTest-898806204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:38:58 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4018ef3b-a2f8-489d-8a9a-ad8cf86876bc tempest-SnapshotsActionsTest-898806204 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:58 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-b00b45e7-b51d-4ad5-bca4-a91c72420a84 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:38:58 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-b00b45e7-b51d-4ad5-bca4-a91c72420a84 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.030s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:38:58 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-b00b45e7-b51d-4ad5-bca4-a91c72420a84 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:38:58 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-b00b45e7-b51d-4ad5-bca4-a91c72420a84 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:38:58 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-b00b45e7-b51d-4ad5-bca4-a91c72420a84 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:38:58 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b00b45e7-b51d-4ad5-bca4-a91c72420a84 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:38:59 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4018ef3b-a2f8-489d-8a9a-ad8cf86876bc tempest-SnapshotsActionsTest-898806204 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.541s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:59 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-4018ef3b-a2f8-489d-8a9a-ad8cf86876bc tempest-SnapshotsActionsTest-898806204 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:38:59 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-4018ef3b-a2f8-489d-8a9a-ad8cf86876bc tempest-SnapshotsActionsTest-898806204 None] Deleted volume successfully. Sep 10 21:38:59 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b00b45e7-b51d-4ad5-bca4-a91c72420a84 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.527s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:38:59 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-b00b45e7-b51d-4ad5-bca4-a91c72420a84 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:38:59 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-b00b45e7-b51d-4ad5-bca4-a91c72420a84 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Deleted volume successfully. Sep 10 21:38:59 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-4018ef3b-a2f8-489d-8a9a-ad8cf86876bc tempest-SnapshotsActionsTest-898806204 None] Lock "cinder-b9e88b77-4d0d-42ab-a29e-f4c453b5123b-delete_volume" released by "delete_volume" :: held 2.990s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:38:59 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-b00b45e7-b51d-4ad5-bca4-a91c72420a84 tempest-CreateVolumesFromSourceVolumeTest-345054220 None] Lock "cinder-76b79227-34b8-43e2-a468-278aa6893ddb-delete_volume" released by "delete_volume" :: held 3.107s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:39:03 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=79,cinder:UPDATE=101,cinder:INSERT=25,cinder:DELETE=4 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:39:03 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=78,cinder:INSERT=27,cinder:UPDATE=121,cinder:DELETE=16 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:39:03 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-9c29ece9-d063-482b-b348-e3094d7731b9 tempest-CinderUnicodeTest-1359250362 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:39:03 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c29ece9-d063-482b-b348-e3094d7731b9 tempest-CinderUnicodeTest-1359250362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:39:04 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-9c29ece9-d063-482b-b348-e3094d7731b9 tempest-CinderUnicodeTest-1359250362 None] Flow 'volume_create_manager' (f18f6c4f-00f8-4a9b-b5a8-80853bc32fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:39:04 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-9c29ece9-d063-482b-b348-e3094d7731b9 tempest-CinderUnicodeTest-1359250362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (626eb55d-b3c1-4283-aa80-22235c97ade7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:39:04 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-9c29ece9-d063-482b-b348-e3094d7731b9 tempest-CinderUnicodeTest-1359250362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (626eb55d-b3c1-4283-aa80-22235c97ade7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:39:03Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c821effb-8aab-453b-ac3f-9f34bf3dc8d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75aeb6735b5f4f2f9010044ca96f54ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:39:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:39:04Z,use_quota=True,user_id='0436378e50b64fcbaed7b58b0a453c11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:39:04 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-9c29ece9-d063-482b-b348-e3094d7731b9 tempest-CinderUnicodeTest-1359250362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14f82f45-ed9a-469d-a3de-9aa42873d085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:39:04 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-9c29ece9-d063-482b-b348-e3094d7731b9 tempest-CinderUnicodeTest-1359250362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14f82f45-ed9a-469d-a3de-9aa42873d085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:39:04 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-9c29ece9-d063-482b-b348-e3094d7731b9 tempest-CinderUnicodeTest-1359250362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f441d150-8765-4821-9b04-ff1ee99dfb57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:39:04 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-9c29ece9-d063-482b-b348-e3094d7731b9 tempest-CinderUnicodeTest-1359250362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f441d150-8765-4821-9b04-ff1ee99dfb57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c821effb-8aab-453b-ac3f-9f34bf3dc8d4', 'volume_name': 'volume-c821effb-8aab-453b-ac3f-9f34bf3dc8d4', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:39:04 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-9c29ece9-d063-482b-b348-e3094d7731b9 tempest-CinderUnicodeTest-1359250362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff9d2a17-be5d-4c10-9ecc-be1f115d02b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:39:04 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-9c29ece9-d063-482b-b348-e3094d7731b9 tempest-CinderUnicodeTest-1359250362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff9d2a17-be5d-4c10-9ecc-be1f115d02b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:39:04 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-9c29ece9-d063-482b-b348-e3094d7731b9 tempest-CinderUnicodeTest-1359250362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d498a537-0ec8-4cd7-bd07-94598fb84f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:39:04 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-9c29ece9-d063-482b-b348-e3094d7731b9 tempest-CinderUnicodeTest-1359250362 None] Volume c821effb-8aab-453b-ac3f-9f34bf3dc8d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c821effb-8aab-453b-ac3f-9f34bf3dc8d4', 'volume_size': 1} Sep 10 21:39:04 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-9c29ece9-d063-482b-b348-e3094d7731b9 tempest-CinderUnicodeTest-1359250362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:39:04 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-9c29ece9-d063-482b-b348-e3094d7731b9 tempest-CinderUnicodeTest-1359250362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:39:04 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-9c29ece9-d063-482b-b348-e3094d7731b9 tempest-CinderUnicodeTest-1359250362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:39:03Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c821effb-8aab-453b-ac3f-9f34bf3dc8d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75aeb6735b5f4f2f9010044ca96f54ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:39:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:39:04Z,use_quota=True,user_id='0436378e50b64fcbaed7b58b0a453c11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:39:04 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-9c29ece9-d063-482b-b348-e3094d7731b9 tempest-CinderUnicodeTest-1359250362 None] Creating volume c821effb-8aab-453b-ac3f-9f34bf3dc8d4 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:39:04 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-9c29ece9-d063-482b-b348-e3094d7731b9 tempest-CinderUnicodeTest-1359250362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:39:04 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-9c29ece9-d063-482b-b348-e3094d7731b9 tempest-CinderUnicodeTest-1359250362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:39:04 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-9c29ece9-d063-482b-b348-e3094d7731b9 tempest-CinderUnicodeTest-1359250362 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:39:04 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-9c29ece9-d063-482b-b348-e3094d7731b9 tempest-CinderUnicodeTest-1359250362 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:39:04 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-9c29ece9-d063-482b-b348-e3094d7731b9 tempest-CinderUnicodeTest-1359250362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:39:04 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-9c29ece9-d063-482b-b348-e3094d7731b9 tempest-CinderUnicodeTest-1359250362 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:39:04 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-9c29ece9-d063-482b-b348-e3094d7731b9 tempest-CinderUnicodeTest-1359250362 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:39:04 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9c29ece9-d063-482b-b348-e3094d7731b9 tempest-CinderUnicodeTest-1359250362 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-c821effb-8aab-453b-ac3f-9f34bf3dc8d4 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:39:04 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=123, name=volume-c821effb-8aab-453b-ac3f-9f34bf3dc8d4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:39:04 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9c29ece9-d063-482b-b348-e3094d7731b9 tempest-CinderUnicodeTest-1359250362 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-c821effb-8aab-453b-ac3f-9f34bf3dc8d4 1073741824" returned: 0 in 0.439s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:39:04 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9c29ece9-d063-482b-b348-e3094d7731b9 tempest-CinderUnicodeTest-1359250362 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-c821effb-8aab-453b-ac3f-9f34bf3dc8d4 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:39:04 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9c29ece9-d063-482b-b348-e3094d7731b9 tempest-CinderUnicodeTest-1359250362 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-c821effb-8aab-453b-ac3f-9f34bf3dc8d4" returned: 0 in 0.180s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:39:04 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-9c29ece9-d063-482b-b348-e3094d7731b9 tempest-CinderUnicodeTest-1359250362 None] <== create_volume: return (692ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:39:04 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-9c29ece9-d063-482b-b348-e3094d7731b9 tempest-CinderUnicodeTest-1359250362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:39:05 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-9c29ece9-d063-482b-b348-e3094d7731b9 tempest-CinderUnicodeTest-1359250362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d498a537-0ec8-4cd7-bd07-94598fb84f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c821effb-8aab-453b-ac3f-9f34bf3dc8d4', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:39:05 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-9c29ece9-d063-482b-b348-e3094d7731b9 tempest-CinderUnicodeTest-1359250362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82190d70-a737-4caa-bc05-cc2c61682f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:39:05 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-9c29ece9-d063-482b-b348-e3094d7731b9 tempest-CinderUnicodeTest-1359250362 None] Volume volume-c821effb-8aab-453b-ac3f-9f34bf3dc8d4 (c821effb-8aab-453b-ac3f-9f34bf3dc8d4): created successfully Sep 10 21:39:05 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-9c29ece9-d063-482b-b348-e3094d7731b9 tempest-CinderUnicodeTest-1359250362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82190d70-a737-4caa-bc05-cc2c61682f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:39:05 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-9c29ece9-d063-482b-b348-e3094d7731b9 tempest-CinderUnicodeTest-1359250362 None] Flow 'volume_create_manager' (f18f6c4f-00f8-4a9b-b5a8-80853bc32fcc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:39:05 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-9c29ece9-d063-482b-b348-e3094d7731b9 tempest-CinderUnicodeTest-1359250362 None] Created volume successfully. Sep 10 21:39:06 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-6a9e0f00-cdc4-4c70-b61d-1e2d63fc7377 tempest-CinderUnicodeTest-1359250362 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:39:06 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a9e0f00-cdc4-4c70-b61d-1e2d63fc7377 tempest-CinderUnicodeTest-1359250362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:39:06 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-6a9e0f00-cdc4-4c70-b61d-1e2d63fc7377 tempest-CinderUnicodeTest-1359250362 None] Flow 'volume_create_manager' (1004ef58-bad9-42b4-85f1-4e7a53adbaa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:39:06 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-6a9e0f00-cdc4-4c70-b61d-1e2d63fc7377 tempest-CinderUnicodeTest-1359250362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6526f8cd-bd89-49d0-9b87-8c392643372c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:39:07 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-6a9e0f00-cdc4-4c70-b61d-1e2d63fc7377 tempest-CinderUnicodeTest-1359250362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6526f8cd-bd89-49d0-9b87-8c392643372c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:39:06Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1512672796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd51b01c-f5fc-4744-a0e9-284b932ccb79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75aeb6735b5f4f2f9010044ca96f54ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:39:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:39:07Z,use_quota=True,user_id='0436378e50b64fcbaed7b58b0a453c11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:39:07 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-6a9e0f00-cdc4-4c70-b61d-1e2d63fc7377 tempest-CinderUnicodeTest-1359250362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b8bb288-25c6-4cfe-a033-4905418ffc14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:39:07 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-6a9e0f00-cdc4-4c70-b61d-1e2d63fc7377 tempest-CinderUnicodeTest-1359250362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b8bb288-25c6-4cfe-a033-4905418ffc14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:39:07 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-6a9e0f00-cdc4-4c70-b61d-1e2d63fc7377 tempest-CinderUnicodeTest-1359250362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75535ace-540a-4e10-9353-3ccad899ed47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:39:07 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-6a9e0f00-cdc4-4c70-b61d-1e2d63fc7377 tempest-CinderUnicodeTest-1359250362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75535ace-540a-4e10-9353-3ccad899ed47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd51b01c-f5fc-4744-a0e9-284b932ccb79', 'volume_name': 'volume-cd51b01c-f5fc-4744-a0e9-284b932ccb79', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:39:07 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-6a9e0f00-cdc4-4c70-b61d-1e2d63fc7377 tempest-CinderUnicodeTest-1359250362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad431745-6dd7-4e5f-b0e7-e0fd6cd9f339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:39:07 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-6a9e0f00-cdc4-4c70-b61d-1e2d63fc7377 tempest-CinderUnicodeTest-1359250362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad431745-6dd7-4e5f-b0e7-e0fd6cd9f339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:39:07 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-6a9e0f00-cdc4-4c70-b61d-1e2d63fc7377 tempest-CinderUnicodeTest-1359250362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90ba4c24-84c3-443b-9c6c-7fde5257a94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:39:07 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-6a9e0f00-cdc4-4c70-b61d-1e2d63fc7377 tempest-CinderUnicodeTest-1359250362 None] Volume cd51b01c-f5fc-4744-a0e9-284b932ccb79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd51b01c-f5fc-4744-a0e9-284b932ccb79', 'volume_size': 1} Sep 10 21:39:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-6a9e0f00-cdc4-4c70-b61d-1e2d63fc7377 tempest-CinderUnicodeTest-1359250362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:39:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-6a9e0f00-cdc4-4c70-b61d-1e2d63fc7377 tempest-CinderUnicodeTest-1359250362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:39:07 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-6a9e0f00-cdc4-4c70-b61d-1e2d63fc7377 tempest-CinderUnicodeTest-1359250362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:39:06Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1512672796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd51b01c-f5fc-4744-a0e9-284b932ccb79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75aeb6735b5f4f2f9010044ca96f54ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:39:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:39:07Z,use_quota=True,user_id='0436378e50b64fcbaed7b58b0a453c11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:39:07 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-6a9e0f00-cdc4-4c70-b61d-1e2d63fc7377 tempest-CinderUnicodeTest-1359250362 None] Creating volume cd51b01c-f5fc-4744-a0e9-284b932ccb79 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:39:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-6a9e0f00-cdc4-4c70-b61d-1e2d63fc7377 tempest-CinderUnicodeTest-1359250362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:39:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-6a9e0f00-cdc4-4c70-b61d-1e2d63fc7377 tempest-CinderUnicodeTest-1359250362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:39:07 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-6a9e0f00-cdc4-4c70-b61d-1e2d63fc7377 tempest-CinderUnicodeTest-1359250362 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:39:07 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-6a9e0f00-cdc4-4c70-b61d-1e2d63fc7377 tempest-CinderUnicodeTest-1359250362 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:39:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-6a9e0f00-cdc4-4c70-b61d-1e2d63fc7377 tempest-CinderUnicodeTest-1359250362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:39:07 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-6a9e0f00-cdc4-4c70-b61d-1e2d63fc7377 tempest-CinderUnicodeTest-1359250362 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:39:07 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-6a9e0f00-cdc4-4c70-b61d-1e2d63fc7377 tempest-CinderUnicodeTest-1359250362 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:39:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-6a9e0f00-cdc4-4c70-b61d-1e2d63fc7377 tempest-CinderUnicodeTest-1359250362 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-cd51b01c-f5fc-4744-a0e9-284b932ccb79 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:39:07 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=124, name=volume-cd51b01c-f5fc-4744-a0e9-284b932ccb79, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:39:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-6a9e0f00-cdc4-4c70-b61d-1e2d63fc7377 tempest-CinderUnicodeTest-1359250362 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-cd51b01c-f5fc-4744-a0e9-284b932ccb79 1073741824" returned: 0 in 0.413s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:39:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-6a9e0f00-cdc4-4c70-b61d-1e2d63fc7377 tempest-CinderUnicodeTest-1359250362 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-cd51b01c-f5fc-4744-a0e9-284b932ccb79 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:39:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-6a9e0f00-cdc4-4c70-b61d-1e2d63fc7377 tempest-CinderUnicodeTest-1359250362 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-cd51b01c-f5fc-4744-a0e9-284b932ccb79" returned: 0 in 0.120s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:39:07 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-6a9e0f00-cdc4-4c70-b61d-1e2d63fc7377 tempest-CinderUnicodeTest-1359250362 None] <== create_volume: return (616ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:39:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-6a9e0f00-cdc4-4c70-b61d-1e2d63fc7377 tempest-CinderUnicodeTest-1359250362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.631s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:39:07 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-6a9e0f00-cdc4-4c70-b61d-1e2d63fc7377 tempest-CinderUnicodeTest-1359250362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90ba4c24-84c3-443b-9c6c-7fde5257a94a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd51b01c-f5fc-4744-a0e9-284b932ccb79', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:39:07 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-6a9e0f00-cdc4-4c70-b61d-1e2d63fc7377 tempest-CinderUnicodeTest-1359250362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8e2db82-a521-4ba2-ba47-788225364a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:39:08 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-6a9e0f00-cdc4-4c70-b61d-1e2d63fc7377 tempest-CinderUnicodeTest-1359250362 None] Volume volume-cd51b01c-f5fc-4744-a0e9-284b932ccb79 (cd51b01c-f5fc-4744-a0e9-284b932ccb79): created successfully Sep 10 21:39:08 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-6a9e0f00-cdc4-4c70-b61d-1e2d63fc7377 tempest-CinderUnicodeTest-1359250362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8e2db82-a521-4ba2-ba47-788225364a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:39:08 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-6a9e0f00-cdc4-4c70-b61d-1e2d63fc7377 tempest-CinderUnicodeTest-1359250362 None] Flow 'volume_create_manager' (1004ef58-bad9-42b4-85f1-4e7a53adbaa7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:39:08 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-6a9e0f00-cdc4-4c70-b61d-1e2d63fc7377 tempest-CinderUnicodeTest-1359250362 None] Created volume successfully. Sep 10 21:39:09 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-f7375877-f4ae-46cf-8ec8-3d155ee92ef3 tempest-CinderUnicodeTest-1359250362 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:39:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-f7375877-f4ae-46cf-8ec8-3d155ee92ef3 tempest-CinderUnicodeTest-1359250362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:39:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-f7375877-f4ae-46cf-8ec8-3d155ee92ef3 tempest-CinderUnicodeTest-1359250362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:39:09 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-f7375877-f4ae-46cf-8ec8-3d155ee92ef3 tempest-CinderUnicodeTest-1359250362 None] Creating offline snapshot ef543b0c-c4cf-45a8-b7dd-1791f8f0d1a2 of volume cd51b01c-f5fc-4744-a0e9-284b932ccb79 {{(pid=82780) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 21:39:09 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce34ba8-095a-4684-9cb4-44a0a8739742]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:39:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f7375877-f4ae-46cf-8ec8-3d155ee92ef3 tempest-CinderUnicodeTest-1359250362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-cd51b01c-f5fc-4744-a0e9-284b932ccb79 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:39:09 devstack quobyte-client[82807]: System call of process 99756 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:39:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f7375877-f4ae-46cf-8ec8-3d155ee92ef3 tempest-CinderUnicodeTest-1359250362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-cd51b01c-f5fc-4744-a0e9-284b932ccb79" returned: 0 in 0.519s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:39:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f7375877-f4ae-46cf-8ec8-3d155ee92ef3 tempest-CinderUnicodeTest-1359250362 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-cd51b01c-f5fc-4744-a0e9-284b932ccb79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-cd51b01c-f5fc-4744-a0e9-284b932ccb79.ef543b0c-c4cf-45a8-b7dd-1791f8f0d1a2 1G {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:39:10 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=125, name=volume-cd51b01c-f5fc-4744-a0e9-284b932ccb79.ef543b0c-c4cf-45a8-b7dd-1791f8f0d1a2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:39:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f7375877-f4ae-46cf-8ec8-3d155ee92ef3 tempest-CinderUnicodeTest-1359250362 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-cd51b01c-f5fc-4744-a0e9-284b932ccb79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-cd51b01c-f5fc-4744-a0e9-284b932ccb79.ef543b0c-c4cf-45a8-b7dd-1791f8f0d1a2 1G" returned: 0 in 0.289s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:39:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f7375877-f4ae-46cf-8ec8-3d155ee92ef3 tempest-CinderUnicodeTest-1359250362 None] Running cmd (subprocess): qemu-img rebase -u -b volume-cd51b01c-f5fc-4744-a0e9-284b932ccb79 -F qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-cd51b01c-f5fc-4744-a0e9-284b932ccb79.ef543b0c-c4cf-45a8-b7dd-1791f8f0d1a2 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:39:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f7375877-f4ae-46cf-8ec8-3d155ee92ef3 tempest-CinderUnicodeTest-1359250362 None] CMD "qemu-img rebase -u -b volume-cd51b01c-f5fc-4744-a0e9-284b932ccb79 -F qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-cd51b01c-f5fc-4744-a0e9-284b932ccb79.ef543b0c-c4cf-45a8-b7dd-1791f8f0d1a2" returned: 0 in 0.221s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:39:10 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-f7375877-f4ae-46cf-8ec8-3d155ee92ef3 tempest-CinderUnicodeTest-1359250362 None] File path /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-cd51b01c-f5fc-4744-a0e9-284b932ccb79.ef543b0c-c4cf-45a8-b7dd-1791f8f0d1a2 is being set with permissions: 660 {{(pid=82780) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 21:39:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f7375877-f4ae-46cf-8ec8-3d155ee92ef3 tempest-CinderUnicodeTest-1359250362 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-cd51b01c-f5fc-4744-a0e9-284b932ccb79.ef543b0c-c4cf-45a8-b7dd-1791f8f0d1a2 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:39:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f7375877-f4ae-46cf-8ec8-3d155ee92ef3 tempest-CinderUnicodeTest-1359250362 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-cd51b01c-f5fc-4744-a0e9-284b932ccb79.ef543b0c-c4cf-45a8-b7dd-1791f8f0d1a2" returned: 0 in 0.129s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:39:10 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-f7375877-f4ae-46cf-8ec8-3d155ee92ef3 tempest-CinderUnicodeTest-1359250362 None] Setting permissions: /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-cd51b01c-f5fc-4744-a0e9-284b932ccb79 -> 1000:1000 {{(pid=82780) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 21:39:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f7375877-f4ae-46cf-8ec8-3d155ee92ef3 tempest-CinderUnicodeTest-1359250362 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-cd51b01c-f5fc-4744-a0e9-284b932ccb79 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-cd51b01c-f5fc-4744-a0e9-284b932ccb79.ef543b0c-c4cf-45a8-b7dd-1791f8f0d1a2 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:39:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f7375877-f4ae-46cf-8ec8-3d155ee92ef3 tempest-CinderUnicodeTest-1359250362 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-cd51b01c-f5fc-4744-a0e9-284b932ccb79 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-cd51b01c-f5fc-4744-a0e9-284b932ccb79.ef543b0c-c4cf-45a8-b7dd-1791f8f0d1a2" returned: 0 in 0.118s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:39:11 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f7375877-f4ae-46cf-8ec8-3d155ee92ef3 tempest-CinderUnicodeTest-1359250362 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-cd51b01c-f5fc-4744-a0e9-284b932ccb79.info {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:39:11 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f7375877-f4ae-46cf-8ec8-3d155ee92ef3 tempest-CinderUnicodeTest-1359250362 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-cd51b01c-f5fc-4744-a0e9-284b932ccb79.info" returned: 0 in 0.116s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:39:11 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-f7375877-f4ae-46cf-8ec8-3d155ee92ef3 tempest-CinderUnicodeTest-1359250362 None] File path /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-cd51b01c-f5fc-4744-a0e9-284b932ccb79.info is being set with permissions: 660 {{(pid=82780) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 21:39:11 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f7375877-f4ae-46cf-8ec8-3d155ee92ef3 tempest-CinderUnicodeTest-1359250362 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-cd51b01c-f5fc-4744-a0e9-284b932ccb79.info {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:39:11 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f7375877-f4ae-46cf-8ec8-3d155ee92ef3 tempest-CinderUnicodeTest-1359250362 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-cd51b01c-f5fc-4744-a0e9-284b932ccb79.info" returned: 0 in 0.131s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:39:11 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-f7375877-f4ae-46cf-8ec8-3d155ee92ef3 tempest-CinderUnicodeTest-1359250362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.953s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:39:11 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-f7375877-f4ae-46cf-8ec8-3d155ee92ef3 tempest-CinderUnicodeTest-1359250362 None] Create snapshot completed successfully Sep 10 21:39:12 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-6b669091-7369-4e42-8be4-f60a2984d30c tempest-CinderUnicodeTest-1359250362 None] Acquiring lock "cinder-ef543b0c-c4cf-45a8-b7dd-1791f8f0d1a2-delete_snapshot" by "delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:39:12 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-6b669091-7369-4e42-8be4-f60a2984d30c tempest-CinderUnicodeTest-1359250362 None] Lock "cinder-ef543b0c-c4cf-45a8-b7dd-1791f8f0d1a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.072s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:39:12 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-6b669091-7369-4e42-8be4-f60a2984d30c tempest-CinderUnicodeTest-1359250362 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:39:12 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-6b669091-7369-4e42-8be4-f60a2984d30c tempest-CinderUnicodeTest-1359250362 None] Acquiring lock "cinder-quobyte-cd51b01c-f5fc-4744-a0e9-284b932ccb79" by "delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:39:12 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-6b669091-7369-4e42-8be4-f60a2984d30c tempest-CinderUnicodeTest-1359250362 None] Lock "cinder-quobyte-cd51b01c-f5fc-4744-a0e9-284b932ccb79" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:39:12 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-6b669091-7369-4e42-8be4-f60a2984d30c tempest-CinderUnicodeTest-1359250362 None] Acquiring lock "cinder-quobyte-ef543b0c-c4cf-45a8-b7dd-1791f8f0d1a2" by "_delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:39:12 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-6b669091-7369-4e42-8be4-f60a2984d30c tempest-CinderUnicodeTest-1359250362 None] Lock "cinder-quobyte-ef543b0c-c4cf-45a8-b7dd-1791f8f0d1a2" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:39:12 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-6b669091-7369-4e42-8be4-f60a2984d30c tempest-CinderUnicodeTest-1359250362 None] Deleting offline snapshot ef543b0c-c4cf-45a8-b7dd-1791f8f0d1a2 of volume cd51b01c-f5fc-4744-a0e9-284b932ccb79 {{(pid=82780) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 21:39:12 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-6b669091-7369-4e42-8be4-f60a2984d30c tempest-CinderUnicodeTest-1359250362 None] snapshot_file for this snap is: volume-cd51b01c-f5fc-4744-a0e9-284b932ccb79.ef543b0c-c4cf-45a8-b7dd-1791f8f0d1a2 {{(pid=82780) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 21:39:12 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9b6f13-dd48-4178-bf1a-f2f82f2a390f]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:39:12 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-6b669091-7369-4e42-8be4-f60a2984d30c tempest-CinderUnicodeTest-1359250362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-cd51b01c-f5fc-4744-a0e9-284b932ccb79.ef543b0c-c4cf-45a8-b7dd-1791f8f0d1a2 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:39:13 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-6b669091-7369-4e42-8be4-f60a2984d30c tempest-CinderUnicodeTest-1359250362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-cd51b01c-f5fc-4744-a0e9-284b932ccb79.ef543b0c-c4cf-45a8-b7dd-1791f8f0d1a2" returned: 0 in 0.500s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:39:13 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-6b669091-7369-4e42-8be4-f60a2984d30c tempest-CinderUnicodeTest-1359250362 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd51b01c-f5fc-4744-a0e9-284b932ccb79(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82780) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 21:39:13 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[64760fd0-996e-4f6b-b497-9e487059dafb]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:39:13 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-6b669091-7369-4e42-8be4-f60a2984d30c tempest-CinderUnicodeTest-1359250362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-cd51b01c-f5fc-4744-a0e9-284b932ccb79 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:39:13 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-6b669091-7369-4e42-8be4-f60a2984d30c tempest-CinderUnicodeTest-1359250362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-cd51b01c-f5fc-4744-a0e9-284b932ccb79" returned: 0 in 0.530s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:39:13 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-6b669091-7369-4e42-8be4-f60a2984d30c tempest-CinderUnicodeTest-1359250362 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-cd51b01c-f5fc-4744-a0e9-284b932ccb79.ef543b0c-c4cf-45a8-b7dd-1791f8f0d1a2 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:39:14 devstack quobyte-client[82807]: System call of process 99775 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:39:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-6b669091-7369-4e42-8be4-f60a2984d30c tempest-CinderUnicodeTest-1359250362 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-cd51b01c-f5fc-4744-a0e9-284b932ccb79.ef543b0c-c4cf-45a8-b7dd-1791f8f0d1a2" returned: 0 in 0.311s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:39:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-6b669091-7369-4e42-8be4-f60a2984d30c tempest-CinderUnicodeTest-1359250362 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-cd51b01c-f5fc-4744-a0e9-284b932ccb79.ef543b0c-c4cf-45a8-b7dd-1791f8f0d1a2 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:39:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-6b669091-7369-4e42-8be4-f60a2984d30c tempest-CinderUnicodeTest-1359250362 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-cd51b01c-f5fc-4744-a0e9-284b932ccb79.ef543b0c-c4cf-45a8-b7dd-1791f8f0d1a2" returned: 0 in 0.196s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:39:14 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-6b669091-7369-4e42-8be4-f60a2984d30c tempest-CinderUnicodeTest-1359250362 None] Lock "cinder-quobyte-ef543b0c-c4cf-45a8-b7dd-1791f8f0d1a2" released by "_delete_snapshot" :: held 1.854s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:39:14 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-6b669091-7369-4e42-8be4-f60a2984d30c tempest-CinderUnicodeTest-1359250362 None] Lock "cinder-quobyte-cd51b01c-f5fc-4744-a0e9-284b932ccb79" released by "delete_snapshot" :: held 1.883s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:39:15 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-6b669091-7369-4e42-8be4-f60a2984d30c tempest-CinderUnicodeTest-1359250362 None] Created reservations ['aa3f1cf2-4d9f-44c1-84c1-e364cdf76719', 'c6a28812-ec74-4d16-bd1b-6be4f16701c6', '14e6fffa-ab4c-48d3-b4bf-18e83cb868a3', 'f3b927ff-4d43-4f11-a056-686864e147a4'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:39:15 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-6b669091-7369-4e42-8be4-f60a2984d30c tempest-CinderUnicodeTest-1359250362 None] Delete snapshot completed successfully. Sep 10 21:39:15 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-6b669091-7369-4e42-8be4-f60a2984d30c tempest-CinderUnicodeTest-1359250362 None] Lock "cinder-ef543b0c-c4cf-45a8-b7dd-1791f8f0d1a2-delete_snapshot" released by "delete_snapshot" :: held 2.513s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:39:15 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-600bd1e8-4928-4b05-910a-72731eeeb0c9 tempest-CinderUnicodeTest-1359250362 None] Acquiring lock "cinder-cd51b01c-f5fc-4744-a0e9-284b932ccb79-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:39:16 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-600bd1e8-4928-4b05-910a-72731eeeb0c9 tempest-CinderUnicodeTest-1359250362 None] Lock "cinder-cd51b01c-f5fc-4744-a0e9-284b932ccb79-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:39:16 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-600bd1e8-4928-4b05-910a-72731eeeb0c9 tempest-CinderUnicodeTest-1359250362 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:39:16 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-600bd1e8-4928-4b05-910a-72731eeeb0c9 tempest-CinderUnicodeTest-1359250362 None] Acquiring lock "cinder-quobyte-cd51b01c-f5fc-4744-a0e9-284b932ccb79" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:39:16 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-600bd1e8-4928-4b05-910a-72731eeeb0c9 tempest-CinderUnicodeTest-1359250362 None] Lock "cinder-quobyte-cd51b01c-f5fc-4744-a0e9-284b932ccb79" acquired by "delete_volume" :: waited 0.015s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:39:16 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b559a404-edd0-4435-b082-f1457879c451]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:39:16 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-600bd1e8-4928-4b05-910a-72731eeeb0c9 tempest-CinderUnicodeTest-1359250362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-cd51b01c-f5fc-4744-a0e9-284b932ccb79 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:39:16 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-600bd1e8-4928-4b05-910a-72731eeeb0c9 tempest-CinderUnicodeTest-1359250362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-cd51b01c-f5fc-4744-a0e9-284b932ccb79" returned: 0 in 0.473s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:39:16 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-600bd1e8-4928-4b05-910a-72731eeeb0c9 tempest-CinderUnicodeTest-1359250362 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-cd51b01c-f5fc-4744-a0e9-284b932ccb79 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:39:16 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-600bd1e8-4928-4b05-910a-72731eeeb0c9 tempest-CinderUnicodeTest-1359250362 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-cd51b01c-f5fc-4744-a0e9-284b932ccb79" returned: 0 in 0.118s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:39:16 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-600bd1e8-4928-4b05-910a-72731eeeb0c9 tempest-CinderUnicodeTest-1359250362 None] Lock "cinder-quobyte-cd51b01c-f5fc-4744-a0e9-284b932ccb79" released by "delete_volume" :: held 0.792s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:39:17 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-600bd1e8-4928-4b05-910a-72731eeeb0c9 tempest-CinderUnicodeTest-1359250362 None] Created reservations ['5e9bd258-2ef5-40d3-8918-e88d2d673931', '63b7c0b9-abf9-4a1b-acf9-29a5c3c36a47', '70c0cb95-37cc-4bf9-916a-8a965f82b132', 'fbd56bb2-87da-4957-ad64-315401fb5e24'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:39:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-600bd1e8-4928-4b05-910a-72731eeeb0c9 tempest-CinderUnicodeTest-1359250362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:39:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-600bd1e8-4928-4b05-910a-72731eeeb0c9 tempest-CinderUnicodeTest-1359250362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:39:17 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-600bd1e8-4928-4b05-910a-72731eeeb0c9 tempest-CinderUnicodeTest-1359250362 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:39:17 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-600bd1e8-4928-4b05-910a-72731eeeb0c9 tempest-CinderUnicodeTest-1359250362 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:39:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-600bd1e8-4928-4b05-910a-72731eeeb0c9 tempest-CinderUnicodeTest-1359250362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:39:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-600bd1e8-4928-4b05-910a-72731eeeb0c9 tempest-CinderUnicodeTest-1359250362 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:39:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-600bd1e8-4928-4b05-910a-72731eeeb0c9 tempest-CinderUnicodeTest-1359250362 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.100s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:39:17 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-600bd1e8-4928-4b05-910a-72731eeeb0c9 tempest-CinderUnicodeTest-1359250362 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:39:17 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-600bd1e8-4928-4b05-910a-72731eeeb0c9 tempest-CinderUnicodeTest-1359250362 None] Deleted volume successfully. Sep 10 21:39:17 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-600bd1e8-4928-4b05-910a-72731eeeb0c9 tempest-CinderUnicodeTest-1359250362 None] Lock "cinder-cd51b01c-f5fc-4744-a0e9-284b932ccb79-delete_volume" released by "delete_volume" :: held 1.938s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:39:18 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-1492a188-c16e-45f2-836e-0e49adada28d tempest-CinderUnicodeTest-1359250362 None] Acquiring lock "cinder-c821effb-8aab-453b-ac3f-9f34bf3dc8d4-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:39:18 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-1492a188-c16e-45f2-836e-0e49adada28d tempest-CinderUnicodeTest-1359250362 None] Lock "cinder-c821effb-8aab-453b-ac3f-9f34bf3dc8d4-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:39:18 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-1492a188-c16e-45f2-836e-0e49adada28d tempest-CinderUnicodeTest-1359250362 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:39:18 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-1492a188-c16e-45f2-836e-0e49adada28d tempest-CinderUnicodeTest-1359250362 None] Acquiring lock "cinder-quobyte-c821effb-8aab-453b-ac3f-9f34bf3dc8d4" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:39:18 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-1492a188-c16e-45f2-836e-0e49adada28d tempest-CinderUnicodeTest-1359250362 None] Lock "cinder-quobyte-c821effb-8aab-453b-ac3f-9f34bf3dc8d4" acquired by "delete_volume" :: waited 0.012s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:39:18 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c46c41-cb24-408f-a259-c8f4667ff8e9]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:39:18 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1492a188-c16e-45f2-836e-0e49adada28d tempest-CinderUnicodeTest-1359250362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-c821effb-8aab-453b-ac3f-9f34bf3dc8d4 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:39:19 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1492a188-c16e-45f2-836e-0e49adada28d tempest-CinderUnicodeTest-1359250362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-c821effb-8aab-453b-ac3f-9f34bf3dc8d4" returned: 0 in 0.532s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:39:19 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1492a188-c16e-45f2-836e-0e49adada28d tempest-CinderUnicodeTest-1359250362 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-c821effb-8aab-453b-ac3f-9f34bf3dc8d4 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:39:19 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1492a188-c16e-45f2-836e-0e49adada28d tempest-CinderUnicodeTest-1359250362 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-c821effb-8aab-453b-ac3f-9f34bf3dc8d4" returned: 0 in 0.113s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:39:19 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-1492a188-c16e-45f2-836e-0e49adada28d tempest-CinderUnicodeTest-1359250362 None] Lock "cinder-quobyte-c821effb-8aab-453b-ac3f-9f34bf3dc8d4" released by "delete_volume" :: held 0.813s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:39:19 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-1492a188-c16e-45f2-836e-0e49adada28d tempest-CinderUnicodeTest-1359250362 None] Created reservations ['8cc2713d-0dca-42c6-b812-d7d54ea96e0e', 'a0b1d92b-6eff-4368-9d55-13956167741c', '2fb6b667-e1ec-4b9f-9b0a-3e7bdb40567d', '8ba4c777-2ebd-4504-9527-5c093696b492'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:39:19 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-1492a188-c16e-45f2-836e-0e49adada28d tempest-CinderUnicodeTest-1359250362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:39:19 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-1492a188-c16e-45f2-836e-0e49adada28d tempest-CinderUnicodeTest-1359250362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:39:19 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-1492a188-c16e-45f2-836e-0e49adada28d tempest-CinderUnicodeTest-1359250362 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:39:20 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-1492a188-c16e-45f2-836e-0e49adada28d tempest-CinderUnicodeTest-1359250362 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:39:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-1492a188-c16e-45f2-836e-0e49adada28d tempest-CinderUnicodeTest-1359250362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:39:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1492a188-c16e-45f2-836e-0e49adada28d tempest-CinderUnicodeTest-1359250362 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:39:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1492a188-c16e-45f2-836e-0e49adada28d tempest-CinderUnicodeTest-1359250362 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.117s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:39:20 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-1492a188-c16e-45f2-836e-0e49adada28d tempest-CinderUnicodeTest-1359250362 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:39:20 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-1492a188-c16e-45f2-836e-0e49adada28d tempest-CinderUnicodeTest-1359250362 None] Deleted volume successfully. Sep 10 21:39:20 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-1492a188-c16e-45f2-836e-0e49adada28d tempest-CinderUnicodeTest-1359250362 None] Lock "cinder-c821effb-8aab-453b-ac3f-9f34bf3dc8d4-delete_volume" released by "delete_volume" :: held 2.019s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:39:29 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:UPDATE=27,cinder:SELECT=20,cinder:DELETE=1,cinder:INSERT=5 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:39:30 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=15,cinder:UPDATE=25,cinder:DELETE=4,cinder:INSERT=7 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:39:56 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-002d9814-6e16-46b1-9038-7491d9bc9995 tempest-SnapshotDependencyTests-1197874144 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:39:56 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-002d9814-6e16-46b1-9038-7491d9bc9995 tempest-SnapshotDependencyTests-1197874144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:39:56 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-002d9814-6e16-46b1-9038-7491d9bc9995 tempest-SnapshotDependencyTests-1197874144 None] Flow 'volume_create_manager' (a3e497ad-81d2-4e5b-a2b8-a806b8f3d588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:39:56 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-002d9814-6e16-46b1-9038-7491d9bc9995 tempest-SnapshotDependencyTests-1197874144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7de065f-1277-449f-b76f-109d5cfc48c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:39:56 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-002d9814-6e16-46b1-9038-7491d9bc9995 tempest-SnapshotDependencyTests-1197874144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7de065f-1277-449f-b76f-109d5cfc48c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:39:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1754862608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a5753bb-449a-4782-b29b-61e0b56e8a04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fb96f9de67e4d7784097288ca26b4d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:39:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:39:56Z,use_quota=True,user_id='d118dec05001475780c35fe9d011b491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:39:56 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-002d9814-6e16-46b1-9038-7491d9bc9995 tempest-SnapshotDependencyTests-1197874144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94cd1691-952a-4a08-8a36-805170b06a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:39:56 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-002d9814-6e16-46b1-9038-7491d9bc9995 tempest-SnapshotDependencyTests-1197874144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94cd1691-952a-4a08-8a36-805170b06a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:39:56 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-002d9814-6e16-46b1-9038-7491d9bc9995 tempest-SnapshotDependencyTests-1197874144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f863604-6824-4c38-8fcc-5fb56e3a4df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:39:56 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-002d9814-6e16-46b1-9038-7491d9bc9995 tempest-SnapshotDependencyTests-1197874144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f863604-6824-4c38-8fcc-5fb56e3a4df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a5753bb-449a-4782-b29b-61e0b56e8a04', 'volume_name': 'volume-3a5753bb-449a-4782-b29b-61e0b56e8a04', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:39:56 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-002d9814-6e16-46b1-9038-7491d9bc9995 tempest-SnapshotDependencyTests-1197874144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1e71871-bb29-4b54-97ba-0e51eaebc539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:39:56 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-002d9814-6e16-46b1-9038-7491d9bc9995 tempest-SnapshotDependencyTests-1197874144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1e71871-bb29-4b54-97ba-0e51eaebc539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:39:56 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-002d9814-6e16-46b1-9038-7491d9bc9995 tempest-SnapshotDependencyTests-1197874144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80dd679c-958c-4f1b-9953-f12a10a53238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:39:56 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-002d9814-6e16-46b1-9038-7491d9bc9995 tempest-SnapshotDependencyTests-1197874144 None] Volume 3a5753bb-449a-4782-b29b-61e0b56e8a04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a5753bb-449a-4782-b29b-61e0b56e8a04', 'volume_size': 1} Sep 10 21:39:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-002d9814-6e16-46b1-9038-7491d9bc9995 tempest-SnapshotDependencyTests-1197874144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:39:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-002d9814-6e16-46b1-9038-7491d9bc9995 tempest-SnapshotDependencyTests-1197874144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:39:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-002d9814-6e16-46b1-9038-7491d9bc9995 tempest-SnapshotDependencyTests-1197874144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:39:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1754862608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a5753bb-449a-4782-b29b-61e0b56e8a04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fb96f9de67e4d7784097288ca26b4d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:39:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:39:56Z,use_quota=True,user_id='d118dec05001475780c35fe9d011b491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:39:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-002d9814-6e16-46b1-9038-7491d9bc9995 tempest-SnapshotDependencyTests-1197874144 None] Creating volume 3a5753bb-449a-4782-b29b-61e0b56e8a04 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:39:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-002d9814-6e16-46b1-9038-7491d9bc9995 tempest-SnapshotDependencyTests-1197874144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:39:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-002d9814-6e16-46b1-9038-7491d9bc9995 tempest-SnapshotDependencyTests-1197874144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:39:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-002d9814-6e16-46b1-9038-7491d9bc9995 tempest-SnapshotDependencyTests-1197874144 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:39:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-002d9814-6e16-46b1-9038-7491d9bc9995 tempest-SnapshotDependencyTests-1197874144 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:39:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-002d9814-6e16-46b1-9038-7491d9bc9995 tempest-SnapshotDependencyTests-1197874144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:39:56 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-002d9814-6e16-46b1-9038-7491d9bc9995 tempest-SnapshotDependencyTests-1197874144 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:39:56 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-002d9814-6e16-46b1-9038-7491d9bc9995 tempest-SnapshotDependencyTests-1197874144 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:39:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-002d9814-6e16-46b1-9038-7491d9bc9995 tempest-SnapshotDependencyTests-1197874144 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a5753bb-449a-4782-b29b-61e0b56e8a04 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:39:57 devstack cinder-volume[82780]: DEBUG oslo_service.periodic_task [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82780) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 21:39:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:39:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:39:57 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:39:57 devstack quobyte-client[82807]: System call of process 99797 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:39:57 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:39:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:39:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:39:57 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=127, name=volume-3a5753bb-449a-4782-b29b-61e0b56e8a04, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:39:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.193s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:39:57 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:39:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-002d9814-6e16-46b1-9038-7491d9bc9995 tempest-SnapshotDependencyTests-1197874144 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a5753bb-449a-4782-b29b-61e0b56e8a04 1073741824" returned: 0 in 0.783s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:39:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-002d9814-6e16-46b1-9038-7491d9bc9995 tempest-SnapshotDependencyTests-1197874144 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a5753bb-449a-4782-b29b-61e0b56e8a04 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:39:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-002d9814-6e16-46b1-9038-7491d9bc9995 tempest-SnapshotDependencyTests-1197874144 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a5753bb-449a-4782-b29b-61e0b56e8a04" returned: 0 in 0.127s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:39:57 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-002d9814-6e16-46b1-9038-7491d9bc9995 tempest-SnapshotDependencyTests-1197874144 None] <== create_volume: return (1014ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:39:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-002d9814-6e16-46b1-9038-7491d9bc9995 tempest-SnapshotDependencyTests-1197874144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:39:58 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-002d9814-6e16-46b1-9038-7491d9bc9995 tempest-SnapshotDependencyTests-1197874144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80dd679c-958c-4f1b-9953-f12a10a53238) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a5753bb-449a-4782-b29b-61e0b56e8a04', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:39:58 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-002d9814-6e16-46b1-9038-7491d9bc9995 tempest-SnapshotDependencyTests-1197874144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24778cac-a9a6-47ef-8cf3-ea9b049dba3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:39:58 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-002d9814-6e16-46b1-9038-7491d9bc9995 tempest-SnapshotDependencyTests-1197874144 None] Volume volume-3a5753bb-449a-4782-b29b-61e0b56e8a04 (3a5753bb-449a-4782-b29b-61e0b56e8a04): created successfully Sep 10 21:39:58 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-002d9814-6e16-46b1-9038-7491d9bc9995 tempest-SnapshotDependencyTests-1197874144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24778cac-a9a6-47ef-8cf3-ea9b049dba3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:39:58 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-002d9814-6e16-46b1-9038-7491d9bc9995 tempest-SnapshotDependencyTests-1197874144 None] Flow 'volume_create_manager' (a3e497ad-81d2-4e5b-a2b8-a806b8f3d588) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:39:58 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-002d9814-6e16-46b1-9038-7491d9bc9995 tempest-SnapshotDependencyTests-1197874144 None] Created volume successfully. Sep 10 21:39:59 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-5c94494b-43a7-4420-9409-15d04b69fa13 tempest-SnapshotDependencyTests-1197874144 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:39:59 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-5c94494b-43a7-4420-9409-15d04b69fa13 tempest-SnapshotDependencyTests-1197874144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:39:59 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-5c94494b-43a7-4420-9409-15d04b69fa13 tempest-SnapshotDependencyTests-1197874144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:39:59 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-5c94494b-43a7-4420-9409-15d04b69fa13 tempest-SnapshotDependencyTests-1197874144 None] Creating offline snapshot 62f77114-7e4c-457c-ad69-40dd2ff8ba82 of volume 3a5753bb-449a-4782-b29b-61e0b56e8a04 {{(pid=82780) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 21:39:59 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b36c517-4c03-4c4c-8caa-ab057763644d]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:39:59 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-5c94494b-43a7-4420-9409-15d04b69fa13 tempest-SnapshotDependencyTests-1197874144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a5753bb-449a-4782-b29b-61e0b56e8a04 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:40:00 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-5c94494b-43a7-4420-9409-15d04b69fa13 tempest-SnapshotDependencyTests-1197874144 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a5753bb-449a-4782-b29b-61e0b56e8a04" returned: 0 in 0.757s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:40:00 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-5c94494b-43a7-4420-9409-15d04b69fa13 tempest-SnapshotDependencyTests-1197874144 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a5753bb-449a-4782-b29b-61e0b56e8a04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a5753bb-449a-4782-b29b-61e0b56e8a04.62f77114-7e4c-457c-ad69-40dd2ff8ba82 1G {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:40:00 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=128, name=volume-3a5753bb-449a-4782-b29b-61e0b56e8a04.62f77114-7e4c-457c-ad69-40dd2ff8ba82, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:40:00 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-5c94494b-43a7-4420-9409-15d04b69fa13 tempest-SnapshotDependencyTests-1197874144 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a5753bb-449a-4782-b29b-61e0b56e8a04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a5753bb-449a-4782-b29b-61e0b56e8a04.62f77114-7e4c-457c-ad69-40dd2ff8ba82 1G" returned: 0 in 0.431s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:40:00 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-5c94494b-43a7-4420-9409-15d04b69fa13 tempest-SnapshotDependencyTests-1197874144 None] Running cmd (subprocess): qemu-img rebase -u -b volume-3a5753bb-449a-4782-b29b-61e0b56e8a04 -F qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a5753bb-449a-4782-b29b-61e0b56e8a04.62f77114-7e4c-457c-ad69-40dd2ff8ba82 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:40:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-5c94494b-43a7-4420-9409-15d04b69fa13 tempest-SnapshotDependencyTests-1197874144 None] CMD "qemu-img rebase -u -b volume-3a5753bb-449a-4782-b29b-61e0b56e8a04 -F qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a5753bb-449a-4782-b29b-61e0b56e8a04.62f77114-7e4c-457c-ad69-40dd2ff8ba82" returned: 0 in 0.368s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:40:01 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-5c94494b-43a7-4420-9409-15d04b69fa13 tempest-SnapshotDependencyTests-1197874144 None] File path /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a5753bb-449a-4782-b29b-61e0b56e8a04.62f77114-7e4c-457c-ad69-40dd2ff8ba82 is being set with permissions: 660 {{(pid=82780) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 21:40:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-5c94494b-43a7-4420-9409-15d04b69fa13 tempest-SnapshotDependencyTests-1197874144 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a5753bb-449a-4782-b29b-61e0b56e8a04.62f77114-7e4c-457c-ad69-40dd2ff8ba82 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:40:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-5c94494b-43a7-4420-9409-15d04b69fa13 tempest-SnapshotDependencyTests-1197874144 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a5753bb-449a-4782-b29b-61e0b56e8a04.62f77114-7e4c-457c-ad69-40dd2ff8ba82" returned: 0 in 0.456s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:40:01 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-5c94494b-43a7-4420-9409-15d04b69fa13 tempest-SnapshotDependencyTests-1197874144 None] Setting permissions: /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a5753bb-449a-4782-b29b-61e0b56e8a04 -> 1000:1000 {{(pid=82780) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 21:40:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-5c94494b-43a7-4420-9409-15d04b69fa13 tempest-SnapshotDependencyTests-1197874144 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a5753bb-449a-4782-b29b-61e0b56e8a04 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a5753bb-449a-4782-b29b-61e0b56e8a04.62f77114-7e4c-457c-ad69-40dd2ff8ba82 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:40:02 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-5c94494b-43a7-4420-9409-15d04b69fa13 tempest-SnapshotDependencyTests-1197874144 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a5753bb-449a-4782-b29b-61e0b56e8a04 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a5753bb-449a-4782-b29b-61e0b56e8a04.62f77114-7e4c-457c-ad69-40dd2ff8ba82" returned: 0 in 0.335s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:40:02 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-5c94494b-43a7-4420-9409-15d04b69fa13 tempest-SnapshotDependencyTests-1197874144 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a5753bb-449a-4782-b29b-61e0b56e8a04.info {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:40:02 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-5c94494b-43a7-4420-9409-15d04b69fa13 tempest-SnapshotDependencyTests-1197874144 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a5753bb-449a-4782-b29b-61e0b56e8a04.info" returned: 0 in 0.225s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:40:02 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-5c94494b-43a7-4420-9409-15d04b69fa13 tempest-SnapshotDependencyTests-1197874144 None] File path /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a5753bb-449a-4782-b29b-61e0b56e8a04.info is being set with permissions: 660 {{(pid=82780) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 21:40:02 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-5c94494b-43a7-4420-9409-15d04b69fa13 tempest-SnapshotDependencyTests-1197874144 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a5753bb-449a-4782-b29b-61e0b56e8a04.info {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:40:02 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-5c94494b-43a7-4420-9409-15d04b69fa13 tempest-SnapshotDependencyTests-1197874144 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a5753bb-449a-4782-b29b-61e0b56e8a04.info" returned: 0 in 0.180s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:40:02 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-5c94494b-43a7-4420-9409-15d04b69fa13 tempest-SnapshotDependencyTests-1197874144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.422s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:40:03 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-5c94494b-43a7-4420-9409-15d04b69fa13 tempest-SnapshotDependencyTests-1197874144 None] Create snapshot completed successfully Sep 10 21:40:05 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-5bcffbde-8dc8-4bca-b7d8-e9fc5c7face9 tempest-SnapshotDependencyTests-1197874144 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:40:05 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bcffbde-8dc8-4bca-b7d8-e9fc5c7face9 tempest-SnapshotDependencyTests-1197874144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:40:05 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-5bcffbde-8dc8-4bca-b7d8-e9fc5c7face9 tempest-SnapshotDependencyTests-1197874144 None] Flow 'volume_create_manager' (1855c994-afe5-43b5-9c47-a7abfa950b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:40:05 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-5bcffbde-8dc8-4bca-b7d8-e9fc5c7face9 tempest-SnapshotDependencyTests-1197874144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cc32647-b2b3-4f6e-8291-e2d215edcb48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:40:05 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-5bcffbde-8dc8-4bca-b7d8-e9fc5c7face9 tempest-SnapshotDependencyTests-1197874144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cc32647-b2b3-4f6e-8291-e2d215edcb48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:40:05Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac39df48-6ddd-4402-9fbb-ce2e0fb9f2be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fb96f9de67e4d7784097288ca26b4d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:40:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=62f77114-7e4c-457c-ad69-40dd2ff8ba82,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:40:05Z,use_quota=True,user_id='d118dec05001475780c35fe9d011b491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:40:05 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-5bcffbde-8dc8-4bca-b7d8-e9fc5c7face9 tempest-SnapshotDependencyTests-1197874144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10e7d627-01ac-4029-8500-b845f5bcea4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:40:05 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-5bcffbde-8dc8-4bca-b7d8-e9fc5c7face9 tempest-SnapshotDependencyTests-1197874144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10e7d627-01ac-4029-8500-b845f5bcea4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:40:05 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-5bcffbde-8dc8-4bca-b7d8-e9fc5c7face9 tempest-SnapshotDependencyTests-1197874144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c6297a0-e5a8-497d-9f0c-2e6d34bb4bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:40:05 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-5bcffbde-8dc8-4bca-b7d8-e9fc5c7face9 tempest-SnapshotDependencyTests-1197874144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c6297a0-e5a8-497d-9f0c-2e6d34bb4bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ac39df48-6ddd-4402-9fbb-ce2e0fb9f2be', 'volume_name': 'volume-ac39df48-6ddd-4402-9fbb-ce2e0fb9f2be', 'volume_size': 1, 'snapshot_id': '62f77114-7e4c-457c-ad69-40dd2ff8ba82'}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:40:05 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-5bcffbde-8dc8-4bca-b7d8-e9fc5c7face9 tempest-SnapshotDependencyTests-1197874144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dd05b12-e4b3-47d9-bd40-0a7767a7ed9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:40:05 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-5bcffbde-8dc8-4bca-b7d8-e9fc5c7face9 tempest-SnapshotDependencyTests-1197874144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dd05b12-e4b3-47d9-bd40-0a7767a7ed9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:40:05 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-5bcffbde-8dc8-4bca-b7d8-e9fc5c7face9 tempest-SnapshotDependencyTests-1197874144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89bcb85e-2bb5-4e81-a079-f7be8f9427d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:40:05 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-5bcffbde-8dc8-4bca-b7d8-e9fc5c7face9 tempest-SnapshotDependencyTests-1197874144 None] Volume ac39df48-6ddd-4402-9fbb-ce2e0fb9f2be: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ac39df48-6ddd-4402-9fbb-ce2e0fb9f2be', 'volume_size': 1, 'snapshot_id': '62f77114-7e4c-457c-ad69-40dd2ff8ba82'} Sep 10 21:40:05 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-5bcffbde-8dc8-4bca-b7d8-e9fc5c7face9 tempest-SnapshotDependencyTests-1197874144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:40:05 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-5bcffbde-8dc8-4bca-b7d8-e9fc5c7face9 tempest-SnapshotDependencyTests-1197874144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:40:05 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-5bcffbde-8dc8-4bca-b7d8-e9fc5c7face9 tempest-SnapshotDependencyTests-1197874144 None] Acquiring lock "cinder-quobyte-62f77114-7e4c-457c-ad69-40dd2ff8ba82-ac39df48-6ddd-4402-9fbb-ce2e0fb9f2be" by "_create_volume_from_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:40:05 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-5bcffbde-8dc8-4bca-b7d8-e9fc5c7face9 tempest-SnapshotDependencyTests-1197874144 None] Lock "cinder-quobyte-62f77114-7e4c-457c-ad69-40dd2ff8ba82-ac39df48-6ddd-4402-9fbb-ce2e0fb9f2be" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:40:05 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-5bcffbde-8dc8-4bca-b7d8-e9fc5c7face9 tempest-SnapshotDependencyTests-1197874144 None] Creating volume ac39df48-6ddd-4402-9fbb-ce2e0fb9f2be from snapshot 62f77114-7e4c-457c-ad69-40dd2ff8ba82 {{(pid=82780) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 10 21:40:05 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-5bcffbde-8dc8-4bca-b7d8-e9fc5c7face9 tempest-SnapshotDependencyTests-1197874144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:40:05 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-5bcffbde-8dc8-4bca-b7d8-e9fc5c7face9 tempest-SnapshotDependencyTests-1197874144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:40:05 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-5bcffbde-8dc8-4bca-b7d8-e9fc5c7face9 tempest-SnapshotDependencyTests-1197874144 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:40:05 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-5bcffbde-8dc8-4bca-b7d8-e9fc5c7face9 tempest-SnapshotDependencyTests-1197874144 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:40:05 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-5bcffbde-8dc8-4bca-b7d8-e9fc5c7face9 tempest-SnapshotDependencyTests-1197874144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:40:05 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-5bcffbde-8dc8-4bca-b7d8-e9fc5c7face9 tempest-SnapshotDependencyTests-1197874144 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:40:05 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-5bcffbde-8dc8-4bca-b7d8-e9fc5c7face9 tempest-SnapshotDependencyTests-1197874144 None] Acquiring lock "cinder-quobyte-ac39df48-6ddd-4402-9fbb-ce2e0fb9f2be" by "_copy_volume_from_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:40:05 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-5bcffbde-8dc8-4bca-b7d8-e9fc5c7face9 tempest-SnapshotDependencyTests-1197874144 None] Lock "cinder-quobyte-ac39df48-6ddd-4402-9fbb-ce2e0fb9f2be" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:40:05 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-5bcffbde-8dc8-4bca-b7d8-e9fc5c7face9 tempest-SnapshotDependencyTests-1197874144 None] snapshot: 62f77114-7e4c-457c-ad69-40dd2ff8ba82, volume: ac39df48-6ddd-4402-9fbb-ce2e0fb9f2be, {{(pid=82780) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}} Sep 10 21:40:05 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-5bcffbde-8dc8-4bca-b7d8-e9fc5c7face9 tempest-SnapshotDependencyTests-1197874144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:40:05 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-5bcffbde-8dc8-4bca-b7d8-e9fc5c7face9 tempest-SnapshotDependencyTests-1197874144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:40:05 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-5bcffbde-8dc8-4bca-b7d8-e9fc5c7face9 tempest-SnapshotDependencyTests-1197874144 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:40:05 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-5bcffbde-8dc8-4bca-b7d8-e9fc5c7face9 tempest-SnapshotDependencyTests-1197874144 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:40:05 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-5bcffbde-8dc8-4bca-b7d8-e9fc5c7face9 tempest-SnapshotDependencyTests-1197874144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:40:05 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5558765-a677-4787-8bea-72fcee0ab522]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:40:05 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-5bcffbde-8dc8-4bca-b7d8-e9fc5c7face9 tempest-SnapshotDependencyTests-1197874144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a5753bb-449a-4782-b29b-61e0b56e8a04.62f77114-7e4c-457c-ad69-40dd2ff8ba82 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:40:06 devstack quobyte-client[82807]: System call of process 99855 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:40:06 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-5bcffbde-8dc8-4bca-b7d8-e9fc5c7face9 tempest-SnapshotDependencyTests-1197874144 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a5753bb-449a-4782-b29b-61e0b56e8a04.62f77114-7e4c-457c-ad69-40dd2ff8ba82" returned: 0 in 0.468s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:40:06 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-5bcffbde-8dc8-4bca-b7d8-e9fc5c7face9 tempest-SnapshotDependencyTests-1197874144 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a5753bb-449a-4782-b29b-61e0b56e8a04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82780) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 21:40:06 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-5bcffbde-8dc8-4bca-b7d8-e9fc5c7face9 tempest-SnapshotDependencyTests-1197874144 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a5753bb-449a-4782-b29b-61e0b56e8a04 {{(pid=82780) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}} Sep 10 21:40:06 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-5bcffbde-8dc8-4bca-b7d8-e9fc5c7face9 tempest-SnapshotDependencyTests-1197874144 None] Creating direct copy from snapshot {{(pid=82780) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Sep 10 21:40:06 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b99b7af-da63-4cc4-9372-83ed4973f03c]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:40:06 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-5bcffbde-8dc8-4bca-b7d8-e9fc5c7face9 tempest-SnapshotDependencyTests-1197874144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a5753bb-449a-4782-b29b-61e0b56e8a04 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:40:06 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-5bcffbde-8dc8-4bca-b7d8-e9fc5c7face9 tempest-SnapshotDependencyTests-1197874144 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a5753bb-449a-4782-b29b-61e0b56e8a04" returned: 0 in 0.496s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:40:06 devstack cinder-volume[82780]: DEBUG cinder.utils [None req-5bcffbde-8dc8-4bca-b7d8-e9fc5c7face9 tempest-SnapshotDependencyTests-1197874144 None] Path /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ac39df48-6ddd-4402-9fbb-ce2e0fb9f2be not found in is_blk_device check {{(pid=82780) is_blk_device /opt/stack/cinder/cinder/utils.py:591}} Sep 10 21:40:06 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-5bcffbde-8dc8-4bca-b7d8-e9fc5c7face9 tempest-SnapshotDependencyTests-1197874144 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a5753bb-449a-4782-b29b-61e0b56e8a04 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ac39df48-6ddd-4402-9fbb-ce2e0fb9f2be {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:40:06 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=130, name=volume-ac39df48-6ddd-4402-9fbb-ce2e0fb9f2be, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:40:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-5bcffbde-8dc8-4bca-b7d8-e9fc5c7face9 tempest-SnapshotDependencyTests-1197874144 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a5753bb-449a-4782-b29b-61e0b56e8a04 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ac39df48-6ddd-4402-9fbb-ce2e0fb9f2be" returned: 0 in 7.310s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:40:14 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3babba-f089-4bba-95fa-99f13a81be9b]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:40:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-5bcffbde-8dc8-4bca-b7d8-e9fc5c7face9 tempest-SnapshotDependencyTests-1197874144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a5753bb-449a-4782-b29b-61e0b56e8a04 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:40:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-5bcffbde-8dc8-4bca-b7d8-e9fc5c7face9 tempest-SnapshotDependencyTests-1197874144 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a5753bb-449a-4782-b29b-61e0b56e8a04" returned: 0 in 0.670s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:40:14 devstack cinder-volume[82780]: DEBUG cinder.image.image_utils [None req-5bcffbde-8dc8-4bca-b7d8-e9fc5c7face9 tempest-SnapshotDependencyTests-1197874144 None] Image conversion details: src /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a5753bb-449a-4782-b29b-61e0b56e8a04, size 1024.00 MB, duration 7.34 sec, destination /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ac39df48-6ddd-4402-9fbb-ce2e0fb9f2be {{(pid=82780) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 10 21:40:14 devstack cinder-volume[82780]: INFO cinder.image.image_utils [None req-5bcffbde-8dc8-4bca-b7d8-e9fc5c7face9 tempest-SnapshotDependencyTests-1197874144 None] Converted 1024.00 MB image at 139.55 MB/s Sep 10 21:40:14 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-5bcffbde-8dc8-4bca-b7d8-e9fc5c7face9 tempest-SnapshotDependencyTests-1197874144 None] File path /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ac39df48-6ddd-4402-9fbb-ce2e0fb9f2be is being set with permissions: 660 {{(pid=82780) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 21:40:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-5bcffbde-8dc8-4bca-b7d8-e9fc5c7face9 tempest-SnapshotDependencyTests-1197874144 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ac39df48-6ddd-4402-9fbb-ce2e0fb9f2be {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:40:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-5bcffbde-8dc8-4bca-b7d8-e9fc5c7face9 tempest-SnapshotDependencyTests-1197874144 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ac39df48-6ddd-4402-9fbb-ce2e0fb9f2be" returned: 0 in 0.086s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:40:15 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-5bcffbde-8dc8-4bca-b7d8-e9fc5c7face9 tempest-SnapshotDependencyTests-1197874144 None] Lock "cinder-quobyte-ac39df48-6ddd-4402-9fbb-ce2e0fb9f2be" released by "_copy_volume_from_snapshot" :: held 9.404s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:40:15 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-5bcffbde-8dc8-4bca-b7d8-e9fc5c7face9 tempest-SnapshotDependencyTests-1197874144 None] Lock "cinder-quobyte-62f77114-7e4c-457c-ad69-40dd2ff8ba82-ac39df48-6ddd-4402-9fbb-ce2e0fb9f2be" released by "_create_volume_from_snapshot" :: held 9.441s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:40:15 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-5bcffbde-8dc8-4bca-b7d8-e9fc5c7face9 tempest-SnapshotDependencyTests-1197874144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.470s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:40:15 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-5bcffbde-8dc8-4bca-b7d8-e9fc5c7face9 tempest-SnapshotDependencyTests-1197874144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89bcb85e-2bb5-4e81-a079-f7be8f9427d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac39df48-6ddd-4402-9fbb-ce2e0fb9f2be', 'volume_size': 1, 'snapshot_id': '62f77114-7e4c-457c-ad69-40dd2ff8ba82'}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:40:15 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-5bcffbde-8dc8-4bca-b7d8-e9fc5c7face9 tempest-SnapshotDependencyTests-1197874144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b64c840-1bb2-4abf-a730-c4466e15c19b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:40:15 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-5bcffbde-8dc8-4bca-b7d8-e9fc5c7face9 tempest-SnapshotDependencyTests-1197874144 None] Volume volume-ac39df48-6ddd-4402-9fbb-ce2e0fb9f2be (ac39df48-6ddd-4402-9fbb-ce2e0fb9f2be): created successfully Sep 10 21:40:15 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-5bcffbde-8dc8-4bca-b7d8-e9fc5c7face9 tempest-SnapshotDependencyTests-1197874144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b64c840-1bb2-4abf-a730-c4466e15c19b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:40:15 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-5bcffbde-8dc8-4bca-b7d8-e9fc5c7face9 tempest-SnapshotDependencyTests-1197874144 None] Flow 'volume_create_manager' (1855c994-afe5-43b5-9c47-a7abfa950b05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:40:15 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-5bcffbde-8dc8-4bca-b7d8-e9fc5c7face9 tempest-SnapshotDependencyTests-1197874144 None] Created volume successfully. Sep 10 21:40:16 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-de64ef0b-a5bc-492c-b1e9-90b762ee339f tempest-SnapshotDependencyTests-1197874144 None] Acquiring lock "cinder-62f77114-7e4c-457c-ad69-40dd2ff8ba82-delete_snapshot" by "delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:40:16 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-de64ef0b-a5bc-492c-b1e9-90b762ee339f tempest-SnapshotDependencyTests-1197874144 None] Lock "cinder-62f77114-7e4c-457c-ad69-40dd2ff8ba82-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:40:16 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-de64ef0b-a5bc-492c-b1e9-90b762ee339f tempest-SnapshotDependencyTests-1197874144 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:40:16 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-de64ef0b-a5bc-492c-b1e9-90b762ee339f tempest-SnapshotDependencyTests-1197874144 None] Acquiring lock "cinder-quobyte-3a5753bb-449a-4782-b29b-61e0b56e8a04" by "delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:40:17 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-de64ef0b-a5bc-492c-b1e9-90b762ee339f tempest-SnapshotDependencyTests-1197874144 None] Lock "cinder-quobyte-3a5753bb-449a-4782-b29b-61e0b56e8a04" acquired by "delete_snapshot" :: waited 0.025s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:40:17 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-de64ef0b-a5bc-492c-b1e9-90b762ee339f tempest-SnapshotDependencyTests-1197874144 None] Acquiring lock "cinder-quobyte-62f77114-7e4c-457c-ad69-40dd2ff8ba82" by "_delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:40:17 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-de64ef0b-a5bc-492c-b1e9-90b762ee339f tempest-SnapshotDependencyTests-1197874144 None] Lock "cinder-quobyte-62f77114-7e4c-457c-ad69-40dd2ff8ba82" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:40:17 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-de64ef0b-a5bc-492c-b1e9-90b762ee339f tempest-SnapshotDependencyTests-1197874144 None] Deleting offline snapshot 62f77114-7e4c-457c-ad69-40dd2ff8ba82 of volume 3a5753bb-449a-4782-b29b-61e0b56e8a04 {{(pid=82780) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 21:40:17 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-de64ef0b-a5bc-492c-b1e9-90b762ee339f tempest-SnapshotDependencyTests-1197874144 None] snapshot_file for this snap is: volume-3a5753bb-449a-4782-b29b-61e0b56e8a04.62f77114-7e4c-457c-ad69-40dd2ff8ba82 {{(pid=82780) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 21:40:17 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7cd9697-ca5c-4002-9901-3cbff3024ef7]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:40:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-de64ef0b-a5bc-492c-b1e9-90b762ee339f tempest-SnapshotDependencyTests-1197874144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a5753bb-449a-4782-b29b-61e0b56e8a04.62f77114-7e4c-457c-ad69-40dd2ff8ba82 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:40:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-de64ef0b-a5bc-492c-b1e9-90b762ee339f tempest-SnapshotDependencyTests-1197874144 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a5753bb-449a-4782-b29b-61e0b56e8a04.62f77114-7e4c-457c-ad69-40dd2ff8ba82" returned: 0 in 0.439s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:40:17 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-de64ef0b-a5bc-492c-b1e9-90b762ee339f tempest-SnapshotDependencyTests-1197874144 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a5753bb-449a-4782-b29b-61e0b56e8a04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82780) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 21:40:17 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ce3091-f015-4a96-ac25-87760e372d89]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:40:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-de64ef0b-a5bc-492c-b1e9-90b762ee339f tempest-SnapshotDependencyTests-1197874144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a5753bb-449a-4782-b29b-61e0b56e8a04 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:40:18 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-de64ef0b-a5bc-492c-b1e9-90b762ee339f tempest-SnapshotDependencyTests-1197874144 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a5753bb-449a-4782-b29b-61e0b56e8a04" returned: 0 in 0.484s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:40:18 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-de64ef0b-a5bc-492c-b1e9-90b762ee339f tempest-SnapshotDependencyTests-1197874144 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a5753bb-449a-4782-b29b-61e0b56e8a04.62f77114-7e4c-457c-ad69-40dd2ff8ba82 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:40:18 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-de64ef0b-a5bc-492c-b1e9-90b762ee339f tempest-SnapshotDependencyTests-1197874144 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a5753bb-449a-4782-b29b-61e0b56e8a04.62f77114-7e4c-457c-ad69-40dd2ff8ba82" returned: 0 in 0.285s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:40:18 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-de64ef0b-a5bc-492c-b1e9-90b762ee339f tempest-SnapshotDependencyTests-1197874144 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a5753bb-449a-4782-b29b-61e0b56e8a04.62f77114-7e4c-457c-ad69-40dd2ff8ba82 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:40:18 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-de64ef0b-a5bc-492c-b1e9-90b762ee339f tempest-SnapshotDependencyTests-1197874144 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a5753bb-449a-4782-b29b-61e0b56e8a04.62f77114-7e4c-457c-ad69-40dd2ff8ba82" returned: 0 in 0.113s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:40:18 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-de64ef0b-a5bc-492c-b1e9-90b762ee339f tempest-SnapshotDependencyTests-1197874144 None] Lock "cinder-quobyte-62f77114-7e4c-457c-ad69-40dd2ff8ba82" released by "_delete_snapshot" :: held 1.675s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:40:18 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-de64ef0b-a5bc-492c-b1e9-90b762ee339f tempest-SnapshotDependencyTests-1197874144 None] Lock "cinder-quobyte-3a5753bb-449a-4782-b29b-61e0b56e8a04" released by "delete_snapshot" :: held 1.727s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:40:19 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-de64ef0b-a5bc-492c-b1e9-90b762ee339f tempest-SnapshotDependencyTests-1197874144 None] Created reservations ['e83abfec-dff0-4b4c-8143-3f2e9589fb4d', '86ea9215-0f85-499d-a52f-cd2b02e57db2', '3c477d38-f806-4fd4-9509-daa49942248b', 'beb7ce53-d48a-4a06-bdd8-963a8a46bb6a'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:40:19 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-de64ef0b-a5bc-492c-b1e9-90b762ee339f tempest-SnapshotDependencyTests-1197874144 None] Delete snapshot completed successfully. Sep 10 21:40:19 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-de64ef0b-a5bc-492c-b1e9-90b762ee339f tempest-SnapshotDependencyTests-1197874144 None] Lock "cinder-62f77114-7e4c-457c-ad69-40dd2ff8ba82-delete_snapshot" released by "delete_snapshot" :: held 2.349s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:40:20 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-7d5d74d5-11ba-4798-9faf-8524990094a8 tempest-SnapshotDependencyTests-1197874144 None] Acquiring lock "cinder-3a5753bb-449a-4782-b29b-61e0b56e8a04-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:40:20 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-7d5d74d5-11ba-4798-9faf-8524990094a8 tempest-SnapshotDependencyTests-1197874144 None] Lock "cinder-3a5753bb-449a-4782-b29b-61e0b56e8a04-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:40:20 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-7d5d74d5-11ba-4798-9faf-8524990094a8 tempest-SnapshotDependencyTests-1197874144 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:40:20 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-7d5d74d5-11ba-4798-9faf-8524990094a8 tempest-SnapshotDependencyTests-1197874144 None] Acquiring lock "cinder-quobyte-3a5753bb-449a-4782-b29b-61e0b56e8a04" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:40:20 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-7d5d74d5-11ba-4798-9faf-8524990094a8 tempest-SnapshotDependencyTests-1197874144 None] Lock "cinder-quobyte-3a5753bb-449a-4782-b29b-61e0b56e8a04" acquired by "delete_volume" :: waited 0.014s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:40:20 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc45bde5-4998-4019-b2dc-2668b051ef8a]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:40:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-7d5d74d5-11ba-4798-9faf-8524990094a8 tempest-SnapshotDependencyTests-1197874144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a5753bb-449a-4782-b29b-61e0b56e8a04 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:40:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-7d5d74d5-11ba-4798-9faf-8524990094a8 tempest-SnapshotDependencyTests-1197874144 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a5753bb-449a-4782-b29b-61e0b56e8a04" returned: 0 in 0.507s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:40:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-7d5d74d5-11ba-4798-9faf-8524990094a8 tempest-SnapshotDependencyTests-1197874144 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a5753bb-449a-4782-b29b-61e0b56e8a04 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:40:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-7d5d74d5-11ba-4798-9faf-8524990094a8 tempest-SnapshotDependencyTests-1197874144 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-3a5753bb-449a-4782-b29b-61e0b56e8a04" returned: 0 in 0.122s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:40:21 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-7d5d74d5-11ba-4798-9faf-8524990094a8 tempest-SnapshotDependencyTests-1197874144 None] Lock "cinder-quobyte-3a5753bb-449a-4782-b29b-61e0b56e8a04" released by "delete_volume" :: held 0.846s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:40:21 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-7d5d74d5-11ba-4798-9faf-8524990094a8 tempest-SnapshotDependencyTests-1197874144 None] Created reservations ['6d81de55-7cec-4096-9122-b9ebf2c062a8', '0ae8352a-a09d-4fb5-95ac-add785ba2817', '434d3c7b-2963-40ba-a4c9-dbdcac5da06a', 'd54a1e72-1ccb-46f5-8e9a-0da6704aaafc'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:40:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-7d5d74d5-11ba-4798-9faf-8524990094a8 tempest-SnapshotDependencyTests-1197874144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:40:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-7d5d74d5-11ba-4798-9faf-8524990094a8 tempest-SnapshotDependencyTests-1197874144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:40:21 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-7d5d74d5-11ba-4798-9faf-8524990094a8 tempest-SnapshotDependencyTests-1197874144 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:40:21 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-7d5d74d5-11ba-4798-9faf-8524990094a8 tempest-SnapshotDependencyTests-1197874144 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:40:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-7d5d74d5-11ba-4798-9faf-8524990094a8 tempest-SnapshotDependencyTests-1197874144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:40:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-7d5d74d5-11ba-4798-9faf-8524990094a8 tempest-SnapshotDependencyTests-1197874144 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:40:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-7d5d74d5-11ba-4798-9faf-8524990094a8 tempest-SnapshotDependencyTests-1197874144 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.145s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:40:22 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-7d5d74d5-11ba-4798-9faf-8524990094a8 tempest-SnapshotDependencyTests-1197874144 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:40:22 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-7d5d74d5-11ba-4798-9faf-8524990094a8 tempest-SnapshotDependencyTests-1197874144 None] Deleted volume successfully. Sep 10 21:40:22 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-7d5d74d5-11ba-4798-9faf-8524990094a8 tempest-SnapshotDependencyTests-1197874144 None] Lock "cinder-3a5753bb-449a-4782-b29b-61e0b56e8a04-delete_volume" released by "delete_volume" :: held 2.190s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:40:22 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-10915b4e-58d9-4837-86d8-6ffd67a7590c tempest-SnapshotDependencyTests-1197874144 None] Acquiring lock "cinder-ac39df48-6ddd-4402-9fbb-ce2e0fb9f2be-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:40:22 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-10915b4e-58d9-4837-86d8-6ffd67a7590c tempest-SnapshotDependencyTests-1197874144 None] Lock "cinder-ac39df48-6ddd-4402-9fbb-ce2e0fb9f2be-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:40:23 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-10915b4e-58d9-4837-86d8-6ffd67a7590c tempest-SnapshotDependencyTests-1197874144 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:40:23 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-10915b4e-58d9-4837-86d8-6ffd67a7590c tempest-SnapshotDependencyTests-1197874144 None] Acquiring lock "cinder-quobyte-ac39df48-6ddd-4402-9fbb-ce2e0fb9f2be" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:40:23 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-10915b4e-58d9-4837-86d8-6ffd67a7590c tempest-SnapshotDependencyTests-1197874144 None] Lock "cinder-quobyte-ac39df48-6ddd-4402-9fbb-ce2e0fb9f2be" acquired by "delete_volume" :: waited 0.015s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:40:23 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79331d6-f0b8-4085-968a-297d396e697a]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:40:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-10915b4e-58d9-4837-86d8-6ffd67a7590c tempest-SnapshotDependencyTests-1197874144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ac39df48-6ddd-4402-9fbb-ce2e0fb9f2be {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:40:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-10915b4e-58d9-4837-86d8-6ffd67a7590c tempest-SnapshotDependencyTests-1197874144 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ac39df48-6ddd-4402-9fbb-ce2e0fb9f2be" returned: 0 in 0.620s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:40:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-10915b4e-58d9-4837-86d8-6ffd67a7590c tempest-SnapshotDependencyTests-1197874144 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ac39df48-6ddd-4402-9fbb-ce2e0fb9f2be {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:40:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-10915b4e-58d9-4837-86d8-6ffd67a7590c tempest-SnapshotDependencyTests-1197874144 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ac39df48-6ddd-4402-9fbb-ce2e0fb9f2be" returned: 0 in 0.197s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:40:24 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-10915b4e-58d9-4837-86d8-6ffd67a7590c tempest-SnapshotDependencyTests-1197874144 None] Lock "cinder-quobyte-ac39df48-6ddd-4402-9fbb-ce2e0fb9f2be" released by "delete_volume" :: held 1.041s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:40:24 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-10915b4e-58d9-4837-86d8-6ffd67a7590c tempest-SnapshotDependencyTests-1197874144 None] Created reservations ['fc9ad846-ace6-434e-9eef-8bdbeda111fe', '182cd02e-1ab5-4a75-b340-333c36d1af92', '85f2101d-8c51-4cb7-84a1-e002b13c0d46', '60ef60e2-21b2-4651-a46d-8b1c19cea8ee'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:40:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-10915b4e-58d9-4837-86d8-6ffd67a7590c tempest-SnapshotDependencyTests-1197874144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:40:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-10915b4e-58d9-4837-86d8-6ffd67a7590c tempest-SnapshotDependencyTests-1197874144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.015s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:40:24 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-10915b4e-58d9-4837-86d8-6ffd67a7590c tempest-SnapshotDependencyTests-1197874144 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:40:24 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-10915b4e-58d9-4837-86d8-6ffd67a7590c tempest-SnapshotDependencyTests-1197874144 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:40:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-10915b4e-58d9-4837-86d8-6ffd67a7590c tempest-SnapshotDependencyTests-1197874144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:40:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-10915b4e-58d9-4837-86d8-6ffd67a7590c tempest-SnapshotDependencyTests-1197874144 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:40:25 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-10915b4e-58d9-4837-86d8-6ffd67a7590c tempest-SnapshotDependencyTests-1197874144 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.111s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:40:25 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-10915b4e-58d9-4837-86d8-6ffd67a7590c tempest-SnapshotDependencyTests-1197874144 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:40:25 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-10915b4e-58d9-4837-86d8-6ffd67a7590c tempest-SnapshotDependencyTests-1197874144 None] Deleted volume successfully. Sep 10 21:40:25 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-10915b4e-58d9-4837-86d8-6ffd67a7590c tempest-SnapshotDependencyTests-1197874144 None] Lock "cinder-ac39df48-6ddd-4402-9fbb-ce2e0fb9f2be-delete_volume" released by "delete_volume" :: held 2.649s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:40:34 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:UPDATE=20,cinder:SELECT=20,cinder:DELETE=2,cinder:INSERT=10 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:40:35 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=20,cinder:UPDATE=34,cinder:DELETE=3,cinder:INSERT=2 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:40:54 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-95ade74a-6f3b-423e-8123-beafce2425a2 tempest-VolumesActionsTest-916036654 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:40:54 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-95ade74a-6f3b-423e-8123-beafce2425a2 tempest-VolumesActionsTest-916036654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:40:54 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-95ade74a-6f3b-423e-8123-beafce2425a2 tempest-VolumesActionsTest-916036654 None] Flow 'volume_create_manager' (0905af87-f533-4213-a50a-7705d765853c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:40:54 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-95ade74a-6f3b-423e-8123-beafce2425a2 tempest-VolumesActionsTest-916036654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1189b03-2a2b-4539-ac3a-2310d4f97cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:40:54 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-95ade74a-6f3b-423e-8123-beafce2425a2 tempest-VolumesActionsTest-916036654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1189b03-2a2b-4539-ac3a-2310d4f97cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:40:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2142979393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a88408f-49dd-4160-8266-5f5d3b294bfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61072f025e8a40f5b1715023226c0593',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:40:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:40:54Z,use_quota=True,user_id='3b3a697e72a340e0b343914f5b890922',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:40:54 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-95ade74a-6f3b-423e-8123-beafce2425a2 tempest-VolumesActionsTest-916036654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87a0fdd0-e3b1-4e36-baa8-5ff8b471a5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:40:54 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-95ade74a-6f3b-423e-8123-beafce2425a2 tempest-VolumesActionsTest-916036654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87a0fdd0-e3b1-4e36-baa8-5ff8b471a5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:40:54 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-95ade74a-6f3b-423e-8123-beafce2425a2 tempest-VolumesActionsTest-916036654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff3c43ef-dc5b-4c12-ab3c-e2bed7085b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:40:54 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-95ade74a-6f3b-423e-8123-beafce2425a2 tempest-VolumesActionsTest-916036654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff3c43ef-dc5b-4c12-ab3c-e2bed7085b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a88408f-49dd-4160-8266-5f5d3b294bfb', 'volume_name': 'volume-7a88408f-49dd-4160-8266-5f5d3b294bfb', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:40:54 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-95ade74a-6f3b-423e-8123-beafce2425a2 tempest-VolumesActionsTest-916036654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed67496b-a39f-4187-b023-4a048d735065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:40:54 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-95ade74a-6f3b-423e-8123-beafce2425a2 tempest-VolumesActionsTest-916036654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed67496b-a39f-4187-b023-4a048d735065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:40:54 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-95ade74a-6f3b-423e-8123-beafce2425a2 tempest-VolumesActionsTest-916036654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15e8e862-a7bd-496b-af52-0e8bd5129586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:40:54 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-95ade74a-6f3b-423e-8123-beafce2425a2 tempest-VolumesActionsTest-916036654 None] Volume 7a88408f-49dd-4160-8266-5f5d3b294bfb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a88408f-49dd-4160-8266-5f5d3b294bfb', 'volume_size': 1} Sep 10 21:40:54 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-95ade74a-6f3b-423e-8123-beafce2425a2 tempest-VolumesActionsTest-916036654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:40:54 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-95ade74a-6f3b-423e-8123-beafce2425a2 tempest-VolumesActionsTest-916036654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:40:54 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-95ade74a-6f3b-423e-8123-beafce2425a2 tempest-VolumesActionsTest-916036654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:40:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2142979393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a88408f-49dd-4160-8266-5f5d3b294bfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61072f025e8a40f5b1715023226c0593',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:40:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:40:54Z,use_quota=True,user_id='3b3a697e72a340e0b343914f5b890922',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:40:54 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-95ade74a-6f3b-423e-8123-beafce2425a2 tempest-VolumesActionsTest-916036654 None] Creating volume 7a88408f-49dd-4160-8266-5f5d3b294bfb {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:40:54 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-95ade74a-6f3b-423e-8123-beafce2425a2 tempest-VolumesActionsTest-916036654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:40:54 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-95ade74a-6f3b-423e-8123-beafce2425a2 tempest-VolumesActionsTest-916036654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:40:54 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-95ade74a-6f3b-423e-8123-beafce2425a2 tempest-VolumesActionsTest-916036654 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:40:54 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-95ade74a-6f3b-423e-8123-beafce2425a2 tempest-VolumesActionsTest-916036654 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:40:54 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-95ade74a-6f3b-423e-8123-beafce2425a2 tempest-VolumesActionsTest-916036654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:40:54 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-95ade74a-6f3b-423e-8123-beafce2425a2 tempest-VolumesActionsTest-916036654 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:40:54 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-95ade74a-6f3b-423e-8123-beafce2425a2 tempest-VolumesActionsTest-916036654 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:40:54 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-95ade74a-6f3b-423e-8123-beafce2425a2 tempest-VolumesActionsTest-916036654 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-7a88408f-49dd-4160-8266-5f5d3b294bfb 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:40:54 devstack quobyte-client[82807]: System call of process 100003 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:40:54 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=131, name=volume-7a88408f-49dd-4160-8266-5f5d3b294bfb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:40:54 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-95ade74a-6f3b-423e-8123-beafce2425a2 tempest-VolumesActionsTest-916036654 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-7a88408f-49dd-4160-8266-5f5d3b294bfb 1073741824" returned: 0 in 0.564s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:40:54 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-95ade74a-6f3b-423e-8123-beafce2425a2 tempest-VolumesActionsTest-916036654 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-7a88408f-49dd-4160-8266-5f5d3b294bfb {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:40:55 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-95ade74a-6f3b-423e-8123-beafce2425a2 tempest-VolumesActionsTest-916036654 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-7a88408f-49dd-4160-8266-5f5d3b294bfb" returned: 0 in 0.147s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:40:55 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-95ade74a-6f3b-423e-8123-beafce2425a2 tempest-VolumesActionsTest-916036654 None] <== create_volume: return (790ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:40:55 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-95ade74a-6f3b-423e-8123-beafce2425a2 tempest-VolumesActionsTest-916036654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:40:55 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-95ade74a-6f3b-423e-8123-beafce2425a2 tempest-VolumesActionsTest-916036654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15e8e862-a7bd-496b-af52-0e8bd5129586) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a88408f-49dd-4160-8266-5f5d3b294bfb', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:40:55 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-95ade74a-6f3b-423e-8123-beafce2425a2 tempest-VolumesActionsTest-916036654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (682f9cd1-cad2-4e89-b6d2-f63d0f2440db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:40:55 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-95ade74a-6f3b-423e-8123-beafce2425a2 tempest-VolumesActionsTest-916036654 None] Volume volume-7a88408f-49dd-4160-8266-5f5d3b294bfb (7a88408f-49dd-4160-8266-5f5d3b294bfb): created successfully Sep 10 21:40:55 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-95ade74a-6f3b-423e-8123-beafce2425a2 tempest-VolumesActionsTest-916036654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (682f9cd1-cad2-4e89-b6d2-f63d0f2440db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:40:55 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-95ade74a-6f3b-423e-8123-beafce2425a2 tempest-VolumesActionsTest-916036654 None] Flow 'volume_create_manager' (0905af87-f533-4213-a50a-7705d765853c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:40:55 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-95ade74a-6f3b-423e-8123-beafce2425a2 tempest-VolumesActionsTest-916036654 None] Created volume successfully. Sep 10 21:40:56 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-e8239dbf-e82b-47be-a5aa-5e49204dab78 tempest-VolumesActionsTest-916036654 None] Acquiring lock "cinder-7a88408f-49dd-4160-8266-5f5d3b294bfb" by "attach_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:40:56 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-e8239dbf-e82b-47be-a5aa-5e49204dab78 tempest-VolumesActionsTest-916036654 None] Lock "cinder-7a88408f-49dd-4160-8266-5f5d3b294bfb" acquired by "attach_volume" :: waited 0.091s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:40:56 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-e8239dbf-e82b-47be-a5aa-5e49204dab78 tempest-VolumesActionsTest-916036654 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:40:56 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-e8239dbf-e82b-47be-a5aa-5e49204dab78 tempest-VolumesActionsTest-916036654 None] Attaching volume 7a88408f-49dd-4160-8266-5f5d3b294bfb to instance 929c22d3-9e03-4b38-9d4d-06a79d74a1b1 at mountpoint /dev/vdb on host None. Sep 10 21:40:56 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-e8239dbf-e82b-47be-a5aa-5e49204dab78 tempest-VolumesActionsTest-916036654 None] Attach volume completed successfully. Sep 10 21:40:56 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-e8239dbf-e82b-47be-a5aa-5e49204dab78 tempest-VolumesActionsTest-916036654 None] Lock "cinder-7a88408f-49dd-4160-8266-5f5d3b294bfb" released by "attach_volume" :: held 0.485s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:40:57 devstack cinder-volume[82780]: DEBUG oslo_service.periodic_task [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82780) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 21:40:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:40:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:40:57 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:40:57 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:40:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:40:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:40:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.133s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:40:57 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:40:58 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-d27efdd6-d23d-4630-8dfc-df1f703c328f tempest-VolumesActionsTest-1970135913 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:40:58 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-d27efdd6-d23d-4630-8dfc-df1f703c328f tempest-VolumesActionsTest-1970135913 None] Terminate volume connection completed successfully. Sep 10 21:40:58 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-d27efdd6-d23d-4630-8dfc-df1f703c328f tempest-VolumesActionsTest-1970135913 None] Acquiring lock "cinder-7a88408f-49dd-4160-8266-5f5d3b294bfb-detach_volume" by "detach_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:40:58 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-d27efdd6-d23d-4630-8dfc-df1f703c328f tempest-VolumesActionsTest-1970135913 None] Lock "cinder-7a88408f-49dd-4160-8266-5f5d3b294bfb-detach_volume" acquired by "detach_volume" :: waited 0.065s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:40:58 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-d27efdd6-d23d-4630-8dfc-df1f703c328f tempest-VolumesActionsTest-1970135913 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:40:58 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-d27efdd6-d23d-4630-8dfc-df1f703c328f tempest-VolumesActionsTest-1970135913 None] Detaching volume 7a88408f-49dd-4160-8266-5f5d3b294bfb from instance 929c22d3-9e03-4b38-9d4d-06a79d74a1b1. Sep 10 21:40:58 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-d27efdd6-d23d-4630-8dfc-df1f703c328f tempest-VolumesActionsTest-1970135913 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:40:59 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-d27efdd6-d23d-4630-8dfc-df1f703c328f tempest-VolumesActionsTest-1970135913 None] Detach volume completed successfully. Sep 10 21:40:59 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-d27efdd6-d23d-4630-8dfc-df1f703c328f tempest-VolumesActionsTest-1970135913 None] Lock "cinder-7a88408f-49dd-4160-8266-5f5d3b294bfb-detach_volume" released by "detach_volume" :: held 0.223s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:40:59 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-503f4a7f-f3e8-444e-8d63-362362a23650 tempest-VolumesActionsTest-916036654 None] Acquiring lock "cinder-7a88408f-49dd-4160-8266-5f5d3b294bfb-detach_volume" by "detach_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:40:59 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-503f4a7f-f3e8-444e-8d63-362362a23650 tempest-VolumesActionsTest-916036654 None] Lock "cinder-7a88408f-49dd-4160-8266-5f5d3b294bfb-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:40:59 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-503f4a7f-f3e8-444e-8d63-362362a23650 tempest-VolumesActionsTest-916036654 None] Volume detach called, but volume not attached. Sep 10 21:40:59 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-503f4a7f-f3e8-444e-8d63-362362a23650 tempest-VolumesActionsTest-916036654 None] Lock "cinder-7a88408f-49dd-4160-8266-5f5d3b294bfb-detach_volume" released by "detach_volume" :: held 0.060s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:41:00 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-ec21578e-336c-43b3-bba7-c7f8e831ed17 tempest-VolumesActionsTest-916036654 None] Acquiring lock "cinder-7a88408f-49dd-4160-8266-5f5d3b294bfb-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:41:00 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-ec21578e-336c-43b3-bba7-c7f8e831ed17 tempest-VolumesActionsTest-916036654 None] Lock "cinder-7a88408f-49dd-4160-8266-5f5d3b294bfb-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:41:00 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-ec21578e-336c-43b3-bba7-c7f8e831ed17 tempest-VolumesActionsTest-916036654 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:41:00 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-ec21578e-336c-43b3-bba7-c7f8e831ed17 tempest-VolumesActionsTest-916036654 None] Acquiring lock "cinder-quobyte-7a88408f-49dd-4160-8266-5f5d3b294bfb" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:41:00 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-ec21578e-336c-43b3-bba7-c7f8e831ed17 tempest-VolumesActionsTest-916036654 None] Lock "cinder-quobyte-7a88408f-49dd-4160-8266-5f5d3b294bfb" acquired by "delete_volume" :: waited 0.011s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:41:00 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c81dff-2462-43a1-abdd-a37c5a987184]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:41:00 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ec21578e-336c-43b3-bba7-c7f8e831ed17 tempest-VolumesActionsTest-916036654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-7a88408f-49dd-4160-8266-5f5d3b294bfb {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:41:00 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ec21578e-336c-43b3-bba7-c7f8e831ed17 tempest-VolumesActionsTest-916036654 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-7a88408f-49dd-4160-8266-5f5d3b294bfb" returned: 0 in 0.444s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:41:00 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ec21578e-336c-43b3-bba7-c7f8e831ed17 tempest-VolumesActionsTest-916036654 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-7a88408f-49dd-4160-8266-5f5d3b294bfb {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:41:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ec21578e-336c-43b3-bba7-c7f8e831ed17 tempest-VolumesActionsTest-916036654 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-7a88408f-49dd-4160-8266-5f5d3b294bfb" returned: 0 in 0.131s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:41:01 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-ec21578e-336c-43b3-bba7-c7f8e831ed17 tempest-VolumesActionsTest-916036654 None] Lock "cinder-quobyte-7a88408f-49dd-4160-8266-5f5d3b294bfb" released by "delete_volume" :: held 0.775s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:41:01 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-ec21578e-336c-43b3-bba7-c7f8e831ed17 tempest-VolumesActionsTest-916036654 None] Created reservations ['5d133373-c7ac-4cd5-96f2-7d975d61bd73', 'd3bf5484-5ec8-47d0-b288-b47c05dbe991', '4afb0651-ad7c-4af5-bf80-1b718b2bbc30', 'ca5647c9-0ff9-4061-b681-3be428aa52a1'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:41:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-ec21578e-336c-43b3-bba7-c7f8e831ed17 tempest-VolumesActionsTest-916036654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:41:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-ec21578e-336c-43b3-bba7-c7f8e831ed17 tempest-VolumesActionsTest-916036654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:41:01 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-ec21578e-336c-43b3-bba7-c7f8e831ed17 tempest-VolumesActionsTest-916036654 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:41:01 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-ec21578e-336c-43b3-bba7-c7f8e831ed17 tempest-VolumesActionsTest-916036654 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:41:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-ec21578e-336c-43b3-bba7-c7f8e831ed17 tempest-VolumesActionsTest-916036654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:41:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ec21578e-336c-43b3-bba7-c7f8e831ed17 tempest-VolumesActionsTest-916036654 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:41:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ec21578e-336c-43b3-bba7-c7f8e831ed17 tempest-VolumesActionsTest-916036654 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.114s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:41:01 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-ec21578e-336c-43b3-bba7-c7f8e831ed17 tempest-VolumesActionsTest-916036654 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:41:02 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-ec21578e-336c-43b3-bba7-c7f8e831ed17 tempest-VolumesActionsTest-916036654 None] Deleted volume successfully. Sep 10 21:41:02 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-ec21578e-336c-43b3-bba7-c7f8e831ed17 tempest-VolumesActionsTest-916036654 None] Lock "cinder-7a88408f-49dd-4160-8266-5f5d3b294bfb-delete_volume" released by "delete_volume" :: held 1.903s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:41:11 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-9d82e5f2-77a4-4ab6-9b2f-699b6fcb71ec tempest-VolumesActionsTest-916036654 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:41:11 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d82e5f2-77a4-4ab6-9b2f-699b6fcb71ec tempest-VolumesActionsTest-916036654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:41:11 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-9d82e5f2-77a4-4ab6-9b2f-699b6fcb71ec tempest-VolumesActionsTest-916036654 None] Flow 'volume_create_manager' (03ad5f14-d402-4c19-a5bc-2f100b057194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:41:11 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-9d82e5f2-77a4-4ab6-9b2f-699b6fcb71ec tempest-VolumesActionsTest-916036654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75298203-ecc7-424a-83d0-a1f59f5d907b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:41:11 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-9d82e5f2-77a4-4ab6-9b2f-699b6fcb71ec tempest-VolumesActionsTest-916036654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75298203-ecc7-424a-83d0-a1f59f5d907b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:41:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-559950654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b450c1e3-d174-4d3c-ba8f-f352bee7a868,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61072f025e8a40f5b1715023226c0593',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:41:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:41:11Z,use_quota=True,user_id='3b3a697e72a340e0b343914f5b890922',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:41:11 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-9d82e5f2-77a4-4ab6-9b2f-699b6fcb71ec tempest-VolumesActionsTest-916036654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79830b2e-e079-4935-ba2e-d4644ade06f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:41:11 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-9d82e5f2-77a4-4ab6-9b2f-699b6fcb71ec tempest-VolumesActionsTest-916036654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79830b2e-e079-4935-ba2e-d4644ade06f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:41:11 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-9d82e5f2-77a4-4ab6-9b2f-699b6fcb71ec tempest-VolumesActionsTest-916036654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea9c1792-6a2a-4035-ad65-9e71008d1ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:41:11 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-9d82e5f2-77a4-4ab6-9b2f-699b6fcb71ec tempest-VolumesActionsTest-916036654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea9c1792-6a2a-4035-ad65-9e71008d1ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b450c1e3-d174-4d3c-ba8f-f352bee7a868', 'volume_name': 'volume-b450c1e3-d174-4d3c-ba8f-f352bee7a868', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:41:11 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-9d82e5f2-77a4-4ab6-9b2f-699b6fcb71ec tempest-VolumesActionsTest-916036654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e75a4b6e-92d8-4112-bb0a-361e4a5bdd4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:41:11 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-9d82e5f2-77a4-4ab6-9b2f-699b6fcb71ec tempest-VolumesActionsTest-916036654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e75a4b6e-92d8-4112-bb0a-361e4a5bdd4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:41:11 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-9d82e5f2-77a4-4ab6-9b2f-699b6fcb71ec tempest-VolumesActionsTest-916036654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aede7f2d-4fc3-4e6e-a20c-9d4c3be08616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:41:11 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-9d82e5f2-77a4-4ab6-9b2f-699b6fcb71ec tempest-VolumesActionsTest-916036654 None] Volume b450c1e3-d174-4d3c-ba8f-f352bee7a868: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b450c1e3-d174-4d3c-ba8f-f352bee7a868', 'volume_size': 1} Sep 10 21:41:11 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-9d82e5f2-77a4-4ab6-9b2f-699b6fcb71ec tempest-VolumesActionsTest-916036654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:41:11 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-9d82e5f2-77a4-4ab6-9b2f-699b6fcb71ec tempest-VolumesActionsTest-916036654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:41:11 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-9d82e5f2-77a4-4ab6-9b2f-699b6fcb71ec tempest-VolumesActionsTest-916036654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:41:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-559950654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b450c1e3-d174-4d3c-ba8f-f352bee7a868,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61072f025e8a40f5b1715023226c0593',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:41:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:41:11Z,use_quota=True,user_id='3b3a697e72a340e0b343914f5b890922',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:41:11 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-9d82e5f2-77a4-4ab6-9b2f-699b6fcb71ec tempest-VolumesActionsTest-916036654 None] Creating volume b450c1e3-d174-4d3c-ba8f-f352bee7a868 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:41:11 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-9d82e5f2-77a4-4ab6-9b2f-699b6fcb71ec tempest-VolumesActionsTest-916036654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:41:11 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-9d82e5f2-77a4-4ab6-9b2f-699b6fcb71ec tempest-VolumesActionsTest-916036654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:41:11 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-9d82e5f2-77a4-4ab6-9b2f-699b6fcb71ec tempest-VolumesActionsTest-916036654 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:41:11 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-9d82e5f2-77a4-4ab6-9b2f-699b6fcb71ec tempest-VolumesActionsTest-916036654 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:41:11 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-9d82e5f2-77a4-4ab6-9b2f-699b6fcb71ec tempest-VolumesActionsTest-916036654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:41:11 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-9d82e5f2-77a4-4ab6-9b2f-699b6fcb71ec tempest-VolumesActionsTest-916036654 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:41:11 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-9d82e5f2-77a4-4ab6-9b2f-699b6fcb71ec tempest-VolumesActionsTest-916036654 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:41:11 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9d82e5f2-77a4-4ab6-9b2f-699b6fcb71ec tempest-VolumesActionsTest-916036654 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b450c1e3-d174-4d3c-ba8f-f352bee7a868 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:41:11 devstack quobyte-client[82807]: System call of process 100100 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:41:12 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=132, name=volume-b450c1e3-d174-4d3c-ba8f-f352bee7a868, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:41:12 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9d82e5f2-77a4-4ab6-9b2f-699b6fcb71ec tempest-VolumesActionsTest-916036654 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b450c1e3-d174-4d3c-ba8f-f352bee7a868 1073741824" returned: 0 in 0.388s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:41:12 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9d82e5f2-77a4-4ab6-9b2f-699b6fcb71ec tempest-VolumesActionsTest-916036654 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b450c1e3-d174-4d3c-ba8f-f352bee7a868 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:41:12 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9d82e5f2-77a4-4ab6-9b2f-699b6fcb71ec tempest-VolumesActionsTest-916036654 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b450c1e3-d174-4d3c-ba8f-f352bee7a868" returned: 0 in 0.079s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:41:12 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-9d82e5f2-77a4-4ab6-9b2f-699b6fcb71ec tempest-VolumesActionsTest-916036654 None] <== create_volume: return (540ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:41:12 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-9d82e5f2-77a4-4ab6-9b2f-699b6fcb71ec tempest-VolumesActionsTest-916036654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.553s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:41:12 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-9d82e5f2-77a4-4ab6-9b2f-699b6fcb71ec tempest-VolumesActionsTest-916036654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aede7f2d-4fc3-4e6e-a20c-9d4c3be08616) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b450c1e3-d174-4d3c-ba8f-f352bee7a868', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:41:12 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-9d82e5f2-77a4-4ab6-9b2f-699b6fcb71ec tempest-VolumesActionsTest-916036654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f78774a5-d112-45b4-8ea4-4fe142f2d9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:41:12 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-9d82e5f2-77a4-4ab6-9b2f-699b6fcb71ec tempest-VolumesActionsTest-916036654 None] Volume volume-b450c1e3-d174-4d3c-ba8f-f352bee7a868 (b450c1e3-d174-4d3c-ba8f-f352bee7a868): created successfully Sep 10 21:41:12 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-9d82e5f2-77a4-4ab6-9b2f-699b6fcb71ec tempest-VolumesActionsTest-916036654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f78774a5-d112-45b4-8ea4-4fe142f2d9fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:41:12 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-9d82e5f2-77a4-4ab6-9b2f-699b6fcb71ec tempest-VolumesActionsTest-916036654 None] Flow 'volume_create_manager' (03ad5f14-d402-4c19-a5bc-2f100b057194) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:41:12 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-9d82e5f2-77a4-4ab6-9b2f-699b6fcb71ec tempest-VolumesActionsTest-916036654 None] Created volume successfully. Sep 10 21:41:13 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-2303ac5b-3e26-4574-a346-01c479278baa tempest-VolumesActionsTest-1970135913 None] Acquiring lock "cinder-b450c1e3-d174-4d3c-ba8f-f352bee7a868-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:41:13 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-2303ac5b-3e26-4574-a346-01c479278baa tempest-VolumesActionsTest-1970135913 None] Lock "cinder-b450c1e3-d174-4d3c-ba8f-f352bee7a868-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:41:14 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-2303ac5b-3e26-4574-a346-01c479278baa tempest-VolumesActionsTest-1970135913 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:41:14 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-2303ac5b-3e26-4574-a346-01c479278baa tempest-VolumesActionsTest-1970135913 None] Acquiring lock "cinder-quobyte-b450c1e3-d174-4d3c-ba8f-f352bee7a868" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:41:14 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-2303ac5b-3e26-4574-a346-01c479278baa tempest-VolumesActionsTest-1970135913 None] Lock "cinder-quobyte-b450c1e3-d174-4d3c-ba8f-f352bee7a868" acquired by "delete_volume" :: waited 0.021s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:41:14 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29b26ec-e5b5-4b35-8194-8237e4431198]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:41:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-2303ac5b-3e26-4574-a346-01c479278baa tempest-VolumesActionsTest-1970135913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b450c1e3-d174-4d3c-ba8f-f352bee7a868 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:41:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-2303ac5b-3e26-4574-a346-01c479278baa tempest-VolumesActionsTest-1970135913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b450c1e3-d174-4d3c-ba8f-f352bee7a868" returned: 0 in 0.409s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:41:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-2303ac5b-3e26-4574-a346-01c479278baa tempest-VolumesActionsTest-1970135913 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b450c1e3-d174-4d3c-ba8f-f352bee7a868 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:41:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-2303ac5b-3e26-4574-a346-01c479278baa tempest-VolumesActionsTest-1970135913 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b450c1e3-d174-4d3c-ba8f-f352bee7a868" returned: 0 in 0.135s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:41:14 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-2303ac5b-3e26-4574-a346-01c479278baa tempest-VolumesActionsTest-1970135913 None] Lock "cinder-quobyte-b450c1e3-d174-4d3c-ba8f-f352bee7a868" released by "delete_volume" :: held 0.696s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:41:15 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-2303ac5b-3e26-4574-a346-01c479278baa tempest-VolumesActionsTest-1970135913 None] Created reservations ['6235bf01-07e4-4c56-9fab-a7063e8701a8', '8bda1117-d4c6-4b4d-bbbf-1778b78b1e0a', 'f2d7d5d3-5851-40fd-90b6-22124d254588', 'c1ff2389-0500-4a3b-8cda-adad7a4a74a9'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:41:15 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-2303ac5b-3e26-4574-a346-01c479278baa tempest-VolumesActionsTest-1970135913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:41:15 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-2303ac5b-3e26-4574-a346-01c479278baa tempest-VolumesActionsTest-1970135913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:41:15 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-2303ac5b-3e26-4574-a346-01c479278baa tempest-VolumesActionsTest-1970135913 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:41:15 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-2303ac5b-3e26-4574-a346-01c479278baa tempest-VolumesActionsTest-1970135913 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:41:15 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-2303ac5b-3e26-4574-a346-01c479278baa tempest-VolumesActionsTest-1970135913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:41:15 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-2303ac5b-3e26-4574-a346-01c479278baa tempest-VolumesActionsTest-1970135913 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:41:15 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-2303ac5b-3e26-4574-a346-01c479278baa tempest-VolumesActionsTest-1970135913 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.090s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:41:15 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-2303ac5b-3e26-4574-a346-01c479278baa tempest-VolumesActionsTest-1970135913 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:41:15 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-2303ac5b-3e26-4574-a346-01c479278baa tempest-VolumesActionsTest-1970135913 None] Deleted volume successfully. Sep 10 21:41:15 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-2303ac5b-3e26-4574-a346-01c479278baa tempest-VolumesActionsTest-1970135913 None] Lock "cinder-b450c1e3-d174-4d3c-ba8f-f352bee7a868-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:41:17 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-39b47dd5-6578-4bde-99ae-1f4acf650d5b tempest-VolumesActionsTest-916036654 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:41:17 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-39b47dd5-6578-4bde-99ae-1f4acf650d5b tempest-VolumesActionsTest-916036654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:41:17 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-39b47dd5-6578-4bde-99ae-1f4acf650d5b tempest-VolumesActionsTest-916036654 None] Flow 'volume_create_manager' (dadd6770-3130-40ef-8f00-24cfaf412158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:41:17 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-39b47dd5-6578-4bde-99ae-1f4acf650d5b tempest-VolumesActionsTest-916036654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98db7fcf-34f3-43b0-876b-7168363d99d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:41:17 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-39b47dd5-6578-4bde-99ae-1f4acf650d5b tempest-VolumesActionsTest-916036654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98db7fcf-34f3-43b0-876b-7168363d99d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:41:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1369127083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caad97aa-2b67-4a6a-b227-6db69516c689,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61072f025e8a40f5b1715023226c0593',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:41:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:41:17Z,use_quota=True,user_id='3b3a697e72a340e0b343914f5b890922',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:41:17 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-39b47dd5-6578-4bde-99ae-1f4acf650d5b tempest-VolumesActionsTest-916036654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6adde74-9d85-45eb-9108-2beeff0dd74a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:41:17 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-39b47dd5-6578-4bde-99ae-1f4acf650d5b tempest-VolumesActionsTest-916036654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6adde74-9d85-45eb-9108-2beeff0dd74a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:41:17 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-39b47dd5-6578-4bde-99ae-1f4acf650d5b tempest-VolumesActionsTest-916036654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13298cc7-9e10-4942-a8f0-550774fed7d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:41:17 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-39b47dd5-6578-4bde-99ae-1f4acf650d5b tempest-VolumesActionsTest-916036654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13298cc7-9e10-4942-a8f0-550774fed7d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'caad97aa-2b67-4a6a-b227-6db69516c689', 'volume_name': 'volume-caad97aa-2b67-4a6a-b227-6db69516c689', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:41:17 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-39b47dd5-6578-4bde-99ae-1f4acf650d5b tempest-VolumesActionsTest-916036654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8f2dc11-b430-4f3b-8c11-f7e4fd6432ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:41:17 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-39b47dd5-6578-4bde-99ae-1f4acf650d5b tempest-VolumesActionsTest-916036654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8f2dc11-b430-4f3b-8c11-f7e4fd6432ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:41:17 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-39b47dd5-6578-4bde-99ae-1f4acf650d5b tempest-VolumesActionsTest-916036654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21494435-deff-4483-9212-5e6dccefdfe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:41:17 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-39b47dd5-6578-4bde-99ae-1f4acf650d5b tempest-VolumesActionsTest-916036654 None] Volume caad97aa-2b67-4a6a-b227-6db69516c689: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-caad97aa-2b67-4a6a-b227-6db69516c689', 'volume_size': 1} Sep 10 21:41:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-39b47dd5-6578-4bde-99ae-1f4acf650d5b tempest-VolumesActionsTest-916036654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:41:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-39b47dd5-6578-4bde-99ae-1f4acf650d5b tempest-VolumesActionsTest-916036654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:41:17 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-39b47dd5-6578-4bde-99ae-1f4acf650d5b tempest-VolumesActionsTest-916036654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:41:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1369127083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caad97aa-2b67-4a6a-b227-6db69516c689,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61072f025e8a40f5b1715023226c0593',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:41:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:41:17Z,use_quota=True,user_id='3b3a697e72a340e0b343914f5b890922',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:41:17 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-39b47dd5-6578-4bde-99ae-1f4acf650d5b tempest-VolumesActionsTest-916036654 None] Creating volume caad97aa-2b67-4a6a-b227-6db69516c689 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:41:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-39b47dd5-6578-4bde-99ae-1f4acf650d5b tempest-VolumesActionsTest-916036654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:41:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-39b47dd5-6578-4bde-99ae-1f4acf650d5b tempest-VolumesActionsTest-916036654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:41:17 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-39b47dd5-6578-4bde-99ae-1f4acf650d5b tempest-VolumesActionsTest-916036654 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:41:17 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-39b47dd5-6578-4bde-99ae-1f4acf650d5b tempest-VolumesActionsTest-916036654 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:41:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-39b47dd5-6578-4bde-99ae-1f4acf650d5b tempest-VolumesActionsTest-916036654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:41:17 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-39b47dd5-6578-4bde-99ae-1f4acf650d5b tempest-VolumesActionsTest-916036654 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:41:17 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-39b47dd5-6578-4bde-99ae-1f4acf650d5b tempest-VolumesActionsTest-916036654 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:41:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-39b47dd5-6578-4bde-99ae-1f4acf650d5b tempest-VolumesActionsTest-916036654 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-caad97aa-2b67-4a6a-b227-6db69516c689 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:41:17 devstack quobyte-client[82807]: System call of process 100109 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:41:17 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=133, name=volume-caad97aa-2b67-4a6a-b227-6db69516c689, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:41:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-39b47dd5-6578-4bde-99ae-1f4acf650d5b tempest-VolumesActionsTest-916036654 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-caad97aa-2b67-4a6a-b227-6db69516c689 1073741824" returned: 0 in 0.341s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:41:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-39b47dd5-6578-4bde-99ae-1f4acf650d5b tempest-VolumesActionsTest-916036654 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-caad97aa-2b67-4a6a-b227-6db69516c689 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:41:18 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-39b47dd5-6578-4bde-99ae-1f4acf650d5b tempest-VolumesActionsTest-916036654 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-caad97aa-2b67-4a6a-b227-6db69516c689" returned: 0 in 0.090s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:41:18 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-39b47dd5-6578-4bde-99ae-1f4acf650d5b tempest-VolumesActionsTest-916036654 None] <== create_volume: return (509ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:41:18 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-39b47dd5-6578-4bde-99ae-1f4acf650d5b tempest-VolumesActionsTest-916036654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.523s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:41:18 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-39b47dd5-6578-4bde-99ae-1f4acf650d5b tempest-VolumesActionsTest-916036654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21494435-deff-4483-9212-5e6dccefdfe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-caad97aa-2b67-4a6a-b227-6db69516c689', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:41:18 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-39b47dd5-6578-4bde-99ae-1f4acf650d5b tempest-VolumesActionsTest-916036654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cc042a5-17fe-4028-9527-b01a0450e749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:41:18 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-39b47dd5-6578-4bde-99ae-1f4acf650d5b tempest-VolumesActionsTest-916036654 None] Volume volume-caad97aa-2b67-4a6a-b227-6db69516c689 (caad97aa-2b67-4a6a-b227-6db69516c689): created successfully Sep 10 21:41:18 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-39b47dd5-6578-4bde-99ae-1f4acf650d5b tempest-VolumesActionsTest-916036654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cc042a5-17fe-4028-9527-b01a0450e749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:41:18 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-39b47dd5-6578-4bde-99ae-1f4acf650d5b tempest-VolumesActionsTest-916036654 None] Flow 'volume_create_manager' (dadd6770-3130-40ef-8f00-24cfaf412158) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:41:18 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-39b47dd5-6578-4bde-99ae-1f4acf650d5b tempest-VolumesActionsTest-916036654 None] Created volume successfully. Sep 10 21:41:19 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-49105044-80eb-45e2-b91f-0d4be89cd060 tempest-VolumesActionsTest-1970135913 None] Acquiring lock "cinder-caad97aa-2b67-4a6a-b227-6db69516c689-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:41:19 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-49105044-80eb-45e2-b91f-0d4be89cd060 tempest-VolumesActionsTest-1970135913 None] Lock "cinder-caad97aa-2b67-4a6a-b227-6db69516c689-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:41:19 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-49105044-80eb-45e2-b91f-0d4be89cd060 tempest-VolumesActionsTest-1970135913 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:41:19 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-49105044-80eb-45e2-b91f-0d4be89cd060 tempest-VolumesActionsTest-1970135913 None] Acquiring lock "cinder-quobyte-caad97aa-2b67-4a6a-b227-6db69516c689" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:41:19 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-49105044-80eb-45e2-b91f-0d4be89cd060 tempest-VolumesActionsTest-1970135913 None] Lock "cinder-quobyte-caad97aa-2b67-4a6a-b227-6db69516c689" acquired by "delete_volume" :: waited 0.011s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:41:19 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7ba4e5-b9fa-457a-903e-4ba471a3b6ec]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:41:19 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-49105044-80eb-45e2-b91f-0d4be89cd060 tempest-VolumesActionsTest-1970135913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-caad97aa-2b67-4a6a-b227-6db69516c689 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:41:20 devstack quobyte-client[82807]: System call of process 100114 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:41:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-49105044-80eb-45e2-b91f-0d4be89cd060 tempest-VolumesActionsTest-1970135913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-caad97aa-2b67-4a6a-b227-6db69516c689" returned: 0 in 0.441s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:41:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-49105044-80eb-45e2-b91f-0d4be89cd060 tempest-VolumesActionsTest-1970135913 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-caad97aa-2b67-4a6a-b227-6db69516c689 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:41:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-49105044-80eb-45e2-b91f-0d4be89cd060 tempest-VolumesActionsTest-1970135913 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-caad97aa-2b67-4a6a-b227-6db69516c689" returned: 0 in 0.104s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:41:20 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-49105044-80eb-45e2-b91f-0d4be89cd060 tempest-VolumesActionsTest-1970135913 None] Lock "cinder-quobyte-caad97aa-2b67-4a6a-b227-6db69516c689" released by "delete_volume" :: held 0.717s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:41:20 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-49105044-80eb-45e2-b91f-0d4be89cd060 tempest-VolumesActionsTest-1970135913 None] Created reservations ['a794ce55-5140-4e22-9649-99c4e0e911cd', '800b9d98-075b-4d04-ac47-6481be8db22f', 'a2771e67-7155-49ef-8ece-fa167b80e30d', '05dfbf4d-8a12-48ea-982b-73c41ba6d7a6'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:41:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-49105044-80eb-45e2-b91f-0d4be89cd060 tempest-VolumesActionsTest-1970135913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:41:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-49105044-80eb-45e2-b91f-0d4be89cd060 tempest-VolumesActionsTest-1970135913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:41:21 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-49105044-80eb-45e2-b91f-0d4be89cd060 tempest-VolumesActionsTest-1970135913 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:41:21 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-49105044-80eb-45e2-b91f-0d4be89cd060 tempest-VolumesActionsTest-1970135913 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:41:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-49105044-80eb-45e2-b91f-0d4be89cd060 tempest-VolumesActionsTest-1970135913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:41:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-49105044-80eb-45e2-b91f-0d4be89cd060 tempest-VolumesActionsTest-1970135913 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:41:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-49105044-80eb-45e2-b91f-0d4be89cd060 tempest-VolumesActionsTest-1970135913 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.096s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:41:21 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-49105044-80eb-45e2-b91f-0d4be89cd060 tempest-VolumesActionsTest-1970135913 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:41:21 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-49105044-80eb-45e2-b91f-0d4be89cd060 tempest-VolumesActionsTest-1970135913 None] Deleted volume successfully. Sep 10 21:41:21 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-49105044-80eb-45e2-b91f-0d4be89cd060 tempest-VolumesActionsTest-1970135913 None] Lock "cinder-caad97aa-2b67-4a6a-b227-6db69516c689-delete_volume" released by "delete_volume" :: held 1.774s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:41:22 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-49b0a4ee-062b-4f62-a0e2-eb3a1d614979 tempest-VolumesActionsTest-916036654 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:41:22 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-49b0a4ee-062b-4f62-a0e2-eb3a1d614979 tempest-VolumesActionsTest-916036654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:41:22 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-49b0a4ee-062b-4f62-a0e2-eb3a1d614979 tempest-VolumesActionsTest-916036654 None] Flow 'volume_create_manager' (3690f602-3416-431b-99ee-0652963d7518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:41:22 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-49b0a4ee-062b-4f62-a0e2-eb3a1d614979 tempest-VolumesActionsTest-916036654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c4dd78c-3db8-41ef-b100-e4ca04ac7a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:41:22 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-49b0a4ee-062b-4f62-a0e2-eb3a1d614979 tempest-VolumesActionsTest-916036654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c4dd78c-3db8-41ef-b100-e4ca04ac7a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:41:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-561448348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b26cc0b-8f8a-45b6-b3b5-1f66a18b0040,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61072f025e8a40f5b1715023226c0593',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:41:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:41:22Z,use_quota=True,user_id='3b3a697e72a340e0b343914f5b890922',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:41:22 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-49b0a4ee-062b-4f62-a0e2-eb3a1d614979 tempest-VolumesActionsTest-916036654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d20d923f-7064-4d87-9444-99fb38925264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:41:22 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-49b0a4ee-062b-4f62-a0e2-eb3a1d614979 tempest-VolumesActionsTest-916036654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d20d923f-7064-4d87-9444-99fb38925264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:41:22 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-49b0a4ee-062b-4f62-a0e2-eb3a1d614979 tempest-VolumesActionsTest-916036654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14ab5d07-c9b4-4975-91be-dbda9e58a2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:41:22 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-49b0a4ee-062b-4f62-a0e2-eb3a1d614979 tempest-VolumesActionsTest-916036654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14ab5d07-c9b4-4975-91be-dbda9e58a2b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b26cc0b-8f8a-45b6-b3b5-1f66a18b0040', 'volume_name': 'volume-4b26cc0b-8f8a-45b6-b3b5-1f66a18b0040', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:41:22 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-49b0a4ee-062b-4f62-a0e2-eb3a1d614979 tempest-VolumesActionsTest-916036654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ee77de0-5d47-4d24-84a6-897bd6115a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:41:22 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-49b0a4ee-062b-4f62-a0e2-eb3a1d614979 tempest-VolumesActionsTest-916036654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ee77de0-5d47-4d24-84a6-897bd6115a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:41:22 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-49b0a4ee-062b-4f62-a0e2-eb3a1d614979 tempest-VolumesActionsTest-916036654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0920e5dd-0c1d-4a26-9c0a-f155c959171c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:41:22 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-49b0a4ee-062b-4f62-a0e2-eb3a1d614979 tempest-VolumesActionsTest-916036654 None] Volume 4b26cc0b-8f8a-45b6-b3b5-1f66a18b0040: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b26cc0b-8f8a-45b6-b3b5-1f66a18b0040', 'volume_size': 1} Sep 10 21:41:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-49b0a4ee-062b-4f62-a0e2-eb3a1d614979 tempest-VolumesActionsTest-916036654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:41:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-49b0a4ee-062b-4f62-a0e2-eb3a1d614979 tempest-VolumesActionsTest-916036654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:41:22 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-49b0a4ee-062b-4f62-a0e2-eb3a1d614979 tempest-VolumesActionsTest-916036654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:41:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-561448348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b26cc0b-8f8a-45b6-b3b5-1f66a18b0040,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61072f025e8a40f5b1715023226c0593',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:41:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:41:22Z,use_quota=True,user_id='3b3a697e72a340e0b343914f5b890922',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:41:22 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-49b0a4ee-062b-4f62-a0e2-eb3a1d614979 tempest-VolumesActionsTest-916036654 None] Creating volume 4b26cc0b-8f8a-45b6-b3b5-1f66a18b0040 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:41:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-49b0a4ee-062b-4f62-a0e2-eb3a1d614979 tempest-VolumesActionsTest-916036654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:41:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-49b0a4ee-062b-4f62-a0e2-eb3a1d614979 tempest-VolumesActionsTest-916036654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:41:22 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-49b0a4ee-062b-4f62-a0e2-eb3a1d614979 tempest-VolumesActionsTest-916036654 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:41:22 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-49b0a4ee-062b-4f62-a0e2-eb3a1d614979 tempest-VolumesActionsTest-916036654 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:41:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-49b0a4ee-062b-4f62-a0e2-eb3a1d614979 tempest-VolumesActionsTest-916036654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:41:22 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-49b0a4ee-062b-4f62-a0e2-eb3a1d614979 tempest-VolumesActionsTest-916036654 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:41:22 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-49b0a4ee-062b-4f62-a0e2-eb3a1d614979 tempest-VolumesActionsTest-916036654 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:41:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-49b0a4ee-062b-4f62-a0e2-eb3a1d614979 tempest-VolumesActionsTest-916036654 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-4b26cc0b-8f8a-45b6-b3b5-1f66a18b0040 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:41:22 devstack quobyte-client[82807]: System call of process 100119 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:41:22 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=134, name=volume-4b26cc0b-8f8a-45b6-b3b5-1f66a18b0040, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:41:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-49b0a4ee-062b-4f62-a0e2-eb3a1d614979 tempest-VolumesActionsTest-916036654 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-4b26cc0b-8f8a-45b6-b3b5-1f66a18b0040 1073741824" returned: 0 in 0.407s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:41:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-49b0a4ee-062b-4f62-a0e2-eb3a1d614979 tempest-VolumesActionsTest-916036654 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-4b26cc0b-8f8a-45b6-b3b5-1f66a18b0040 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:41:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-49b0a4ee-062b-4f62-a0e2-eb3a1d614979 tempest-VolumesActionsTest-916036654 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-4b26cc0b-8f8a-45b6-b3b5-1f66a18b0040" returned: 0 in 0.114s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:41:23 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-49b0a4ee-062b-4f62-a0e2-eb3a1d614979 tempest-VolumesActionsTest-916036654 None] <== create_volume: return (614ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:41:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-49b0a4ee-062b-4f62-a0e2-eb3a1d614979 tempest-VolumesActionsTest-916036654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.626s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:41:23 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-49b0a4ee-062b-4f62-a0e2-eb3a1d614979 tempest-VolumesActionsTest-916036654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0920e5dd-0c1d-4a26-9c0a-f155c959171c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b26cc0b-8f8a-45b6-b3b5-1f66a18b0040', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:41:23 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-49b0a4ee-062b-4f62-a0e2-eb3a1d614979 tempest-VolumesActionsTest-916036654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37f90f54-923c-42d2-afc0-02736d14ce02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:41:23 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-49b0a4ee-062b-4f62-a0e2-eb3a1d614979 tempest-VolumesActionsTest-916036654 None] Volume volume-4b26cc0b-8f8a-45b6-b3b5-1f66a18b0040 (4b26cc0b-8f8a-45b6-b3b5-1f66a18b0040): created successfully Sep 10 21:41:23 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-49b0a4ee-062b-4f62-a0e2-eb3a1d614979 tempest-VolumesActionsTest-916036654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37f90f54-923c-42d2-afc0-02736d14ce02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:41:23 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-49b0a4ee-062b-4f62-a0e2-eb3a1d614979 tempest-VolumesActionsTest-916036654 None] Flow 'volume_create_manager' (3690f602-3416-431b-99ee-0652963d7518) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:41:23 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-49b0a4ee-062b-4f62-a0e2-eb3a1d614979 tempest-VolumesActionsTest-916036654 None] Created volume successfully. Sep 10 21:41:24 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-16996670-2b08-400c-8ab0-c12879beecb8 tempest-VolumesActionsTest-1970135913 None] Acquiring lock "cinder-4b26cc0b-8f8a-45b6-b3b5-1f66a18b0040-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:41:25 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-16996670-2b08-400c-8ab0-c12879beecb8 tempest-VolumesActionsTest-1970135913 None] Lock "cinder-4b26cc0b-8f8a-45b6-b3b5-1f66a18b0040-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:41:25 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-16996670-2b08-400c-8ab0-c12879beecb8 tempest-VolumesActionsTest-1970135913 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:41:25 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-16996670-2b08-400c-8ab0-c12879beecb8 tempest-VolumesActionsTest-1970135913 None] Acquiring lock "cinder-quobyte-4b26cc0b-8f8a-45b6-b3b5-1f66a18b0040" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:41:25 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-16996670-2b08-400c-8ab0-c12879beecb8 tempest-VolumesActionsTest-1970135913 None] Lock "cinder-quobyte-4b26cc0b-8f8a-45b6-b3b5-1f66a18b0040" acquired by "delete_volume" :: waited 0.016s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:41:25 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c4fef2f-e19d-42e3-a1c4-c74314de72a1]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:41:25 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-16996670-2b08-400c-8ab0-c12879beecb8 tempest-VolumesActionsTest-1970135913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-4b26cc0b-8f8a-45b6-b3b5-1f66a18b0040 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:41:25 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-16996670-2b08-400c-8ab0-c12879beecb8 tempest-VolumesActionsTest-1970135913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-4b26cc0b-8f8a-45b6-b3b5-1f66a18b0040" returned: 0 in 0.429s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:41:25 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-16996670-2b08-400c-8ab0-c12879beecb8 tempest-VolumesActionsTest-1970135913 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-4b26cc0b-8f8a-45b6-b3b5-1f66a18b0040 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:41:25 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-16996670-2b08-400c-8ab0-c12879beecb8 tempest-VolumesActionsTest-1970135913 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-4b26cc0b-8f8a-45b6-b3b5-1f66a18b0040" returned: 0 in 0.105s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:41:25 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-16996670-2b08-400c-8ab0-c12879beecb8 tempest-VolumesActionsTest-1970135913 None] Lock "cinder-quobyte-4b26cc0b-8f8a-45b6-b3b5-1f66a18b0040" released by "delete_volume" :: held 0.690s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:41:26 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-16996670-2b08-400c-8ab0-c12879beecb8 tempest-VolumesActionsTest-1970135913 None] Created reservations ['5c61b6b1-92d0-4692-80cd-29f5cc9d3314', '082b0928-9e6d-4160-b529-20243239ed58', '1d3fe7f7-0835-418a-8a0d-345d7405767d', 'fd46e419-69e9-4508-b2c8-de6c162d0114'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:41:26 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-16996670-2b08-400c-8ab0-c12879beecb8 tempest-VolumesActionsTest-1970135913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:41:26 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-16996670-2b08-400c-8ab0-c12879beecb8 tempest-VolumesActionsTest-1970135913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:41:26 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-16996670-2b08-400c-8ab0-c12879beecb8 tempest-VolumesActionsTest-1970135913 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:41:26 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-16996670-2b08-400c-8ab0-c12879beecb8 tempest-VolumesActionsTest-1970135913 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:41:26 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-16996670-2b08-400c-8ab0-c12879beecb8 tempest-VolumesActionsTest-1970135913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:41:26 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-16996670-2b08-400c-8ab0-c12879beecb8 tempest-VolumesActionsTest-1970135913 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:41:26 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-16996670-2b08-400c-8ab0-c12879beecb8 tempest-VolumesActionsTest-1970135913 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.094s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:41:26 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-16996670-2b08-400c-8ab0-c12879beecb8 tempest-VolumesActionsTest-1970135913 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:41:26 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-16996670-2b08-400c-8ab0-c12879beecb8 tempest-VolumesActionsTest-1970135913 None] Deleted volume successfully. Sep 10 21:41:26 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-16996670-2b08-400c-8ab0-c12879beecb8 tempest-VolumesActionsTest-1970135913 None] Lock "cinder-4b26cc0b-8f8a-45b6-b3b5-1f66a18b0040-delete_volume" released by "delete_volume" :: held 1.723s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:41:27 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-a3f13f3c-91fa-466c-ba40-210c0fd22b6b tempest-VolumesActionsTest-916036654 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:41:27 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3f13f3c-91fa-466c-ba40-210c0fd22b6b tempest-VolumesActionsTest-916036654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:41:27 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-a3f13f3c-91fa-466c-ba40-210c0fd22b6b tempest-VolumesActionsTest-916036654 None] Flow 'volume_create_manager' (e80f5192-4d11-4d3d-9d80-dec6c9450e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:41:27 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-a3f13f3c-91fa-466c-ba40-210c0fd22b6b tempest-VolumesActionsTest-916036654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8135cdf6-b50e-4705-8ea1-75b394f05cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:41:27 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-a3f13f3c-91fa-466c-ba40-210c0fd22b6b tempest-VolumesActionsTest-916036654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8135cdf6-b50e-4705-8ea1-75b394f05cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-498023071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=954cda0c-7c1b-44a0-bc83-2aba9c9d165a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61072f025e8a40f5b1715023226c0593',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:41:28Z,use_quota=True,user_id='3b3a697e72a340e0b343914f5b890922',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:41:28 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-a3f13f3c-91fa-466c-ba40-210c0fd22b6b tempest-VolumesActionsTest-916036654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54b20f3b-44ce-4cb2-b21c-f0435802f475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:41:28 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-a3f13f3c-91fa-466c-ba40-210c0fd22b6b tempest-VolumesActionsTest-916036654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54b20f3b-44ce-4cb2-b21c-f0435802f475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:41:28 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-a3f13f3c-91fa-466c-ba40-210c0fd22b6b tempest-VolumesActionsTest-916036654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aedc1730-0332-446f-bea5-1ea058823708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:41:28 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-a3f13f3c-91fa-466c-ba40-210c0fd22b6b tempest-VolumesActionsTest-916036654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aedc1730-0332-446f-bea5-1ea058823708) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '954cda0c-7c1b-44a0-bc83-2aba9c9d165a', 'volume_name': 'volume-954cda0c-7c1b-44a0-bc83-2aba9c9d165a', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:41:28 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-a3f13f3c-91fa-466c-ba40-210c0fd22b6b tempest-VolumesActionsTest-916036654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a3b730b-1b53-433e-a1f7-bb87945902e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:41:28 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-a3f13f3c-91fa-466c-ba40-210c0fd22b6b tempest-VolumesActionsTest-916036654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a3b730b-1b53-433e-a1f7-bb87945902e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:41:28 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-a3f13f3c-91fa-466c-ba40-210c0fd22b6b tempest-VolumesActionsTest-916036654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f269fb23-0ab8-4121-96c3-706a4404f5d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:41:28 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-a3f13f3c-91fa-466c-ba40-210c0fd22b6b tempest-VolumesActionsTest-916036654 None] Volume 954cda0c-7c1b-44a0-bc83-2aba9c9d165a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-954cda0c-7c1b-44a0-bc83-2aba9c9d165a', 'volume_size': 1} Sep 10 21:41:28 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a3f13f3c-91fa-466c-ba40-210c0fd22b6b tempest-VolumesActionsTest-916036654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:41:28 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a3f13f3c-91fa-466c-ba40-210c0fd22b6b tempest-VolumesActionsTest-916036654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:41:28 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a3f13f3c-91fa-466c-ba40-210c0fd22b6b tempest-VolumesActionsTest-916036654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-498023071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=954cda0c-7c1b-44a0-bc83-2aba9c9d165a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61072f025e8a40f5b1715023226c0593',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:41:28Z,use_quota=True,user_id='3b3a697e72a340e0b343914f5b890922',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:41:28 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-a3f13f3c-91fa-466c-ba40-210c0fd22b6b tempest-VolumesActionsTest-916036654 None] Creating volume 954cda0c-7c1b-44a0-bc83-2aba9c9d165a {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:41:28 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a3f13f3c-91fa-466c-ba40-210c0fd22b6b tempest-VolumesActionsTest-916036654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:41:28 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a3f13f3c-91fa-466c-ba40-210c0fd22b6b tempest-VolumesActionsTest-916036654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:41:28 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a3f13f3c-91fa-466c-ba40-210c0fd22b6b tempest-VolumesActionsTest-916036654 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:41:28 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a3f13f3c-91fa-466c-ba40-210c0fd22b6b tempest-VolumesActionsTest-916036654 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:41:28 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a3f13f3c-91fa-466c-ba40-210c0fd22b6b tempest-VolumesActionsTest-916036654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:41:28 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a3f13f3c-91fa-466c-ba40-210c0fd22b6b tempest-VolumesActionsTest-916036654 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:41:28 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-a3f13f3c-91fa-466c-ba40-210c0fd22b6b tempest-VolumesActionsTest-916036654 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:41:28 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a3f13f3c-91fa-466c-ba40-210c0fd22b6b tempest-VolumesActionsTest-916036654 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-954cda0c-7c1b-44a0-bc83-2aba9c9d165a 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:41:28 devstack quobyte-client[82807]: System call of process 100128 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:41:28 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=135, name=volume-954cda0c-7c1b-44a0-bc83-2aba9c9d165a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:41:28 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a3f13f3c-91fa-466c-ba40-210c0fd22b6b tempest-VolumesActionsTest-916036654 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-954cda0c-7c1b-44a0-bc83-2aba9c9d165a 1073741824" returned: 0 in 0.348s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:41:28 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a3f13f3c-91fa-466c-ba40-210c0fd22b6b tempest-VolumesActionsTest-916036654 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-954cda0c-7c1b-44a0-bc83-2aba9c9d165a {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:41:28 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a3f13f3c-91fa-466c-ba40-210c0fd22b6b tempest-VolumesActionsTest-916036654 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-954cda0c-7c1b-44a0-bc83-2aba9c9d165a" returned: 0 in 0.088s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:41:28 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a3f13f3c-91fa-466c-ba40-210c0fd22b6b tempest-VolumesActionsTest-916036654 None] <== create_volume: return (511ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:41:28 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a3f13f3c-91fa-466c-ba40-210c0fd22b6b tempest-VolumesActionsTest-916036654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.526s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:41:28 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-a3f13f3c-91fa-466c-ba40-210c0fd22b6b tempest-VolumesActionsTest-916036654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f269fb23-0ab8-4121-96c3-706a4404f5d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-954cda0c-7c1b-44a0-bc83-2aba9c9d165a', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:41:28 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-a3f13f3c-91fa-466c-ba40-210c0fd22b6b tempest-VolumesActionsTest-916036654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c0fad3e-46ba-431b-b553-eca57a86e0a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:41:28 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-a3f13f3c-91fa-466c-ba40-210c0fd22b6b tempest-VolumesActionsTest-916036654 None] Volume volume-954cda0c-7c1b-44a0-bc83-2aba9c9d165a (954cda0c-7c1b-44a0-bc83-2aba9c9d165a): created successfully Sep 10 21:41:28 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-a3f13f3c-91fa-466c-ba40-210c0fd22b6b tempest-VolumesActionsTest-916036654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c0fad3e-46ba-431b-b553-eca57a86e0a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:41:28 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-a3f13f3c-91fa-466c-ba40-210c0fd22b6b tempest-VolumesActionsTest-916036654 None] Flow 'volume_create_manager' (e80f5192-4d11-4d3d-9d80-dec6c9450e9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:41:28 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-a3f13f3c-91fa-466c-ba40-210c0fd22b6b tempest-VolumesActionsTest-916036654 None] Created volume successfully. Sep 10 21:41:30 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-e8383815-7518-47ed-a3c7-d41f46439183 tempest-VolumesActionsTest-1970135913 None] Acquiring lock "cinder-954cda0c-7c1b-44a0-bc83-2aba9c9d165a-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:41:30 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-e8383815-7518-47ed-a3c7-d41f46439183 tempest-VolumesActionsTest-1970135913 None] Lock "cinder-954cda0c-7c1b-44a0-bc83-2aba9c9d165a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:41:30 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-e8383815-7518-47ed-a3c7-d41f46439183 tempest-VolumesActionsTest-1970135913 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:41:30 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-e8383815-7518-47ed-a3c7-d41f46439183 tempest-VolumesActionsTest-1970135913 None] Acquiring lock "cinder-quobyte-954cda0c-7c1b-44a0-bc83-2aba9c9d165a" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:41:30 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-e8383815-7518-47ed-a3c7-d41f46439183 tempest-VolumesActionsTest-1970135913 None] Lock "cinder-quobyte-954cda0c-7c1b-44a0-bc83-2aba9c9d165a" acquired by "delete_volume" :: waited 0.022s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:41:30 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b834db-5a26-49d8-8326-34f3f8aca971]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:41:30 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e8383815-7518-47ed-a3c7-d41f46439183 tempest-VolumesActionsTest-1970135913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-954cda0c-7c1b-44a0-bc83-2aba9c9d165a {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:41:30 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e8383815-7518-47ed-a3c7-d41f46439183 tempest-VolumesActionsTest-1970135913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-954cda0c-7c1b-44a0-bc83-2aba9c9d165a" returned: 0 in 0.419s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:41:30 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e8383815-7518-47ed-a3c7-d41f46439183 tempest-VolumesActionsTest-1970135913 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-954cda0c-7c1b-44a0-bc83-2aba9c9d165a {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:41:30 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e8383815-7518-47ed-a3c7-d41f46439183 tempest-VolumesActionsTest-1970135913 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-954cda0c-7c1b-44a0-bc83-2aba9c9d165a" returned: 0 in 0.089s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:41:31 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-e8383815-7518-47ed-a3c7-d41f46439183 tempest-VolumesActionsTest-1970135913 None] Lock "cinder-quobyte-954cda0c-7c1b-44a0-bc83-2aba9c9d165a" released by "delete_volume" :: held 0.691s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:41:31 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-e8383815-7518-47ed-a3c7-d41f46439183 tempest-VolumesActionsTest-1970135913 None] Created reservations ['40688a06-5858-4751-9222-3169e5b4474d', 'cdf4296c-52f4-41ee-b4ed-c5a17f1d30fe', '97d75b76-d364-4cbb-962e-0b73a82531e0', 'e0514aa8-3ade-4992-92e9-6517fdfa54ef'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:41:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-e8383815-7518-47ed-a3c7-d41f46439183 tempest-VolumesActionsTest-1970135913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:41:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-e8383815-7518-47ed-a3c7-d41f46439183 tempest-VolumesActionsTest-1970135913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:41:31 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-e8383815-7518-47ed-a3c7-d41f46439183 tempest-VolumesActionsTest-1970135913 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:41:31 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-e8383815-7518-47ed-a3c7-d41f46439183 tempest-VolumesActionsTest-1970135913 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:41:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-e8383815-7518-47ed-a3c7-d41f46439183 tempest-VolumesActionsTest-1970135913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:41:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e8383815-7518-47ed-a3c7-d41f46439183 tempest-VolumesActionsTest-1970135913 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:41:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e8383815-7518-47ed-a3c7-d41f46439183 tempest-VolumesActionsTest-1970135913 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.083s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:41:31 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-e8383815-7518-47ed-a3c7-d41f46439183 tempest-VolumesActionsTest-1970135913 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:41:31 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-e8383815-7518-47ed-a3c7-d41f46439183 tempest-VolumesActionsTest-1970135913 None] Deleted volume successfully. Sep 10 21:41:31 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-e8383815-7518-47ed-a3c7-d41f46439183 tempest-VolumesActionsTest-1970135913 None] Lock "cinder-954cda0c-7c1b-44a0-bc83-2aba9c9d165a-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:41:33 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-ce646969-1ef6-4350-8765-c06ac0ac8194 tempest-VolumesActionsTest-916036654 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:41:33 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce646969-1ef6-4350-8765-c06ac0ac8194 tempest-VolumesActionsTest-916036654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:41:33 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ce646969-1ef6-4350-8765-c06ac0ac8194 tempest-VolumesActionsTest-916036654 None] Flow 'volume_create_manager' (dde06658-dc61-4b4d-9ebf-358083ff2603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:41:33 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ce646969-1ef6-4350-8765-c06ac0ac8194 tempest-VolumesActionsTest-916036654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4355145-9d62-40c9-a056-bc55ef448065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:41:33 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ce646969-1ef6-4350-8765-c06ac0ac8194 tempest-VolumesActionsTest-916036654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4355145-9d62-40c9-a056-bc55ef448065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:41:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2101635816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1614656b-1d5b-472a-96e5-0ba07c447c88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61072f025e8a40f5b1715023226c0593',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:41:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:41:33Z,use_quota=True,user_id='3b3a697e72a340e0b343914f5b890922',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:41:33 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ce646969-1ef6-4350-8765-c06ac0ac8194 tempest-VolumesActionsTest-916036654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2b23ab4-e19d-42b2-87e2-fcb28578a735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:41:33 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ce646969-1ef6-4350-8765-c06ac0ac8194 tempest-VolumesActionsTest-916036654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2b23ab4-e19d-42b2-87e2-fcb28578a735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:41:33 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ce646969-1ef6-4350-8765-c06ac0ac8194 tempest-VolumesActionsTest-916036654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (971a0ad9-4621-40f2-ae20-babac3908d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:41:33 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ce646969-1ef6-4350-8765-c06ac0ac8194 tempest-VolumesActionsTest-916036654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (971a0ad9-4621-40f2-ae20-babac3908d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1614656b-1d5b-472a-96e5-0ba07c447c88', 'volume_name': 'volume-1614656b-1d5b-472a-96e5-0ba07c447c88', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:41:33 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ce646969-1ef6-4350-8765-c06ac0ac8194 tempest-VolumesActionsTest-916036654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e77dc61b-5391-481e-bdef-ecf5aa42ac3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:41:33 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ce646969-1ef6-4350-8765-c06ac0ac8194 tempest-VolumesActionsTest-916036654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e77dc61b-5391-481e-bdef-ecf5aa42ac3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:41:33 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ce646969-1ef6-4350-8765-c06ac0ac8194 tempest-VolumesActionsTest-916036654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02ce6984-73a4-4e07-af8d-0172e3f4b561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:41:33 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-ce646969-1ef6-4350-8765-c06ac0ac8194 tempest-VolumesActionsTest-916036654 None] Volume 1614656b-1d5b-472a-96e5-0ba07c447c88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1614656b-1d5b-472a-96e5-0ba07c447c88', 'volume_size': 1} Sep 10 21:41:33 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-ce646969-1ef6-4350-8765-c06ac0ac8194 tempest-VolumesActionsTest-916036654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:41:33 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-ce646969-1ef6-4350-8765-c06ac0ac8194 tempest-VolumesActionsTest-916036654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:41:33 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-ce646969-1ef6-4350-8765-c06ac0ac8194 tempest-VolumesActionsTest-916036654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:41:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2101635816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1614656b-1d5b-472a-96e5-0ba07c447c88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61072f025e8a40f5b1715023226c0593',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:41:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:41:33Z,use_quota=True,user_id='3b3a697e72a340e0b343914f5b890922',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:41:33 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-ce646969-1ef6-4350-8765-c06ac0ac8194 tempest-VolumesActionsTest-916036654 None] Creating volume 1614656b-1d5b-472a-96e5-0ba07c447c88 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:41:33 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-ce646969-1ef6-4350-8765-c06ac0ac8194 tempest-VolumesActionsTest-916036654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:41:33 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-ce646969-1ef6-4350-8765-c06ac0ac8194 tempest-VolumesActionsTest-916036654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:41:33 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-ce646969-1ef6-4350-8765-c06ac0ac8194 tempest-VolumesActionsTest-916036654 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:41:33 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-ce646969-1ef6-4350-8765-c06ac0ac8194 tempest-VolumesActionsTest-916036654 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:41:33 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-ce646969-1ef6-4350-8765-c06ac0ac8194 tempest-VolumesActionsTest-916036654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:41:33 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-ce646969-1ef6-4350-8765-c06ac0ac8194 tempest-VolumesActionsTest-916036654 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:41:33 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-ce646969-1ef6-4350-8765-c06ac0ac8194 tempest-VolumesActionsTest-916036654 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:41:33 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ce646969-1ef6-4350-8765-c06ac0ac8194 tempest-VolumesActionsTest-916036654 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1614656b-1d5b-472a-96e5-0ba07c447c88 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:41:33 devstack quobyte-client[82807]: System call of process 100138 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:41:33 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=136, name=volume-1614656b-1d5b-472a-96e5-0ba07c447c88, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:41:33 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ce646969-1ef6-4350-8765-c06ac0ac8194 tempest-VolumesActionsTest-916036654 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1614656b-1d5b-472a-96e5-0ba07c447c88 1073741824" returned: 0 in 0.492s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:41:33 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ce646969-1ef6-4350-8765-c06ac0ac8194 tempest-VolumesActionsTest-916036654 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1614656b-1d5b-472a-96e5-0ba07c447c88 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:41:34 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ce646969-1ef6-4350-8765-c06ac0ac8194 tempest-VolumesActionsTest-916036654 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1614656b-1d5b-472a-96e5-0ba07c447c88" returned: 0 in 0.176s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:41:34 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-ce646969-1ef6-4350-8765-c06ac0ac8194 tempest-VolumesActionsTest-916036654 None] <== create_volume: return (769ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:41:34 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-ce646969-1ef6-4350-8765-c06ac0ac8194 tempest-VolumesActionsTest-916036654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:41:34 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ce646969-1ef6-4350-8765-c06ac0ac8194 tempest-VolumesActionsTest-916036654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02ce6984-73a4-4e07-af8d-0172e3f4b561) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1614656b-1d5b-472a-96e5-0ba07c447c88', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:41:34 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ce646969-1ef6-4350-8765-c06ac0ac8194 tempest-VolumesActionsTest-916036654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8723c81a-581e-480d-963f-3023ba3aa6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:41:34 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-ce646969-1ef6-4350-8765-c06ac0ac8194 tempest-VolumesActionsTest-916036654 None] Volume volume-1614656b-1d5b-472a-96e5-0ba07c447c88 (1614656b-1d5b-472a-96e5-0ba07c447c88): created successfully Sep 10 21:41:34 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ce646969-1ef6-4350-8765-c06ac0ac8194 tempest-VolumesActionsTest-916036654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8723c81a-581e-480d-963f-3023ba3aa6a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:41:34 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ce646969-1ef6-4350-8765-c06ac0ac8194 tempest-VolumesActionsTest-916036654 None] Flow 'volume_create_manager' (dde06658-dc61-4b4d-9ebf-358083ff2603) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:41:34 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-ce646969-1ef6-4350-8765-c06ac0ac8194 tempest-VolumesActionsTest-916036654 None] Created volume successfully. Sep 10 21:41:36 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-38c82e15-2ea4-42ca-8ace-bcd5c5e99685 tempest-VolumesActionsTest-916036654 None] Acquiring lock "cinder-1614656b-1d5b-472a-96e5-0ba07c447c88-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:41:36 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-38c82e15-2ea4-42ca-8ace-bcd5c5e99685 tempest-VolumesActionsTest-916036654 None] Lock "cinder-1614656b-1d5b-472a-96e5-0ba07c447c88-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:41:36 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-38c82e15-2ea4-42ca-8ace-bcd5c5e99685 tempest-VolumesActionsTest-916036654 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:41:36 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-38c82e15-2ea4-42ca-8ace-bcd5c5e99685 tempest-VolumesActionsTest-916036654 None] Acquiring lock "cinder-quobyte-1614656b-1d5b-472a-96e5-0ba07c447c88" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:41:36 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-38c82e15-2ea4-42ca-8ace-bcd5c5e99685 tempest-VolumesActionsTest-916036654 None] Lock "cinder-quobyte-1614656b-1d5b-472a-96e5-0ba07c447c88" acquired by "delete_volume" :: waited 0.018s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:41:36 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[3554e7d5-c796-4d27-bd63-d1b81fa3c884]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:41:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-38c82e15-2ea4-42ca-8ace-bcd5c5e99685 tempest-VolumesActionsTest-916036654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1614656b-1d5b-472a-96e5-0ba07c447c88 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:41:37 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-38c82e15-2ea4-42ca-8ace-bcd5c5e99685 tempest-VolumesActionsTest-916036654 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1614656b-1d5b-472a-96e5-0ba07c447c88" returned: 0 in 0.602s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:41:37 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-38c82e15-2ea4-42ca-8ace-bcd5c5e99685 tempest-VolumesActionsTest-916036654 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1614656b-1d5b-472a-96e5-0ba07c447c88 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:41:37 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-38c82e15-2ea4-42ca-8ace-bcd5c5e99685 tempest-VolumesActionsTest-916036654 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1614656b-1d5b-472a-96e5-0ba07c447c88" returned: 0 in 0.119s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:41:37 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-38c82e15-2ea4-42ca-8ace-bcd5c5e99685 tempest-VolumesActionsTest-916036654 None] Lock "cinder-quobyte-1614656b-1d5b-472a-96e5-0ba07c447c88" released by "delete_volume" :: held 0.977s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:41:37 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-38c82e15-2ea4-42ca-8ace-bcd5c5e99685 tempest-VolumesActionsTest-916036654 None] Created reservations ['34d840be-941a-4cee-93aa-5bdcd716aa0a', 'bc34dfa1-059c-4f20-9e70-1ec0014c803b', 'a2ca7bb2-1ed8-41c6-9de9-b0fbe9d04416', '9564d75b-8c07-4903-a157-a7588ed32000'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:41:38 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-38c82e15-2ea4-42ca-8ace-bcd5c5e99685 tempest-VolumesActionsTest-916036654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:41:38 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-38c82e15-2ea4-42ca-8ace-bcd5c5e99685 tempest-VolumesActionsTest-916036654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:41:38 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-38c82e15-2ea4-42ca-8ace-bcd5c5e99685 tempest-VolumesActionsTest-916036654 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:41:38 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-38c82e15-2ea4-42ca-8ace-bcd5c5e99685 tempest-VolumesActionsTest-916036654 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:41:38 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-38c82e15-2ea4-42ca-8ace-bcd5c5e99685 tempest-VolumesActionsTest-916036654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:41:38 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-38c82e15-2ea4-42ca-8ace-bcd5c5e99685 tempest-VolumesActionsTest-916036654 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:41:38 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-38c82e15-2ea4-42ca-8ace-bcd5c5e99685 tempest-VolumesActionsTest-916036654 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.109s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:41:38 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-38c82e15-2ea4-42ca-8ace-bcd5c5e99685 tempest-VolumesActionsTest-916036654 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:41:38 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-38c82e15-2ea4-42ca-8ace-bcd5c5e99685 tempest-VolumesActionsTest-916036654 None] Deleted volume successfully. Sep 10 21:41:38 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-38c82e15-2ea4-42ca-8ace-bcd5c5e99685 tempest-VolumesActionsTest-916036654 None] Lock "cinder-1614656b-1d5b-472a-96e5-0ba07c447c88-delete_volume" released by "delete_volume" :: held 2.235s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:41:48 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=48,cinder:UPDATE=73,cinder:INSERT=8,cinder:DELETE=3 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:41:48 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:UPDATE=54,cinder:DELETE=9,cinder:INSERT=18,cinder:SELECT=39 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:41:57 devstack cinder-volume[82780]: DEBUG oslo_service.periodic_task [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82780) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 21:41:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:41:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:41:57 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:41:57 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:41:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:41:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:41:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.146s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:41:57 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:41:59 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=1 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:41:59 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:UPDATE=1 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:42:01 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-1e6cfc94-de6c-4dd8-982f-0dab2962390a tempest-VolumesTransfersTest-1991930904 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:42:01 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e6cfc94-de6c-4dd8-982f-0dab2962390a tempest-VolumesTransfersTest-1991930904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:42:01 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1e6cfc94-de6c-4dd8-982f-0dab2962390a tempest-VolumesTransfersTest-1991930904 None] Flow 'volume_create_manager' (cb186935-711e-40d4-9e62-34199d46f8b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:42:01 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1e6cfc94-de6c-4dd8-982f-0dab2962390a tempest-VolumesTransfersTest-1991930904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c9f579d-794f-45ff-9333-e5e79e776aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:42:01 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1e6cfc94-de6c-4dd8-982f-0dab2962390a tempest-VolumesTransfersTest-1991930904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c9f579d-794f-45ff-9333-e5e79e776aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:42:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-317922245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aed1cd13-506a-4791-98b2-7039d9f540c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bd1f7d00dcb40a8b39b9d3dcf9e5c23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:42:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:42:01Z,use_quota=True,user_id='1f8c76d7f3164cabb66097e5a7c0b585',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:42:01 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1e6cfc94-de6c-4dd8-982f-0dab2962390a tempest-VolumesTransfersTest-1991930904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (678063ac-9bf6-41ce-8c1f-4caef085fc3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:42:01 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1e6cfc94-de6c-4dd8-982f-0dab2962390a tempest-VolumesTransfersTest-1991930904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (678063ac-9bf6-41ce-8c1f-4caef085fc3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:42:01 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1e6cfc94-de6c-4dd8-982f-0dab2962390a tempest-VolumesTransfersTest-1991930904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddc8eec8-52bb-4280-9e57-e7efeeba53f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:42:01 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1e6cfc94-de6c-4dd8-982f-0dab2962390a tempest-VolumesTransfersTest-1991930904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddc8eec8-52bb-4280-9e57-e7efeeba53f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aed1cd13-506a-4791-98b2-7039d9f540c3', 'volume_name': 'volume-aed1cd13-506a-4791-98b2-7039d9f540c3', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:42:01 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1e6cfc94-de6c-4dd8-982f-0dab2962390a tempest-VolumesTransfersTest-1991930904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ded2686f-05ae-4808-aeb4-18cc66ea502b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:42:01 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1e6cfc94-de6c-4dd8-982f-0dab2962390a tempest-VolumesTransfersTest-1991930904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ded2686f-05ae-4808-aeb4-18cc66ea502b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:42:01 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1e6cfc94-de6c-4dd8-982f-0dab2962390a tempest-VolumesTransfersTest-1991930904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98dc5752-bb95-4059-a366-bb538f57ffec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:42:01 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-1e6cfc94-de6c-4dd8-982f-0dab2962390a tempest-VolumesTransfersTest-1991930904 None] Volume aed1cd13-506a-4791-98b2-7039d9f540c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aed1cd13-506a-4791-98b2-7039d9f540c3', 'volume_size': 1} Sep 10 21:42:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-1e6cfc94-de6c-4dd8-982f-0dab2962390a tempest-VolumesTransfersTest-1991930904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:42:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-1e6cfc94-de6c-4dd8-982f-0dab2962390a tempest-VolumesTransfersTest-1991930904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:42:01 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-1e6cfc94-de6c-4dd8-982f-0dab2962390a tempest-VolumesTransfersTest-1991930904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:42:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-317922245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aed1cd13-506a-4791-98b2-7039d9f540c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bd1f7d00dcb40a8b39b9d3dcf9e5c23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:42:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:42:01Z,use_quota=True,user_id='1f8c76d7f3164cabb66097e5a7c0b585',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:42:01 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-1e6cfc94-de6c-4dd8-982f-0dab2962390a tempest-VolumesTransfersTest-1991930904 None] Creating volume aed1cd13-506a-4791-98b2-7039d9f540c3 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:42:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-1e6cfc94-de6c-4dd8-982f-0dab2962390a tempest-VolumesTransfersTest-1991930904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:42:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-1e6cfc94-de6c-4dd8-982f-0dab2962390a tempest-VolumesTransfersTest-1991930904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:42:01 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-1e6cfc94-de6c-4dd8-982f-0dab2962390a tempest-VolumesTransfersTest-1991930904 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:42:01 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-1e6cfc94-de6c-4dd8-982f-0dab2962390a tempest-VolumesTransfersTest-1991930904 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:42:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-1e6cfc94-de6c-4dd8-982f-0dab2962390a tempest-VolumesTransfersTest-1991930904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:42:01 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-1e6cfc94-de6c-4dd8-982f-0dab2962390a tempest-VolumesTransfersTest-1991930904 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:42:01 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-1e6cfc94-de6c-4dd8-982f-0dab2962390a tempest-VolumesTransfersTest-1991930904 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:42:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1e6cfc94-de6c-4dd8-982f-0dab2962390a tempest-VolumesTransfersTest-1991930904 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-aed1cd13-506a-4791-98b2-7039d9f540c3 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:42:01 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=137, name=volume-aed1cd13-506a-4791-98b2-7039d9f540c3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:42:02 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1e6cfc94-de6c-4dd8-982f-0dab2962390a tempest-VolumesTransfersTest-1991930904 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-aed1cd13-506a-4791-98b2-7039d9f540c3 1073741824" returned: 0 in 0.374s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:42:02 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1e6cfc94-de6c-4dd8-982f-0dab2962390a tempest-VolumesTransfersTest-1991930904 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-aed1cd13-506a-4791-98b2-7039d9f540c3 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:42:02 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1e6cfc94-de6c-4dd8-982f-0dab2962390a tempest-VolumesTransfersTest-1991930904 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-aed1cd13-506a-4791-98b2-7039d9f540c3" returned: 0 in 0.080s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:42:02 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-1e6cfc94-de6c-4dd8-982f-0dab2962390a tempest-VolumesTransfersTest-1991930904 None] <== create_volume: return (538ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:42:02 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-1e6cfc94-de6c-4dd8-982f-0dab2962390a tempest-VolumesTransfersTest-1991930904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.549s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:42:02 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1e6cfc94-de6c-4dd8-982f-0dab2962390a tempest-VolumesTransfersTest-1991930904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98dc5752-bb95-4059-a366-bb538f57ffec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aed1cd13-506a-4791-98b2-7039d9f540c3', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:42:02 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1e6cfc94-de6c-4dd8-982f-0dab2962390a tempest-VolumesTransfersTest-1991930904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (649cfbc8-59e0-4f91-bf7a-39b1e6d912cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:42:02 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-1e6cfc94-de6c-4dd8-982f-0dab2962390a tempest-VolumesTransfersTest-1991930904 None] Volume volume-aed1cd13-506a-4791-98b2-7039d9f540c3 (aed1cd13-506a-4791-98b2-7039d9f540c3): created successfully Sep 10 21:42:02 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1e6cfc94-de6c-4dd8-982f-0dab2962390a tempest-VolumesTransfersTest-1991930904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (649cfbc8-59e0-4f91-bf7a-39b1e6d912cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:42:02 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1e6cfc94-de6c-4dd8-982f-0dab2962390a tempest-VolumesTransfersTest-1991930904 None] Flow 'volume_create_manager' (cb186935-711e-40d4-9e62-34199d46f8b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:42:02 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-1e6cfc94-de6c-4dd8-982f-0dab2962390a tempest-VolumesTransfersTest-1991930904 None] Created volume successfully. Sep 10 21:42:04 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-8267c3c4-59ff-4977-b9ea-a8aedb137a46 tempest-VolumesTransfersTest-1733472826 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:42:04 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-8267c3c4-59ff-4977-b9ea-a8aedb137a46 tempest-VolumesTransfersTest-1733472826 None] Transfer volume completed successfully. Sep 10 21:42:05 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-b9ef1c68-e092-4c8a-b6ce-1948bfb6650f tempest-VolumesTransfersTest-1190719577 None] Acquiring lock "cinder-aed1cd13-506a-4791-98b2-7039d9f540c3-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:42:05 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-b9ef1c68-e092-4c8a-b6ce-1948bfb6650f tempest-VolumesTransfersTest-1190719577 None] Lock "cinder-aed1cd13-506a-4791-98b2-7039d9f540c3-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:42:05 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-b9ef1c68-e092-4c8a-b6ce-1948bfb6650f tempest-VolumesTransfersTest-1190719577 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:42:05 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-b9ef1c68-e092-4c8a-b6ce-1948bfb6650f tempest-VolumesTransfersTest-1190719577 None] Acquiring lock "cinder-quobyte-aed1cd13-506a-4791-98b2-7039d9f540c3" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:42:05 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-b9ef1c68-e092-4c8a-b6ce-1948bfb6650f tempest-VolumesTransfersTest-1190719577 None] Lock "cinder-quobyte-aed1cd13-506a-4791-98b2-7039d9f540c3" acquired by "delete_volume" :: waited 0.016s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:42:05 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd7aae4-91e2-4be4-9eb6-54daa01cd004]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:42:05 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b9ef1c68-e092-4c8a-b6ce-1948bfb6650f tempest-VolumesTransfersTest-1190719577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-aed1cd13-506a-4791-98b2-7039d9f540c3 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:42:06 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b9ef1c68-e092-4c8a-b6ce-1948bfb6650f tempest-VolumesTransfersTest-1190719577 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-aed1cd13-506a-4791-98b2-7039d9f540c3" returned: 0 in 0.457s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:42:06 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b9ef1c68-e092-4c8a-b6ce-1948bfb6650f tempest-VolumesTransfersTest-1190719577 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-aed1cd13-506a-4791-98b2-7039d9f540c3 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:42:06 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b9ef1c68-e092-4c8a-b6ce-1948bfb6650f tempest-VolumesTransfersTest-1190719577 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-aed1cd13-506a-4791-98b2-7039d9f540c3" returned: 0 in 0.118s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:42:06 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-b9ef1c68-e092-4c8a-b6ce-1948bfb6650f tempest-VolumesTransfersTest-1190719577 None] Lock "cinder-quobyte-aed1cd13-506a-4791-98b2-7039d9f540c3" released by "delete_volume" :: held 0.739s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:42:07 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-b9ef1c68-e092-4c8a-b6ce-1948bfb6650f tempest-VolumesTransfersTest-1190719577 None] Created reservations ['9b189d75-31a5-41af-a336-d80858b5f50c', '863ceb93-1446-436d-b2b5-e3619b8af79b', '3caa996c-167d-4d19-b04a-d78b66284780', 'cd585990-7d24-4828-a6df-6a62839301fc'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:42:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-b9ef1c68-e092-4c8a-b6ce-1948bfb6650f tempest-VolumesTransfersTest-1190719577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:42:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-b9ef1c68-e092-4c8a-b6ce-1948bfb6650f tempest-VolumesTransfersTest-1190719577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:42:07 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-b9ef1c68-e092-4c8a-b6ce-1948bfb6650f tempest-VolumesTransfersTest-1190719577 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:42:07 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-b9ef1c68-e092-4c8a-b6ce-1948bfb6650f tempest-VolumesTransfersTest-1190719577 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:42:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-b9ef1c68-e092-4c8a-b6ce-1948bfb6650f tempest-VolumesTransfersTest-1190719577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:42:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b9ef1c68-e092-4c8a-b6ce-1948bfb6650f tempest-VolumesTransfersTest-1190719577 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:42:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b9ef1c68-e092-4c8a-b6ce-1948bfb6650f tempest-VolumesTransfersTest-1190719577 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.095s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:42:07 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-b9ef1c68-e092-4c8a-b6ce-1948bfb6650f tempest-VolumesTransfersTest-1190719577 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:42:07 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-b9ef1c68-e092-4c8a-b6ce-1948bfb6650f tempest-VolumesTransfersTest-1190719577 None] Deleted volume successfully. Sep 10 21:42:07 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-b9ef1c68-e092-4c8a-b6ce-1948bfb6650f tempest-VolumesTransfersTest-1190719577 None] Lock "cinder-aed1cd13-506a-4791-98b2-7039d9f540c3-delete_volume" released by "delete_volume" :: held 1.794s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:42:08 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-1f750673-01f9-440f-ab57-a89c3f0b59e7 tempest-VolumesTransfersTest-1991930904 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:42:08 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f750673-01f9-440f-ab57-a89c3f0b59e7 tempest-VolumesTransfersTest-1991930904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:42:08 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1f750673-01f9-440f-ab57-a89c3f0b59e7 tempest-VolumesTransfersTest-1991930904 None] Flow 'volume_create_manager' (7e1a1d4b-54a9-4cac-8c38-563b56374bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:42:08 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1f750673-01f9-440f-ab57-a89c3f0b59e7 tempest-VolumesTransfersTest-1991930904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d6361ee-7351-4f48-a45e-c0e5337eb4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:42:08 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1f750673-01f9-440f-ab57-a89c3f0b59e7 tempest-VolumesTransfersTest-1991930904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d6361ee-7351-4f48-a45e-c0e5337eb4b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:42:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1703470071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50098739-c321-424a-b713-ecb6975149e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bd1f7d00dcb40a8b39b9d3dcf9e5c23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:42:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:42:08Z,use_quota=True,user_id='1f8c76d7f3164cabb66097e5a7c0b585',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:42:08 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1f750673-01f9-440f-ab57-a89c3f0b59e7 tempest-VolumesTransfersTest-1991930904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11d658da-664e-4a9c-b88f-4afdd847b647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:42:08 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1f750673-01f9-440f-ab57-a89c3f0b59e7 tempest-VolumesTransfersTest-1991930904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11d658da-664e-4a9c-b88f-4afdd847b647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:42:08 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1f750673-01f9-440f-ab57-a89c3f0b59e7 tempest-VolumesTransfersTest-1991930904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (641818f4-80b6-4c92-888c-7d7f84fee2c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:42:08 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1f750673-01f9-440f-ab57-a89c3f0b59e7 tempest-VolumesTransfersTest-1991930904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (641818f4-80b6-4c92-888c-7d7f84fee2c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50098739-c321-424a-b713-ecb6975149e5', 'volume_name': 'volume-50098739-c321-424a-b713-ecb6975149e5', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:42:08 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1f750673-01f9-440f-ab57-a89c3f0b59e7 tempest-VolumesTransfersTest-1991930904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4005877-b3bc-461b-a5e0-ca97fe848de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:42:08 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1f750673-01f9-440f-ab57-a89c3f0b59e7 tempest-VolumesTransfersTest-1991930904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4005877-b3bc-461b-a5e0-ca97fe848de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:42:09 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1f750673-01f9-440f-ab57-a89c3f0b59e7 tempest-VolumesTransfersTest-1991930904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1f76a82-d1fd-4d44-8516-3525fe97b92b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:42:09 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-1f750673-01f9-440f-ab57-a89c3f0b59e7 tempest-VolumesTransfersTest-1991930904 None] Volume 50098739-c321-424a-b713-ecb6975149e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50098739-c321-424a-b713-ecb6975149e5', 'volume_size': 1} Sep 10 21:42:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-1f750673-01f9-440f-ab57-a89c3f0b59e7 tempest-VolumesTransfersTest-1991930904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:42:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-1f750673-01f9-440f-ab57-a89c3f0b59e7 tempest-VolumesTransfersTest-1991930904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:42:09 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-1f750673-01f9-440f-ab57-a89c3f0b59e7 tempest-VolumesTransfersTest-1991930904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:42:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1703470071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50098739-c321-424a-b713-ecb6975149e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bd1f7d00dcb40a8b39b9d3dcf9e5c23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:42:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:42:08Z,use_quota=True,user_id='1f8c76d7f3164cabb66097e5a7c0b585',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:42:09 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-1f750673-01f9-440f-ab57-a89c3f0b59e7 tempest-VolumesTransfersTest-1991930904 None] Creating volume 50098739-c321-424a-b713-ecb6975149e5 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:42:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-1f750673-01f9-440f-ab57-a89c3f0b59e7 tempest-VolumesTransfersTest-1991930904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:42:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-1f750673-01f9-440f-ab57-a89c3f0b59e7 tempest-VolumesTransfersTest-1991930904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:42:09 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-1f750673-01f9-440f-ab57-a89c3f0b59e7 tempest-VolumesTransfersTest-1991930904 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:42:09 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-1f750673-01f9-440f-ab57-a89c3f0b59e7 tempest-VolumesTransfersTest-1991930904 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:42:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-1f750673-01f9-440f-ab57-a89c3f0b59e7 tempest-VolumesTransfersTest-1991930904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:42:09 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-1f750673-01f9-440f-ab57-a89c3f0b59e7 tempest-VolumesTransfersTest-1991930904 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:42:09 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-1f750673-01f9-440f-ab57-a89c3f0b59e7 tempest-VolumesTransfersTest-1991930904 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:42:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1f750673-01f9-440f-ab57-a89c3f0b59e7 tempest-VolumesTransfersTest-1991930904 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-50098739-c321-424a-b713-ecb6975149e5 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:42:09 devstack quobyte-client[82807]: System call of process 100209 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:42:09 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=138, name=volume-50098739-c321-424a-b713-ecb6975149e5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:42:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1f750673-01f9-440f-ab57-a89c3f0b59e7 tempest-VolumesTransfersTest-1991930904 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-50098739-c321-424a-b713-ecb6975149e5 1073741824" returned: 0 in 0.393s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:42:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1f750673-01f9-440f-ab57-a89c3f0b59e7 tempest-VolumesTransfersTest-1991930904 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-50098739-c321-424a-b713-ecb6975149e5 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:42:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1f750673-01f9-440f-ab57-a89c3f0b59e7 tempest-VolumesTransfersTest-1991930904 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-50098739-c321-424a-b713-ecb6975149e5" returned: 0 in 0.130s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:42:09 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-1f750673-01f9-440f-ab57-a89c3f0b59e7 tempest-VolumesTransfersTest-1991930904 None] <== create_volume: return (592ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:42:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-1f750673-01f9-440f-ab57-a89c3f0b59e7 tempest-VolumesTransfersTest-1991930904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.603s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:42:09 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1f750673-01f9-440f-ab57-a89c3f0b59e7 tempest-VolumesTransfersTest-1991930904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1f76a82-d1fd-4d44-8516-3525fe97b92b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50098739-c321-424a-b713-ecb6975149e5', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:42:09 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1f750673-01f9-440f-ab57-a89c3f0b59e7 tempest-VolumesTransfersTest-1991930904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac20347f-a70a-4a85-9b82-b7c8bdec945d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:42:09 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-1f750673-01f9-440f-ab57-a89c3f0b59e7 tempest-VolumesTransfersTest-1991930904 None] Volume volume-50098739-c321-424a-b713-ecb6975149e5 (50098739-c321-424a-b713-ecb6975149e5): created successfully Sep 10 21:42:09 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1f750673-01f9-440f-ab57-a89c3f0b59e7 tempest-VolumesTransfersTest-1991930904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac20347f-a70a-4a85-9b82-b7c8bdec945d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:42:09 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1f750673-01f9-440f-ab57-a89c3f0b59e7 tempest-VolumesTransfersTest-1991930904 None] Flow 'volume_create_manager' (7e1a1d4b-54a9-4cac-8c38-563b56374bf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:42:09 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-1f750673-01f9-440f-ab57-a89c3f0b59e7 tempest-VolumesTransfersTest-1991930904 None] Created volume successfully. Sep 10 21:42:11 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-4a9e2b8a-7569-4fcd-a2ea-a4d628a183f5 tempest-VolumesTransfersTest-1190719577 None] Acquiring lock "cinder-50098739-c321-424a-b713-ecb6975149e5-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:42:11 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-4a9e2b8a-7569-4fcd-a2ea-a4d628a183f5 tempest-VolumesTransfersTest-1190719577 None] Lock "cinder-50098739-c321-424a-b713-ecb6975149e5-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:42:11 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-4a9e2b8a-7569-4fcd-a2ea-a4d628a183f5 tempest-VolumesTransfersTest-1190719577 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:42:11 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-4a9e2b8a-7569-4fcd-a2ea-a4d628a183f5 tempest-VolumesTransfersTest-1190719577 None] Acquiring lock "cinder-quobyte-50098739-c321-424a-b713-ecb6975149e5" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:42:11 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-4a9e2b8a-7569-4fcd-a2ea-a4d628a183f5 tempest-VolumesTransfersTest-1190719577 None] Lock "cinder-quobyte-50098739-c321-424a-b713-ecb6975149e5" acquired by "delete_volume" :: waited 0.015s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:42:11 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb446911-442c-4da3-a850-03013ea77504]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:42:11 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4a9e2b8a-7569-4fcd-a2ea-a4d628a183f5 tempest-VolumesTransfersTest-1190719577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-50098739-c321-424a-b713-ecb6975149e5 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:42:11 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4a9e2b8a-7569-4fcd-a2ea-a4d628a183f5 tempest-VolumesTransfersTest-1190719577 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-50098739-c321-424a-b713-ecb6975149e5" returned: 0 in 0.439s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:42:11 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4a9e2b8a-7569-4fcd-a2ea-a4d628a183f5 tempest-VolumesTransfersTest-1190719577 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-50098739-c321-424a-b713-ecb6975149e5 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:42:11 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4a9e2b8a-7569-4fcd-a2ea-a4d628a183f5 tempest-VolumesTransfersTest-1190719577 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-50098739-c321-424a-b713-ecb6975149e5" returned: 0 in 0.111s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:42:12 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-4a9e2b8a-7569-4fcd-a2ea-a4d628a183f5 tempest-VolumesTransfersTest-1190719577 None] Lock "cinder-quobyte-50098739-c321-424a-b713-ecb6975149e5" released by "delete_volume" :: held 0.725s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:42:12 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-4a9e2b8a-7569-4fcd-a2ea-a4d628a183f5 tempest-VolumesTransfersTest-1190719577 None] Created reservations ['c747de6f-9612-4fa8-845e-e92821bf5abe', '4b635037-60fa-4ee4-aee4-b9c88592e07a', 'ffe2436b-db4d-4632-b660-d97c51c4e581', '7129095b-c228-4f00-a3f1-e57637558745'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:42:12 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-4a9e2b8a-7569-4fcd-a2ea-a4d628a183f5 tempest-VolumesTransfersTest-1190719577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:42:12 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-4a9e2b8a-7569-4fcd-a2ea-a4d628a183f5 tempest-VolumesTransfersTest-1190719577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:42:12 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-4a9e2b8a-7569-4fcd-a2ea-a4d628a183f5 tempest-VolumesTransfersTest-1190719577 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:42:12 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-4a9e2b8a-7569-4fcd-a2ea-a4d628a183f5 tempest-VolumesTransfersTest-1190719577 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:42:12 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-4a9e2b8a-7569-4fcd-a2ea-a4d628a183f5 tempest-VolumesTransfersTest-1190719577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:42:12 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4a9e2b8a-7569-4fcd-a2ea-a4d628a183f5 tempest-VolumesTransfersTest-1190719577 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:42:12 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4a9e2b8a-7569-4fcd-a2ea-a4d628a183f5 tempest-VolumesTransfersTest-1190719577 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.091s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:42:12 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-4a9e2b8a-7569-4fcd-a2ea-a4d628a183f5 tempest-VolumesTransfersTest-1190719577 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:42:12 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-4a9e2b8a-7569-4fcd-a2ea-a4d628a183f5 tempest-VolumesTransfersTest-1190719577 None] Deleted volume successfully. Sep 10 21:42:12 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-4a9e2b8a-7569-4fcd-a2ea-a4d628a183f5 tempest-VolumesTransfersTest-1190719577 None] Lock "cinder-50098739-c321-424a-b713-ecb6975149e5-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:42:20 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-909e06e0-2a6a-4c9a-aac3-536debb3a177 tempest-VolumesCloneNegativeTest-1792943859 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:42:20 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-909e06e0-2a6a-4c9a-aac3-536debb3a177 tempest-VolumesCloneNegativeTest-1792943859 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:42:20 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-909e06e0-2a6a-4c9a-aac3-536debb3a177 tempest-VolumesCloneNegativeTest-1792943859 None] Flow 'volume_create_manager' (2b64458f-0463-40cb-b2f0-1f64f23628f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:42:20 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-909e06e0-2a6a-4c9a-aac3-536debb3a177 tempest-VolumesCloneNegativeTest-1792943859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14731ce4-d3be-4715-809a-cb5133f24ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:42:20 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-909e06e0-2a6a-4c9a-aac3-536debb3a177 tempest-VolumesCloneNegativeTest-1792943859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14731ce4-d3be-4715-809a-cb5133f24ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:42:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1106450226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21a50a8a-5d74-487b-85d4-a26db97e7c4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfafe51c608f4efaa015a743c142dde5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:42:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:42:20Z,use_quota=True,user_id='3927bb723cf64cf2af5753e0b46f6d00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:42:20 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-909e06e0-2a6a-4c9a-aac3-536debb3a177 tempest-VolumesCloneNegativeTest-1792943859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bae3959-2836-4256-aebf-88097586e15e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:42:20 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-909e06e0-2a6a-4c9a-aac3-536debb3a177 tempest-VolumesCloneNegativeTest-1792943859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bae3959-2836-4256-aebf-88097586e15e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:42:20 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-909e06e0-2a6a-4c9a-aac3-536debb3a177 tempest-VolumesCloneNegativeTest-1792943859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca07d858-0d73-4804-9b9a-e9f0e898ad0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:42:20 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-909e06e0-2a6a-4c9a-aac3-536debb3a177 tempest-VolumesCloneNegativeTest-1792943859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca07d858-0d73-4804-9b9a-e9f0e898ad0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21a50a8a-5d74-487b-85d4-a26db97e7c4f', 'volume_name': 'volume-21a50a8a-5d74-487b-85d4-a26db97e7c4f', 'volume_size': 2}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:42:20 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-909e06e0-2a6a-4c9a-aac3-536debb3a177 tempest-VolumesCloneNegativeTest-1792943859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d99c400a-3f93-42f3-84c5-dc08c83d9256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:42:20 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-909e06e0-2a6a-4c9a-aac3-536debb3a177 tempest-VolumesCloneNegativeTest-1792943859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d99c400a-3f93-42f3-84c5-dc08c83d9256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:42:20 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-909e06e0-2a6a-4c9a-aac3-536debb3a177 tempest-VolumesCloneNegativeTest-1792943859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0713c1f0-2fc8-4bd8-a935-43056ead5dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:42:20 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-909e06e0-2a6a-4c9a-aac3-536debb3a177 tempest-VolumesCloneNegativeTest-1792943859 None] Volume 21a50a8a-5d74-487b-85d4-a26db97e7c4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21a50a8a-5d74-487b-85d4-a26db97e7c4f', 'volume_size': 2} Sep 10 21:42:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-909e06e0-2a6a-4c9a-aac3-536debb3a177 tempest-VolumesCloneNegativeTest-1792943859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:42:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-909e06e0-2a6a-4c9a-aac3-536debb3a177 tempest-VolumesCloneNegativeTest-1792943859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:42:20 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-909e06e0-2a6a-4c9a-aac3-536debb3a177 tempest-VolumesCloneNegativeTest-1792943859 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:42:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1106450226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21a50a8a-5d74-487b-85d4-a26db97e7c4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfafe51c608f4efaa015a743c142dde5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:42:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:42:20Z,use_quota=True,user_id='3927bb723cf64cf2af5753e0b46f6d00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:42:20 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-909e06e0-2a6a-4c9a-aac3-536debb3a177 tempest-VolumesCloneNegativeTest-1792943859 None] Creating volume 21a50a8a-5d74-487b-85d4-a26db97e7c4f {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:42:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-909e06e0-2a6a-4c9a-aac3-536debb3a177 tempest-VolumesCloneNegativeTest-1792943859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:42:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-909e06e0-2a6a-4c9a-aac3-536debb3a177 tempest-VolumesCloneNegativeTest-1792943859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:42:20 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-909e06e0-2a6a-4c9a-aac3-536debb3a177 tempest-VolumesCloneNegativeTest-1792943859 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:42:20 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-909e06e0-2a6a-4c9a-aac3-536debb3a177 tempest-VolumesCloneNegativeTest-1792943859 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:42:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-909e06e0-2a6a-4c9a-aac3-536debb3a177 tempest-VolumesCloneNegativeTest-1792943859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:42:20 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-909e06e0-2a6a-4c9a-aac3-536debb3a177 tempest-VolumesCloneNegativeTest-1792943859 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:42:20 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-909e06e0-2a6a-4c9a-aac3-536debb3a177 tempest-VolumesCloneNegativeTest-1792943859 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:42:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-909e06e0-2a6a-4c9a-aac3-536debb3a177 tempest-VolumesCloneNegativeTest-1792943859 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-21a50a8a-5d74-487b-85d4-a26db97e7c4f 2147483648 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:42:20 devstack quobyte-client[82807]: System call of process 100221 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:42:20 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=139, name=volume-21a50a8a-5d74-487b-85d4-a26db97e7c4f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:42:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-909e06e0-2a6a-4c9a-aac3-536debb3a177 tempest-VolumesCloneNegativeTest-1792943859 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-21a50a8a-5d74-487b-85d4-a26db97e7c4f 2147483648" returned: 0 in 0.546s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:42:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-909e06e0-2a6a-4c9a-aac3-536debb3a177 tempest-VolumesCloneNegativeTest-1792943859 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-21a50a8a-5d74-487b-85d4-a26db97e7c4f {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:42:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-909e06e0-2a6a-4c9a-aac3-536debb3a177 tempest-VolumesCloneNegativeTest-1792943859 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-21a50a8a-5d74-487b-85d4-a26db97e7c4f" returned: 0 in 0.100s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:42:20 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-909e06e0-2a6a-4c9a-aac3-536debb3a177 tempest-VolumesCloneNegativeTest-1792943859 None] <== create_volume: return (715ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:42:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-909e06e0-2a6a-4c9a-aac3-536debb3a177 tempest-VolumesCloneNegativeTest-1792943859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:42:21 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-909e06e0-2a6a-4c9a-aac3-536debb3a177 tempest-VolumesCloneNegativeTest-1792943859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0713c1f0-2fc8-4bd8-a935-43056ead5dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21a50a8a-5d74-487b-85d4-a26db97e7c4f', 'volume_size': 2}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:42:21 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-909e06e0-2a6a-4c9a-aac3-536debb3a177 tempest-VolumesCloneNegativeTest-1792943859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2d01b82-c065-4c38-a148-7da8cc11d9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:42:21 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-909e06e0-2a6a-4c9a-aac3-536debb3a177 tempest-VolumesCloneNegativeTest-1792943859 None] Volume volume-21a50a8a-5d74-487b-85d4-a26db97e7c4f (21a50a8a-5d74-487b-85d4-a26db97e7c4f): created successfully Sep 10 21:42:21 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-909e06e0-2a6a-4c9a-aac3-536debb3a177 tempest-VolumesCloneNegativeTest-1792943859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2d01b82-c065-4c38-a148-7da8cc11d9b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:42:21 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-909e06e0-2a6a-4c9a-aac3-536debb3a177 tempest-VolumesCloneNegativeTest-1792943859 None] Flow 'volume_create_manager' (2b64458f-0463-40cb-b2f0-1f64f23628f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:42:21 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-909e06e0-2a6a-4c9a-aac3-536debb3a177 tempest-VolumesCloneNegativeTest-1792943859 None] Created volume successfully. Sep 10 21:42:22 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-dec8ee19-5e57-450c-95f3-bd1993285263 tempest-VolumesCloneNegativeTest-1792943859 None] Acquiring lock "cinder-21a50a8a-5d74-487b-85d4-a26db97e7c4f-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:42:22 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-dec8ee19-5e57-450c-95f3-bd1993285263 tempest-VolumesCloneNegativeTest-1792943859 None] Lock "cinder-21a50a8a-5d74-487b-85d4-a26db97e7c4f-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:42:22 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-dec8ee19-5e57-450c-95f3-bd1993285263 tempest-VolumesCloneNegativeTest-1792943859 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:42:22 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-dec8ee19-5e57-450c-95f3-bd1993285263 tempest-VolumesCloneNegativeTest-1792943859 None] Acquiring lock "cinder-quobyte-21a50a8a-5d74-487b-85d4-a26db97e7c4f" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:42:22 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-dec8ee19-5e57-450c-95f3-bd1993285263 tempest-VolumesCloneNegativeTest-1792943859 None] Lock "cinder-quobyte-21a50a8a-5d74-487b-85d4-a26db97e7c4f" acquired by "delete_volume" :: waited 0.021s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:42:22 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec69f89-7fd6-468d-a428-eb92c114f70f]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:42:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-dec8ee19-5e57-450c-95f3-bd1993285263 tempest-VolumesCloneNegativeTest-1792943859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-21a50a8a-5d74-487b-85d4-a26db97e7c4f {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:42:23 devstack quobyte-client[82807]: System call of process 100225 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:42:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-dec8ee19-5e57-450c-95f3-bd1993285263 tempest-VolumesCloneNegativeTest-1792943859 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-21a50a8a-5d74-487b-85d4-a26db97e7c4f" returned: 0 in 0.488s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:42:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-dec8ee19-5e57-450c-95f3-bd1993285263 tempest-VolumesCloneNegativeTest-1792943859 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-21a50a8a-5d74-487b-85d4-a26db97e7c4f {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:42:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-dec8ee19-5e57-450c-95f3-bd1993285263 tempest-VolumesCloneNegativeTest-1792943859 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-21a50a8a-5d74-487b-85d4-a26db97e7c4f" returned: 0 in 0.144s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:42:23 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-dec8ee19-5e57-450c-95f3-bd1993285263 tempest-VolumesCloneNegativeTest-1792943859 None] Lock "cinder-quobyte-21a50a8a-5d74-487b-85d4-a26db97e7c4f" released by "delete_volume" :: held 0.820s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:42:23 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-dec8ee19-5e57-450c-95f3-bd1993285263 tempest-VolumesCloneNegativeTest-1792943859 None] Created reservations ['ef3ab575-7b48-4a92-a9dd-7b003e1526fd', '62bf0e97-7b3c-42d4-955b-c831a730a02d', '8ccf497c-344a-4499-845b-cbd5605c10ac', 'a73f3e07-d727-4b48-bab0-ba6d5dc0d11d'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:42:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-dec8ee19-5e57-450c-95f3-bd1993285263 tempest-VolumesCloneNegativeTest-1792943859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:42:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-dec8ee19-5e57-450c-95f3-bd1993285263 tempest-VolumesCloneNegativeTest-1792943859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:42:24 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-dec8ee19-5e57-450c-95f3-bd1993285263 tempest-VolumesCloneNegativeTest-1792943859 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:42:24 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-dec8ee19-5e57-450c-95f3-bd1993285263 tempest-VolumesCloneNegativeTest-1792943859 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:42:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-dec8ee19-5e57-450c-95f3-bd1993285263 tempest-VolumesCloneNegativeTest-1792943859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:42:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-dec8ee19-5e57-450c-95f3-bd1993285263 tempest-VolumesCloneNegativeTest-1792943859 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:42:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-dec8ee19-5e57-450c-95f3-bd1993285263 tempest-VolumesCloneNegativeTest-1792943859 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.103s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:42:24 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-dec8ee19-5e57-450c-95f3-bd1993285263 tempest-VolumesCloneNegativeTest-1792943859 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:42:24 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-dec8ee19-5e57-450c-95f3-bd1993285263 tempest-VolumesCloneNegativeTest-1792943859 None] Deleted volume successfully. Sep 10 21:42:24 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-dec8ee19-5e57-450c-95f3-bd1993285263 tempest-VolumesCloneNegativeTest-1792943859 None] Lock "cinder-21a50a8a-5d74-487b-85d4-a26db97e7c4f-delete_volume" released by "delete_volume" :: held 2.086s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:42:28 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-12e2cf5b-90f0-43bb-b38a-dc0b419428d9 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:42:28 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-12e2cf5b-90f0-43bb-b38a-dc0b419428d9 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:42:29 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-12e2cf5b-90f0-43bb-b38a-dc0b419428d9 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Flow 'volume_create_manager' (a98f1031-45f9-4d2f-abbe-b0df111bcff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:42:29 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-12e2cf5b-90f0-43bb-b38a-dc0b419428d9 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5b02cc1-72b6-490d-b342-5bbaf615fdb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:42:29 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-12e2cf5b-90f0-43bb-b38a-dc0b419428d9 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5b02cc1-72b6-490d-b342-5bbaf615fdb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:42:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1265109171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eabc6e36-20c9-47ec-95a2-90042a70af71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc0e60bd9f094d3c9ae974d49df1f86f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:42:29Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:42:29Z,use_quota=True,user_id='5657ba3bdb1a4fcf8fcc8c144123a40b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:42:29 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-12e2cf5b-90f0-43bb-b38a-dc0b419428d9 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f48b865c-ac08-4a51-90c4-666f326474ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:42:29 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-12e2cf5b-90f0-43bb-b38a-dc0b419428d9 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f48b865c-ac08-4a51-90c4-666f326474ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:42:29 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-12e2cf5b-90f0-43bb-b38a-dc0b419428d9 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0f42eaf-4b66-43ea-bbfe-1eecf66ae96d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:42:29 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-12e2cf5b-90f0-43bb-b38a-dc0b419428d9 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0f42eaf-4b66-43ea-bbfe-1eecf66ae96d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eabc6e36-20c9-47ec-95a2-90042a70af71', 'volume_name': 'volume-eabc6e36-20c9-47ec-95a2-90042a70af71', 'volume_size': 2}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:42:29 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-12e2cf5b-90f0-43bb-b38a-dc0b419428d9 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3da5ad2b-f373-43d7-b281-130f3ad1d3e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:42:29 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-12e2cf5b-90f0-43bb-b38a-dc0b419428d9 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3da5ad2b-f373-43d7-b281-130f3ad1d3e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:42:29 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-12e2cf5b-90f0-43bb-b38a-dc0b419428d9 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a818c1b4-f3ed-4496-8119-39ccb46bf804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:42:29 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-12e2cf5b-90f0-43bb-b38a-dc0b419428d9 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Volume eabc6e36-20c9-47ec-95a2-90042a70af71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eabc6e36-20c9-47ec-95a2-90042a70af71', 'volume_size': 2} Sep 10 21:42:29 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-12e2cf5b-90f0-43bb-b38a-dc0b419428d9 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:42:29 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-12e2cf5b-90f0-43bb-b38a-dc0b419428d9 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:42:29 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-12e2cf5b-90f0-43bb-b38a-dc0b419428d9 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:42:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1265109171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eabc6e36-20c9-47ec-95a2-90042a70af71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc0e60bd9f094d3c9ae974d49df1f86f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:42:29Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:42:29Z,use_quota=True,user_id='5657ba3bdb1a4fcf8fcc8c144123a40b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:42:29 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-12e2cf5b-90f0-43bb-b38a-dc0b419428d9 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Creating volume eabc6e36-20c9-47ec-95a2-90042a70af71 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:42:29 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-12e2cf5b-90f0-43bb-b38a-dc0b419428d9 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:42:29 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-12e2cf5b-90f0-43bb-b38a-dc0b419428d9 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:42:29 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-12e2cf5b-90f0-43bb-b38a-dc0b419428d9 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:42:29 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-12e2cf5b-90f0-43bb-b38a-dc0b419428d9 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:42:29 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-12e2cf5b-90f0-43bb-b38a-dc0b419428d9 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:42:29 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-12e2cf5b-90f0-43bb-b38a-dc0b419428d9 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:42:29 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-12e2cf5b-90f0-43bb-b38a-dc0b419428d9 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:42:29 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-12e2cf5b-90f0-43bb-b38a-dc0b419428d9 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eabc6e36-20c9-47ec-95a2-90042a70af71 2147483648 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:42:29 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=140, name=volume-eabc6e36-20c9-47ec-95a2-90042a70af71, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:42:29 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-12e2cf5b-90f0-43bb-b38a-dc0b419428d9 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eabc6e36-20c9-47ec-95a2-90042a70af71 2147483648" returned: 0 in 0.492s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:42:29 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-12e2cf5b-90f0-43bb-b38a-dc0b419428d9 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eabc6e36-20c9-47ec-95a2-90042a70af71 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:42:29 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-12e2cf5b-90f0-43bb-b38a-dc0b419428d9 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eabc6e36-20c9-47ec-95a2-90042a70af71" returned: 0 in 0.115s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:42:29 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-12e2cf5b-90f0-43bb-b38a-dc0b419428d9 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] <== create_volume: return (724ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:42:29 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-12e2cf5b-90f0-43bb-b38a-dc0b419428d9 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:42:30 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-12e2cf5b-90f0-43bb-b38a-dc0b419428d9 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a818c1b4-f3ed-4496-8119-39ccb46bf804) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eabc6e36-20c9-47ec-95a2-90042a70af71', 'volume_size': 2}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:42:30 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-12e2cf5b-90f0-43bb-b38a-dc0b419428d9 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76693361-b26b-417f-acc0-b084c8e68dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:42:30 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-12e2cf5b-90f0-43bb-b38a-dc0b419428d9 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Volume volume-eabc6e36-20c9-47ec-95a2-90042a70af71 (eabc6e36-20c9-47ec-95a2-90042a70af71): created successfully Sep 10 21:42:30 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-12e2cf5b-90f0-43bb-b38a-dc0b419428d9 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76693361-b26b-417f-acc0-b084c8e68dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:42:30 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-12e2cf5b-90f0-43bb-b38a-dc0b419428d9 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Flow 'volume_create_manager' (a98f1031-45f9-4d2f-abbe-b0df111bcff8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:42:30 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-12e2cf5b-90f0-43bb-b38a-dc0b419428d9 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Created volume successfully. Sep 10 21:42:31 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-8a112885-37dc-4a35-968f-163746d221f8 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:42:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-8a112885-37dc-4a35-968f-163746d221f8 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:42:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-8a112885-37dc-4a35-968f-163746d221f8 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:42:31 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-8a112885-37dc-4a35-968f-163746d221f8 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Creating offline snapshot ca8115ae-ff6a-4a53-b7b3-dbf62569697f of volume eabc6e36-20c9-47ec-95a2-90042a70af71 {{(pid=82780) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 21:42:31 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb416bc9-57ce-48c5-9990-cf68cea79824]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:42:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-8a112885-37dc-4a35-968f-163746d221f8 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eabc6e36-20c9-47ec-95a2-90042a70af71 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:42:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-8a112885-37dc-4a35-968f-163746d221f8 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eabc6e36-20c9-47ec-95a2-90042a70af71" returned: 0 in 0.440s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:42:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-8a112885-37dc-4a35-968f-163746d221f8 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eabc6e36-20c9-47ec-95a2-90042a70af71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eabc6e36-20c9-47ec-95a2-90042a70af71.ca8115ae-ff6a-4a53-b7b3-dbf62569697f 2G {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:42:32 devstack quobyte-client[82807]: System call of process 100238 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:42:32 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=141, name=volume-eabc6e36-20c9-47ec-95a2-90042a70af71.ca8115ae-ff6a-4a53-b7b3-dbf62569697f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:42:32 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-8a112885-37dc-4a35-968f-163746d221f8 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eabc6e36-20c9-47ec-95a2-90042a70af71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eabc6e36-20c9-47ec-95a2-90042a70af71.ca8115ae-ff6a-4a53-b7b3-dbf62569697f 2G" returned: 0 in 0.266s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:42:32 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-8a112885-37dc-4a35-968f-163746d221f8 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Running cmd (subprocess): qemu-img rebase -u -b volume-eabc6e36-20c9-47ec-95a2-90042a70af71 -F qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eabc6e36-20c9-47ec-95a2-90042a70af71.ca8115ae-ff6a-4a53-b7b3-dbf62569697f {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:42:32 devstack quobyte-client[82807]: System call of process 100241 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:42:32 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-8a112885-37dc-4a35-968f-163746d221f8 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] CMD "qemu-img rebase -u -b volume-eabc6e36-20c9-47ec-95a2-90042a70af71 -F qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eabc6e36-20c9-47ec-95a2-90042a70af71.ca8115ae-ff6a-4a53-b7b3-dbf62569697f" returned: 0 in 0.152s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:42:32 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-8a112885-37dc-4a35-968f-163746d221f8 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] File path /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eabc6e36-20c9-47ec-95a2-90042a70af71.ca8115ae-ff6a-4a53-b7b3-dbf62569697f is being set with permissions: 660 {{(pid=82780) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 21:42:32 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-8a112885-37dc-4a35-968f-163746d221f8 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eabc6e36-20c9-47ec-95a2-90042a70af71.ca8115ae-ff6a-4a53-b7b3-dbf62569697f {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:42:32 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-8a112885-37dc-4a35-968f-163746d221f8 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eabc6e36-20c9-47ec-95a2-90042a70af71.ca8115ae-ff6a-4a53-b7b3-dbf62569697f" returned: 0 in 0.103s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:42:32 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-8a112885-37dc-4a35-968f-163746d221f8 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Setting permissions: /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eabc6e36-20c9-47ec-95a2-90042a70af71 -> 1000:1000 {{(pid=82780) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 21:42:32 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-8a112885-37dc-4a35-968f-163746d221f8 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eabc6e36-20c9-47ec-95a2-90042a70af71 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eabc6e36-20c9-47ec-95a2-90042a70af71.ca8115ae-ff6a-4a53-b7b3-dbf62569697f {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:42:32 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-8a112885-37dc-4a35-968f-163746d221f8 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eabc6e36-20c9-47ec-95a2-90042a70af71 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eabc6e36-20c9-47ec-95a2-90042a70af71.ca8115ae-ff6a-4a53-b7b3-dbf62569697f" returned: 0 in 0.115s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:42:32 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-8a112885-37dc-4a35-968f-163746d221f8 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eabc6e36-20c9-47ec-95a2-90042a70af71.info {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:42:32 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-8a112885-37dc-4a35-968f-163746d221f8 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eabc6e36-20c9-47ec-95a2-90042a70af71.info" returned: 0 in 0.104s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:42:32 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-8a112885-37dc-4a35-968f-163746d221f8 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] File path /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eabc6e36-20c9-47ec-95a2-90042a70af71.info is being set with permissions: 660 {{(pid=82780) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 21:42:32 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-8a112885-37dc-4a35-968f-163746d221f8 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eabc6e36-20c9-47ec-95a2-90042a70af71.info {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:42:33 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-8a112885-37dc-4a35-968f-163746d221f8 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eabc6e36-20c9-47ec-95a2-90042a70af71.info" returned: 0 in 0.085s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:42:33 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-8a112885-37dc-4a35-968f-163746d221f8 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.652s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:42:33 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-8a112885-37dc-4a35-968f-163746d221f8 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Create snapshot completed successfully Sep 10 21:42:33 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-d1362fdd-e9fe-4292-9bf0-c45388c42742 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Acquiring lock "cinder-ca8115ae-ff6a-4a53-b7b3-dbf62569697f-delete_snapshot" by "delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:42:33 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-d1362fdd-e9fe-4292-9bf0-c45388c42742 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Lock "cinder-ca8115ae-ff6a-4a53-b7b3-dbf62569697f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.078s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:42:33 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-d1362fdd-e9fe-4292-9bf0-c45388c42742 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:42:33 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-d1362fdd-e9fe-4292-9bf0-c45388c42742 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Acquiring lock "cinder-quobyte-eabc6e36-20c9-47ec-95a2-90042a70af71" by "delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:42:33 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-d1362fdd-e9fe-4292-9bf0-c45388c42742 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Lock "cinder-quobyte-eabc6e36-20c9-47ec-95a2-90042a70af71" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:42:33 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-d1362fdd-e9fe-4292-9bf0-c45388c42742 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Acquiring lock "cinder-quobyte-ca8115ae-ff6a-4a53-b7b3-dbf62569697f" by "_delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:42:33 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-d1362fdd-e9fe-4292-9bf0-c45388c42742 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Lock "cinder-quobyte-ca8115ae-ff6a-4a53-b7b3-dbf62569697f" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:42:33 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-d1362fdd-e9fe-4292-9bf0-c45388c42742 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Deleting offline snapshot ca8115ae-ff6a-4a53-b7b3-dbf62569697f of volume eabc6e36-20c9-47ec-95a2-90042a70af71 {{(pid=82780) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 21:42:33 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-d1362fdd-e9fe-4292-9bf0-c45388c42742 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] snapshot_file for this snap is: volume-eabc6e36-20c9-47ec-95a2-90042a70af71.ca8115ae-ff6a-4a53-b7b3-dbf62569697f {{(pid=82780) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 21:42:33 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cfa058b-3368-44dd-b156-c252bb56c01e]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:42:33 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-d1362fdd-e9fe-4292-9bf0-c45388c42742 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eabc6e36-20c9-47ec-95a2-90042a70af71.ca8115ae-ff6a-4a53-b7b3-dbf62569697f {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:42:34 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-d1362fdd-e9fe-4292-9bf0-c45388c42742 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eabc6e36-20c9-47ec-95a2-90042a70af71.ca8115ae-ff6a-4a53-b7b3-dbf62569697f" returned: 0 in 0.455s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:42:34 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-d1362fdd-e9fe-4292-9bf0-c45388c42742 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eabc6e36-20c9-47ec-95a2-90042a70af71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82780) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 21:42:34 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef87094-e12c-4681-839a-1fb51c239f0a]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:42:34 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-d1362fdd-e9fe-4292-9bf0-c45388c42742 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eabc6e36-20c9-47ec-95a2-90042a70af71 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:42:34 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-d1362fdd-e9fe-4292-9bf0-c45388c42742 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eabc6e36-20c9-47ec-95a2-90042a70af71" returned: 0 in 0.435s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:42:34 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-d1362fdd-e9fe-4292-9bf0-c45388c42742 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eabc6e36-20c9-47ec-95a2-90042a70af71.ca8115ae-ff6a-4a53-b7b3-dbf62569697f {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:42:35 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-d1362fdd-e9fe-4292-9bf0-c45388c42742 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eabc6e36-20c9-47ec-95a2-90042a70af71.ca8115ae-ff6a-4a53-b7b3-dbf62569697f" returned: 0 in 0.268s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:42:35 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-d1362fdd-e9fe-4292-9bf0-c45388c42742 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eabc6e36-20c9-47ec-95a2-90042a70af71.ca8115ae-ff6a-4a53-b7b3-dbf62569697f {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:42:35 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-d1362fdd-e9fe-4292-9bf0-c45388c42742 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eabc6e36-20c9-47ec-95a2-90042a70af71.ca8115ae-ff6a-4a53-b7b3-dbf62569697f" returned: 0 in 0.091s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:42:35 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-d1362fdd-e9fe-4292-9bf0-c45388c42742 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Lock "cinder-quobyte-ca8115ae-ff6a-4a53-b7b3-dbf62569697f" released by "_delete_snapshot" :: held 1.562s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:42:35 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-d1362fdd-e9fe-4292-9bf0-c45388c42742 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Lock "cinder-quobyte-eabc6e36-20c9-47ec-95a2-90042a70af71" released by "delete_snapshot" :: held 1.587s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:42:35 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-d1362fdd-e9fe-4292-9bf0-c45388c42742 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Created reservations ['6ee1e04a-51eb-4495-a79e-0d57d3247361', 'caf07283-fffc-4df2-ac4b-7319c359652c', '8a5953a8-265c-4680-a2cf-c4775f0fc6ae', '5fd07649-ecbe-4d61-bfad-5c786cfc9814'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:42:35 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-d1362fdd-e9fe-4292-9bf0-c45388c42742 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Delete snapshot completed successfully. Sep 10 21:42:35 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-d1362fdd-e9fe-4292-9bf0-c45388c42742 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Lock "cinder-ca8115ae-ff6a-4a53-b7b3-dbf62569697f-delete_snapshot" released by "delete_snapshot" :: held 2.093s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:42:35 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-30c4f50b-31e6-4951-ba78-f78452abab62 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Acquiring lock "cinder-eabc6e36-20c9-47ec-95a2-90042a70af71-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:42:35 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-30c4f50b-31e6-4951-ba78-f78452abab62 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Lock "cinder-eabc6e36-20c9-47ec-95a2-90042a70af71-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:42:36 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-30c4f50b-31e6-4951-ba78-f78452abab62 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:42:36 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-30c4f50b-31e6-4951-ba78-f78452abab62 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Acquiring lock "cinder-quobyte-eabc6e36-20c9-47ec-95a2-90042a70af71" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:42:36 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-30c4f50b-31e6-4951-ba78-f78452abab62 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Lock "cinder-quobyte-eabc6e36-20c9-47ec-95a2-90042a70af71" acquired by "delete_volume" :: waited 0.018s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:42:36 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[36928320-ee15-4af1-a76d-9d262f6e203a]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:42:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-30c4f50b-31e6-4951-ba78-f78452abab62 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eabc6e36-20c9-47ec-95a2-90042a70af71 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:42:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-30c4f50b-31e6-4951-ba78-f78452abab62 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eabc6e36-20c9-47ec-95a2-90042a70af71" returned: 0 in 0.432s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:42:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-30c4f50b-31e6-4951-ba78-f78452abab62 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eabc6e36-20c9-47ec-95a2-90042a70af71 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:42:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-30c4f50b-31e6-4951-ba78-f78452abab62 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-eabc6e36-20c9-47ec-95a2-90042a70af71" returned: 0 in 0.116s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:42:36 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-30c4f50b-31e6-4951-ba78-f78452abab62 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Lock "cinder-quobyte-eabc6e36-20c9-47ec-95a2-90042a70af71" released by "delete_volume" :: held 0.718s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:42:37 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-30c4f50b-31e6-4951-ba78-f78452abab62 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Created reservations ['a424a773-6152-48a5-9942-733057ca6cad', 'ab254589-4cd4-4002-b1b1-df981f46bd6e', 'a30c8a01-5339-4784-9afb-974958004e62', 'bf99d87b-ae50-4ed2-a279-a49e343cc24b'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:42:37 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-30c4f50b-31e6-4951-ba78-f78452abab62 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:42:37 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-30c4f50b-31e6-4951-ba78-f78452abab62 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:42:37 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-30c4f50b-31e6-4951-ba78-f78452abab62 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:42:37 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-30c4f50b-31e6-4951-ba78-f78452abab62 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:42:37 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-30c4f50b-31e6-4951-ba78-f78452abab62 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:42:37 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-30c4f50b-31e6-4951-ba78-f78452abab62 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:42:37 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-30c4f50b-31e6-4951-ba78-f78452abab62 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.089s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:42:37 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-30c4f50b-31e6-4951-ba78-f78452abab62 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:42:37 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-30c4f50b-31e6-4951-ba78-f78452abab62 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Deleted volume successfully. Sep 10 21:42:37 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-30c4f50b-31e6-4951-ba78-f78452abab62 tempest-VolumesSnapshotNegativeTestJSON-416380076 None] Lock "cinder-eabc6e36-20c9-47ec-95a2-90042a70af71-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:42:47 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=33,cinder:UPDATE=31,cinder:DELETE=4,cinder:INSERT=17 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:42:47 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:UPDATE=62,cinder:SELECT=28,cinder:INSERT=3,cinder:DELETE=5 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:42:57 devstack cinder-volume[82780]: DEBUG oslo_service.periodic_task [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82780) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 21:42:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:42:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:42:57 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:42:57 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:42:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:42:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:42:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.134s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:42:57 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:43:06 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-50d38d34-646d-44ad-a253-e577c55690d6 tempest-TestInstancesWithCinderVolumes-1016534300 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:43:06 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-50d38d34-646d-44ad-a253-e577c55690d6 tempest-TestInstancesWithCinderVolumes-1016534300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:43:07 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-50d38d34-646d-44ad-a253-e577c55690d6 tempest-TestInstancesWithCinderVolumes-1016534300 None] Flow 'volume_create_manager' (eef04ea0-09b0-4914-b4cd-461a4434226a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:43:07 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-50d38d34-646d-44ad-a253-e577c55690d6 tempest-TestInstancesWithCinderVolumes-1016534300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b5ec867-4f68-401c-af91-4806c717cd50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:43:07 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-50d38d34-646d-44ad-a253-e577c55690d6 tempest-TestInstancesWithCinderVolumes-1016534300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b5ec867-4f68-401c-af91-4806c717cd50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:43:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1370718745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2763aad0-406d-4fcb-bbc7-f5ee49592002,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f17b9098446944edadf73e13d9f6ac3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:43:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:43:07Z,use_quota=True,user_id='084a4b0d0dba41109645d76dca8f2cbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(990c5075-aa93-4e96-9f4b-9f2a7991c367),volume_type_id=990c5075-aa93-4e96-9f4b-9f2a7991c367)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:43:07 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-50d38d34-646d-44ad-a253-e577c55690d6 tempest-TestInstancesWithCinderVolumes-1016534300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70305848-3f72-4657-b404-00e220c5cfc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:43:07 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-50d38d34-646d-44ad-a253-e577c55690d6 tempest-TestInstancesWithCinderVolumes-1016534300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70305848-3f72-4657-b404-00e220c5cfc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:43:07 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-50d38d34-646d-44ad-a253-e577c55690d6 tempest-TestInstancesWithCinderVolumes-1016534300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81665ae3-e4bc-4189-b204-825defd94869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:43:07 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-50d38d34-646d-44ad-a253-e577c55690d6 tempest-TestInstancesWithCinderVolumes-1016534300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81665ae3-e4bc-4189-b204-825defd94869) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2763aad0-406d-4fcb-bbc7-f5ee49592002', 'volume_name': 'volume-2763aad0-406d-4fcb-bbc7-f5ee49592002', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:43:07 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-50d38d34-646d-44ad-a253-e577c55690d6 tempest-TestInstancesWithCinderVolumes-1016534300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f29d10d-4f54-4234-bc83-474067a8bbea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:43:07 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-50d38d34-646d-44ad-a253-e577c55690d6 tempest-TestInstancesWithCinderVolumes-1016534300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f29d10d-4f54-4234-bc83-474067a8bbea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:43:07 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-50d38d34-646d-44ad-a253-e577c55690d6 tempest-TestInstancesWithCinderVolumes-1016534300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc02a2b5-472f-408d-9642-8dc59219a21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:43:07 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-50d38d34-646d-44ad-a253-e577c55690d6 tempest-TestInstancesWithCinderVolumes-1016534300 None] Volume 2763aad0-406d-4fcb-bbc7-f5ee49592002: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2763aad0-406d-4fcb-bbc7-f5ee49592002', 'volume_size': 1} Sep 10 21:43:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-50d38d34-646d-44ad-a253-e577c55690d6 tempest-TestInstancesWithCinderVolumes-1016534300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:43:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-50d38d34-646d-44ad-a253-e577c55690d6 tempest-TestInstancesWithCinderVolumes-1016534300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:43:07 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-50d38d34-646d-44ad-a253-e577c55690d6 tempest-TestInstancesWithCinderVolumes-1016534300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:43:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1370718745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2763aad0-406d-4fcb-bbc7-f5ee49592002,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f17b9098446944edadf73e13d9f6ac3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:43:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:43:07Z,use_quota=True,user_id='084a4b0d0dba41109645d76dca8f2cbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(990c5075-aa93-4e96-9f4b-9f2a7991c367),volume_type_id=990c5075-aa93-4e96-9f4b-9f2a7991c367)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:43:07 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-50d38d34-646d-44ad-a253-e577c55690d6 tempest-TestInstancesWithCinderVolumes-1016534300 None] Creating volume 2763aad0-406d-4fcb-bbc7-f5ee49592002 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:43:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-50d38d34-646d-44ad-a253-e577c55690d6 tempest-TestInstancesWithCinderVolumes-1016534300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:43:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-50d38d34-646d-44ad-a253-e577c55690d6 tempest-TestInstancesWithCinderVolumes-1016534300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:43:07 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-50d38d34-646d-44ad-a253-e577c55690d6 tempest-TestInstancesWithCinderVolumes-1016534300 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:43:07 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-50d38d34-646d-44ad-a253-e577c55690d6 tempest-TestInstancesWithCinderVolumes-1016534300 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:43:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-50d38d34-646d-44ad-a253-e577c55690d6 tempest-TestInstancesWithCinderVolumes-1016534300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:43:07 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-50d38d34-646d-44ad-a253-e577c55690d6 tempest-TestInstancesWithCinderVolumes-1016534300 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:43:07 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-50d38d34-646d-44ad-a253-e577c55690d6 tempest-TestInstancesWithCinderVolumes-1016534300 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:43:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-50d38d34-646d-44ad-a253-e577c55690d6 tempest-TestInstancesWithCinderVolumes-1016534300 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-2763aad0-406d-4fcb-bbc7-f5ee49592002 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:43:07 devstack quobyte-client[82807]: System call of process 100310 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:43:07 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=143, name=volume-2763aad0-406d-4fcb-bbc7-f5ee49592002, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:43:07 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-fcfae258-3458-44c9-b3bb-8260bf69f25e tempest-TestInstancesWithCinderVolumes-1016534300 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:43:07 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcfae258-3458-44c9-b3bb-8260bf69f25e tempest-TestInstancesWithCinderVolumes-1016534300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:43:07 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fcfae258-3458-44c9-b3bb-8260bf69f25e tempest-TestInstancesWithCinderVolumes-1016534300 None] Flow 'volume_create_manager' (ecdf88b2-f1e2-4adb-99c7-a4b33c573d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:43:07 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fcfae258-3458-44c9-b3bb-8260bf69f25e tempest-TestInstancesWithCinderVolumes-1016534300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c2795e2-cd51-438e-8322-44872ead7007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:43:08 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-50d38d34-646d-44ad-a253-e577c55690d6 tempest-TestInstancesWithCinderVolumes-1016534300 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-2763aad0-406d-4fcb-bbc7-f5ee49592002 1073741824" returned: 0 in 0.900s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:43:08 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-50d38d34-646d-44ad-a253-e577c55690d6 tempest-TestInstancesWithCinderVolumes-1016534300 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-2763aad0-406d-4fcb-bbc7-f5ee49592002 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:43:08 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fcfae258-3458-44c9-b3bb-8260bf69f25e tempest-TestInstancesWithCinderVolumes-1016534300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c2795e2-cd51-438e-8322-44872ead7007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:43:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1424504348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=631143d7-95ba-4996-b7eb-3d2da9d770d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f17b9098446944edadf73e13d9f6ac3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:43:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:43:07Z,use_quota=True,user_id='084a4b0d0dba41109645d76dca8f2cbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4167e8e-26c0-4c3d-ae43-2fd44ce4bddd),volume_type_id=a4167e8e-26c0-4c3d-ae43-2fd44ce4bddd)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:43:08 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fcfae258-3458-44c9-b3bb-8260bf69f25e tempest-TestInstancesWithCinderVolumes-1016534300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27d42286-b330-424b-886b-4b9cc49df298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:43:08 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fcfae258-3458-44c9-b3bb-8260bf69f25e tempest-TestInstancesWithCinderVolumes-1016534300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27d42286-b330-424b-886b-4b9cc49df298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:43:08 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fcfae258-3458-44c9-b3bb-8260bf69f25e tempest-TestInstancesWithCinderVolumes-1016534300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f063ad1-3575-4c70-9777-1ee55263bfe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:43:08 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fcfae258-3458-44c9-b3bb-8260bf69f25e tempest-TestInstancesWithCinderVolumes-1016534300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f063ad1-3575-4c70-9777-1ee55263bfe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '631143d7-95ba-4996-b7eb-3d2da9d770d9', 'volume_name': 'volume-631143d7-95ba-4996-b7eb-3d2da9d770d9', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:43:08 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fcfae258-3458-44c9-b3bb-8260bf69f25e tempest-TestInstancesWithCinderVolumes-1016534300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb50aab4-7430-422b-9676-c83c4b960a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:43:08 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fcfae258-3458-44c9-b3bb-8260bf69f25e tempest-TestInstancesWithCinderVolumes-1016534300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb50aab4-7430-422b-9676-c83c4b960a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:43:08 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fcfae258-3458-44c9-b3bb-8260bf69f25e tempest-TestInstancesWithCinderVolumes-1016534300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (235f49a3-3786-4ae0-a7af-f81e222c59bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:43:08 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-fcfae258-3458-44c9-b3bb-8260bf69f25e tempest-TestInstancesWithCinderVolumes-1016534300 None] Volume 631143d7-95ba-4996-b7eb-3d2da9d770d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-631143d7-95ba-4996-b7eb-3d2da9d770d9', 'volume_size': 1} Sep 10 21:43:08 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-fcfae258-3458-44c9-b3bb-8260bf69f25e tempest-TestInstancesWithCinderVolumes-1016534300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:43:08 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-50d38d34-646d-44ad-a253-e577c55690d6 tempest-TestInstancesWithCinderVolumes-1016534300 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-2763aad0-406d-4fcb-bbc7-f5ee49592002" returned: 0 in 0.437s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:43:08 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-50d38d34-646d-44ad-a253-e577c55690d6 tempest-TestInstancesWithCinderVolumes-1016534300 None] <== create_volume: return (1364ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:43:08 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-50d38d34-646d-44ad-a253-e577c55690d6 tempest-TestInstancesWithCinderVolumes-1016534300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.373s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:43:08 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-fcfae258-3458-44c9-b3bb-8260bf69f25e tempest-TestInstancesWithCinderVolumes-1016534300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.138s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:43:08 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-fcfae258-3458-44c9-b3bb-8260bf69f25e tempest-TestInstancesWithCinderVolumes-1016534300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:43:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1424504348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=631143d7-95ba-4996-b7eb-3d2da9d770d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f17b9098446944edadf73e13d9f6ac3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:43:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:43:07Z,use_quota=True,user_id='084a4b0d0dba41109645d76dca8f2cbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4167e8e-26c0-4c3d-ae43-2fd44ce4bddd),volume_type_id=a4167e8e-26c0-4c3d-ae43-2fd44ce4bddd)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:43:08 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-fcfae258-3458-44c9-b3bb-8260bf69f25e tempest-TestInstancesWithCinderVolumes-1016534300 None] Creating volume 631143d7-95ba-4996-b7eb-3d2da9d770d9 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:43:08 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-fcfae258-3458-44c9-b3bb-8260bf69f25e tempest-TestInstancesWithCinderVolumes-1016534300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:43:08 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-fcfae258-3458-44c9-b3bb-8260bf69f25e tempest-TestInstancesWithCinderVolumes-1016534300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:43:08 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-fcfae258-3458-44c9-b3bb-8260bf69f25e tempest-TestInstancesWithCinderVolumes-1016534300 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:43:08 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-fcfae258-3458-44c9-b3bb-8260bf69f25e tempest-TestInstancesWithCinderVolumes-1016534300 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:43:08 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-fcfae258-3458-44c9-b3bb-8260bf69f25e tempest-TestInstancesWithCinderVolumes-1016534300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:43:08 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-fcfae258-3458-44c9-b3bb-8260bf69f25e tempest-TestInstancesWithCinderVolumes-1016534300 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:43:08 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-fcfae258-3458-44c9-b3bb-8260bf69f25e tempest-TestInstancesWithCinderVolumes-1016534300 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:43:08 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-fcfae258-3458-44c9-b3bb-8260bf69f25e tempest-TestInstancesWithCinderVolumes-1016534300 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-631143d7-95ba-4996-b7eb-3d2da9d770d9 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:43:08 devstack quobyte-client[82807]: System call of process 100315 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:43:08 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=144, name=volume-631143d7-95ba-4996-b7eb-3d2da9d770d9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:43:09 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-50d38d34-646d-44ad-a253-e577c55690d6 tempest-TestInstancesWithCinderVolumes-1016534300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc02a2b5-472f-408d-9642-8dc59219a21f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2763aad0-406d-4fcb-bbc7-f5ee49592002', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:43:09 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-50d38d34-646d-44ad-a253-e577c55690d6 tempest-TestInstancesWithCinderVolumes-1016534300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1c28201-9eeb-47a6-9cf4-587ffc0293e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:43:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-fcfae258-3458-44c9-b3bb-8260bf69f25e tempest-TestInstancesWithCinderVolumes-1016534300 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-631143d7-95ba-4996-b7eb-3d2da9d770d9 1073741824" returned: 0 in 0.492s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:43:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-fcfae258-3458-44c9-b3bb-8260bf69f25e tempest-TestInstancesWithCinderVolumes-1016534300 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-631143d7-95ba-4996-b7eb-3d2da9d770d9 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:43:09 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-50d38d34-646d-44ad-a253-e577c55690d6 tempest-TestInstancesWithCinderVolumes-1016534300 None] Volume volume-2763aad0-406d-4fcb-bbc7-f5ee49592002 (2763aad0-406d-4fcb-bbc7-f5ee49592002): created successfully Sep 10 21:43:09 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-50d38d34-646d-44ad-a253-e577c55690d6 tempest-TestInstancesWithCinderVolumes-1016534300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1c28201-9eeb-47a6-9cf4-587ffc0293e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:43:09 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-50d38d34-646d-44ad-a253-e577c55690d6 tempest-TestInstancesWithCinderVolumes-1016534300 None] Flow 'volume_create_manager' (eef04ea0-09b0-4914-b4cd-461a4434226a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:43:09 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-9e64a6a3-fe23-4b62-8e31-b10de0c28ba1 tempest-TestInstancesWithCinderVolumes-1016534300 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:43:09 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e64a6a3-fe23-4b62-8e31-b10de0c28ba1 tempest-TestInstancesWithCinderVolumes-1016534300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:43:09 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-9e64a6a3-fe23-4b62-8e31-b10de0c28ba1 tempest-TestInstancesWithCinderVolumes-1016534300 None] Flow 'volume_create_manager' (46457946-a579-4125-8d72-6d85b5304938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:43:09 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-9e64a6a3-fe23-4b62-8e31-b10de0c28ba1 tempest-TestInstancesWithCinderVolumes-1016534300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82ac0d2a-3573-46c7-b717-49d91dba4049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:43:09 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-50d38d34-646d-44ad-a253-e577c55690d6 tempest-TestInstancesWithCinderVolumes-1016534300 None] Created volume successfully. Sep 10 21:43:09 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-9e64a6a3-fe23-4b62-8e31-b10de0c28ba1 tempest-TestInstancesWithCinderVolumes-1016534300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82ac0d2a-3573-46c7-b717-49d91dba4049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-285022957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3e0d200-0b06-469d-bc45-4316ce1dae72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f17b9098446944edadf73e13d9f6ac3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:43:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:43:08Z,use_quota=True,user_id='084a4b0d0dba41109645d76dca8f2cbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bea03d1c-a1d2-42fe-949e-734121c5cd8f),volume_type_id=bea03d1c-a1d2-42fe-949e-734121c5cd8f)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:43:09 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-9e64a6a3-fe23-4b62-8e31-b10de0c28ba1 tempest-TestInstancesWithCinderVolumes-1016534300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02ec86a5-a6dd-4a71-8b4c-ab76c486d055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:43:09 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-9e64a6a3-fe23-4b62-8e31-b10de0c28ba1 tempest-TestInstancesWithCinderVolumes-1016534300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02ec86a5-a6dd-4a71-8b4c-ab76c486d055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:43:09 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-9e64a6a3-fe23-4b62-8e31-b10de0c28ba1 tempest-TestInstancesWithCinderVolumes-1016534300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b988193-5492-4b2e-8516-b258b2632f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:43:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-fcfae258-3458-44c9-b3bb-8260bf69f25e tempest-TestInstancesWithCinderVolumes-1016534300 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-631143d7-95ba-4996-b7eb-3d2da9d770d9" returned: 0 in 0.592s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:43:09 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-fcfae258-3458-44c9-b3bb-8260bf69f25e tempest-TestInstancesWithCinderVolumes-1016534300 None] <== create_volume: return (1106ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:43:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-fcfae258-3458-44c9-b3bb-8260bf69f25e tempest-TestInstancesWithCinderVolumes-1016534300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:43:09 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fcfae258-3458-44c9-b3bb-8260bf69f25e tempest-TestInstancesWithCinderVolumes-1016534300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (235f49a3-3786-4ae0-a7af-f81e222c59bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-631143d7-95ba-4996-b7eb-3d2da9d770d9', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:43:09 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fcfae258-3458-44c9-b3bb-8260bf69f25e tempest-TestInstancesWithCinderVolumes-1016534300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c964625e-d258-4466-968f-f5f05aa55657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:43:09 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-fcfae258-3458-44c9-b3bb-8260bf69f25e tempest-TestInstancesWithCinderVolumes-1016534300 None] Volume volume-631143d7-95ba-4996-b7eb-3d2da9d770d9 (631143d7-95ba-4996-b7eb-3d2da9d770d9): created successfully Sep 10 21:43:09 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fcfae258-3458-44c9-b3bb-8260bf69f25e tempest-TestInstancesWithCinderVolumes-1016534300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c964625e-d258-4466-968f-f5f05aa55657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:43:09 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-fcfae258-3458-44c9-b3bb-8260bf69f25e tempest-TestInstancesWithCinderVolumes-1016534300 None] Flow 'volume_create_manager' (ecdf88b2-f1e2-4adb-99c7-a4b33c573d11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:43:09 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-fcfae258-3458-44c9-b3bb-8260bf69f25e tempest-TestInstancesWithCinderVolumes-1016534300 None] Created volume successfully. Sep 10 21:43:10 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-9e64a6a3-fe23-4b62-8e31-b10de0c28ba1 tempest-TestInstancesWithCinderVolumes-1016534300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b988193-5492-4b2e-8516-b258b2632f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b3e0d200-0b06-469d-bc45-4316ce1dae72', 'volume_name': 'volume-b3e0d200-0b06-469d-bc45-4316ce1dae72', 'volume_size': 1, 'image_id': '940bc637-685e-4200-8d92-93a8a1e8553a', 'image_location': (None, None), 'image_meta': {'name': 'tempest-scenario-img--956965494', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f17b9098446944edadf73e13d9f6ac3c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '940bc637-685e-4200-8d92-93a8a1e8553a', 'created_at': datetime.datetime(2025, 9, 10, 19, 43, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 19, 43, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/940bc637-685e-4200-8d92-93a8a1e8553a/file', 'properties': {}}, 'image_service': }' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:43:10 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-9e64a6a3-fe23-4b62-8e31-b10de0c28ba1 tempest-TestInstancesWithCinderVolumes-1016534300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15830dda-e400-45e1-a00a-c86dc59763f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:43:10 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-9e64a6a3-fe23-4b62-8e31-b10de0c28ba1 tempest-TestInstancesWithCinderVolumes-1016534300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15830dda-e400-45e1-a00a-c86dc59763f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:43:10 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-9e64a6a3-fe23-4b62-8e31-b10de0c28ba1 tempest-TestInstancesWithCinderVolumes-1016534300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef04c74f-eeb4-4fa9-91b5-dcbe581edc69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:43:10 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-9e64a6a3-fe23-4b62-8e31-b10de0c28ba1 tempest-TestInstancesWithCinderVolumes-1016534300 None] Volume b3e0d200-0b06-469d-bc45-4316ce1dae72: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b3e0d200-0b06-469d-bc45-4316ce1dae72', 'volume_size': 1, 'image_id': '940bc637-685e-4200-8d92-93a8a1e8553a', 'image_location': (None, None), 'image_meta': {'name': 'tempest-scenario-img--956965494', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f17b9098446944edadf73e13d9f6ac3c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '940bc637-685e-4200-8d92-93a8a1e8553a', 'created_at': datetime.datetime(2025, 9, 10, 19, 43, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 19, 43, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/940bc637-685e-4200-8d92-93a8a1e8553a/file', 'properties': {}}, 'image_service': } Sep 10 21:43:10 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e64a6a3-fe23-4b62-8e31-b10de0c28ba1 tempest-TestInstancesWithCinderVolumes-1016534300 None] Cloning b3e0d200-0b06-469d-bc45-4316ce1dae72 from image 940bc637-685e-4200-8d92-93a8a1e8553a at location (None, None). {{(pid=82780) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1083}} Sep 10 21:43:11 devstack cinder-volume[82780]: DEBUG cinder.image.image_utils [None req-9e64a6a3-fe23-4b62-8e31-b10de0c28ba1 tempest-TestInstancesWithCinderVolumes-1016534300 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_940bc637-685e-4200-8d92-93a8a1e8553a_qgxy0y3vdevstack@QuobyteHD, size 20.69 MB, duration 1.39 sec {{(pid=82780) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 10 21:43:11 devstack cinder-volume[82780]: INFO cinder.image.image_utils [None req-9e64a6a3-fe23-4b62-8e31-b10de0c28ba1 tempest-TestInstancesWithCinderVolumes-1016534300 None] Image download 20.69 MB at 14.85 MB/s Sep 10 21:43:11 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[9edb3840-0008-454f-9b20-701287b111f6]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:43:11 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9e64a6a3-fe23-4b62-8e31-b10de0c28ba1 tempest-TestInstancesWithCinderVolumes-1016534300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_940bc637-685e-4200-8d92-93a8a1e8553a_qgxy0y3vdevstack@QuobyteHD {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:43:11 devstack sudo[100319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_940bc637-685e-4200-8d92-93a8a1e8553a_qgxy0y3vdevstack@QuobyteHD Sep 10 21:43:11 devstack sudo[100319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 21:43:13 devstack sudo[100319]: pam_unix(sudo:session): session closed for user root Sep 10 21:43:13 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9e64a6a3-fe23-4b62-8e31-b10de0c28ba1 tempest-TestInstancesWithCinderVolumes-1016534300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_940bc637-685e-4200-8d92-93a8a1e8553a_qgxy0y3vdevstack@QuobyteHD" returned: 0 in 2.024s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:43:13 devstack cinder-volume[82780]: DEBUG cinder.image.image_utils [None req-9e64a6a3-fe23-4b62-8e31-b10de0c28ba1 tempest-TestInstancesWithCinderVolumes-1016534300 None] Temporary image 940bc637-685e-4200-8d92-93a8a1e8553a is fetched for user 084a4b0d0dba41109645d76dca8f2cbf. {{(pid=82780) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 10 21:43:13 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[988efddc-032c-4119-8954-7f5214b3e640]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:43:13 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9e64a6a3-fe23-4b62-8e31-b10de0c28ba1 tempest-TestInstancesWithCinderVolumes-1016534300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_940bc637-685e-4200-8d92-93a8a1e8553a_qgxy0y3vdevstack@QuobyteHD {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:43:14 devstack sudo[100324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_940bc637-685e-4200-8d92-93a8a1e8553a_qgxy0y3vdevstack@QuobyteHD Sep 10 21:43:14 devstack sudo[100324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 21:43:15 devstack sudo[100324]: pam_unix(sudo:session): session closed for user root Sep 10 21:43:15 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9e64a6a3-fe23-4b62-8e31-b10de0c28ba1 tempest-TestInstancesWithCinderVolumes-1016534300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_940bc637-685e-4200-8d92-93a8a1e8553a_qgxy0y3vdevstack@QuobyteHD" returned: 0 in 1.969s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:43:15 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-9e64a6a3-fe23-4b62-8e31-b10de0c28ba1 tempest-TestInstancesWithCinderVolumes-1016534300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:43:15 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-9e64a6a3-fe23-4b62-8e31-b10de0c28ba1 tempest-TestInstancesWithCinderVolumes-1016534300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:43:15 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-9e64a6a3-fe23-4b62-8e31-b10de0c28ba1 tempest-TestInstancesWithCinderVolumes-1016534300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-285022957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3e0d200-0b06-469d-bc45-4316ce1dae72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f17b9098446944edadf73e13d9f6ac3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:43:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:43:08Z,use_quota=True,user_id='084a4b0d0dba41109645d76dca8f2cbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bea03d1c-a1d2-42fe-949e-734121c5cd8f),volume_type_id=bea03d1c-a1d2-42fe-949e-734121c5cd8f)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:43:15 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-9e64a6a3-fe23-4b62-8e31-b10de0c28ba1 tempest-TestInstancesWithCinderVolumes-1016534300 None] Creating volume b3e0d200-0b06-469d-bc45-4316ce1dae72 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:43:15 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-9e64a6a3-fe23-4b62-8e31-b10de0c28ba1 tempest-TestInstancesWithCinderVolumes-1016534300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:43:15 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-9e64a6a3-fe23-4b62-8e31-b10de0c28ba1 tempest-TestInstancesWithCinderVolumes-1016534300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:43:15 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-9e64a6a3-fe23-4b62-8e31-b10de0c28ba1 tempest-TestInstancesWithCinderVolumes-1016534300 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:43:15 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-9e64a6a3-fe23-4b62-8e31-b10de0c28ba1 tempest-TestInstancesWithCinderVolumes-1016534300 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:43:15 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-9e64a6a3-fe23-4b62-8e31-b10de0c28ba1 tempest-TestInstancesWithCinderVolumes-1016534300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:43:15 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-9e64a6a3-fe23-4b62-8e31-b10de0c28ba1 tempest-TestInstancesWithCinderVolumes-1016534300 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:43:15 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-9e64a6a3-fe23-4b62-8e31-b10de0c28ba1 tempest-TestInstancesWithCinderVolumes-1016534300 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:43:15 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9e64a6a3-fe23-4b62-8e31-b10de0c28ba1 tempest-TestInstancesWithCinderVolumes-1016534300 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b3e0d200-0b06-469d-bc45-4316ce1dae72 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:43:16 devstack quobyte-client[82807]: System call of process 100329 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:43:16 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=145, name=volume-b3e0d200-0b06-469d-bc45-4316ce1dae72, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:43:16 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9e64a6a3-fe23-4b62-8e31-b10de0c28ba1 tempest-TestInstancesWithCinderVolumes-1016534300 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b3e0d200-0b06-469d-bc45-4316ce1dae72 1073741824" returned: 0 in 0.363s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:43:16 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9e64a6a3-fe23-4b62-8e31-b10de0c28ba1 tempest-TestInstancesWithCinderVolumes-1016534300 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b3e0d200-0b06-469d-bc45-4316ce1dae72 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:43:16 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9e64a6a3-fe23-4b62-8e31-b10de0c28ba1 tempest-TestInstancesWithCinderVolumes-1016534300 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b3e0d200-0b06-469d-bc45-4316ce1dae72" returned: 0 in 0.087s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:43:16 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-9e64a6a3-fe23-4b62-8e31-b10de0c28ba1 tempest-TestInstancesWithCinderVolumes-1016534300 None] <== create_volume: return (533ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:43:16 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-9e64a6a3-fe23-4b62-8e31-b10de0c28ba1 tempest-TestInstancesWithCinderVolumes-1016534300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.561s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:43:16 devstack cinder-volume[82780]: DEBUG cinder.volume.volume_utils [None req-9e64a6a3-fe23-4b62-8e31-b10de0c28ba1 tempest-TestInstancesWithCinderVolumes-1016534300 None] Attempting download of 940bc637-685e-4200-8d92-93a8a1e8553a ((None, None)) to volume b3e0d200-0b06-469d-bc45-4316ce1dae72. {{(pid=82780) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 10 21:43:16 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5fa5ec2-5e45-436c-adbf-d98e5aebe785]: (4, 'raw') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:43:16 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9e64a6a3-fe23-4b62-8e31-b10de0c28ba1 tempest-TestInstancesWithCinderVolumes-1016534300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_940bc637-685e-4200-8d92-93a8a1e8553a_y6ub7oky {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:43:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9e64a6a3-fe23-4b62-8e31-b10de0c28ba1 tempest-TestInstancesWithCinderVolumes-1016534300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_940bc637-685e-4200-8d92-93a8a1e8553a_y6ub7oky" returned: 0 in 0.355s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:43:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9e64a6a3-fe23-4b62-8e31-b10de0c28ba1 tempest-TestInstancesWithCinderVolumes-1016534300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_940bc637-685e-4200-8d92-93a8a1e8553a_y6ub7oky {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:43:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9e64a6a3-fe23-4b62-8e31-b10de0c28ba1 tempest-TestInstancesWithCinderVolumes-1016534300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_940bc637-685e-4200-8d92-93a8a1e8553a_y6ub7oky" returned: 1 in 0.369s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:43:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9e64a6a3-fe23-4b62-8e31-b10de0c28ba1 tempest-TestInstancesWithCinderVolumes-1016534300 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_940bc637-685e-4200-8d92-93a8a1e8553a_y6ub7oky' failed. Not Retrying. {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 21:43:17 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c44f29-5873-4f6b-99d2-3ce07a51054d]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:43:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9e64a6a3-fe23-4b62-8e31-b10de0c28ba1 tempest-TestInstancesWithCinderVolumes-1016534300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_940bc637-685e-4200-8d92-93a8a1e8553a_qgxy0y3vdevstack@QuobyteHD {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:43:18 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9e64a6a3-fe23-4b62-8e31-b10de0c28ba1 tempest-TestInstancesWithCinderVolumes-1016534300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_940bc637-685e-4200-8d92-93a8a1e8553a_qgxy0y3vdevstack@QuobyteHD" returned: 0 in 0.381s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:43:18 devstack cinder-volume[82780]: DEBUG cinder.image.image_utils [None req-9e64a6a3-fe23-4b62-8e31-b10de0c28ba1 tempest-TestInstancesWithCinderVolumes-1016534300 None] 940bc637-685e-4200-8d92-93a8a1e8553a was qcow2, converting to raw {{(pid=82780) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 10 21:43:18 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9e64a6a3-fe23-4b62-8e31-b10de0c28ba1 tempest-TestInstancesWithCinderVolumes-1016534300 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_940bc637-685e-4200-8d92-93a8a1e8553a_qgxy0y3vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b3e0d200-0b06-469d-bc45-4316ce1dae72 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:43:18 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=145, name=volume-b3e0d200-0b06-469d-bc45-4316ce1dae72, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:43:19 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9e64a6a3-fe23-4b62-8e31-b10de0c28ba1 tempest-TestInstancesWithCinderVolumes-1016534300 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_940bc637-685e-4200-8d92-93a8a1e8553a_qgxy0y3vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b3e0d200-0b06-469d-bc45-4316ce1dae72" returned: 0 in 0.969s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:43:19 devstack cinder-volume[82780]: DEBUG cinder.image.image_utils [None req-9e64a6a3-fe23-4b62-8e31-b10de0c28ba1 tempest-TestInstancesWithCinderVolumes-1016534300 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_940bc637-685e-4200-8d92-93a8a1e8553a_qgxy0y3vdevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b3e0d200-0b06-469d-bc45-4316ce1dae72 {{(pid=82780) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 10 21:43:19 devstack cinder-volume[82780]: INFO cinder.image.image_utils [None req-9e64a6a3-fe23-4b62-8e31-b10de0c28ba1 tempest-TestInstancesWithCinderVolumes-1016534300 None] Converted 112.00 MB image at 112.00 MB/s Sep 10 21:43:19 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9e64a6a3-fe23-4b62-8e31-b10de0c28ba1 tempest-TestInstancesWithCinderVolumes-1016534300 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b3e0d200-0b06-469d-bc45-4316ce1dae72 1G {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:43:19 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9e64a6a3-fe23-4b62-8e31-b10de0c28ba1 tempest-TestInstancesWithCinderVolumes-1016534300 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b3e0d200-0b06-469d-bc45-4316ce1dae72 1G" returned: 0 in 0.133s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:43:19 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b863c11-b836-4f5d-9053-a0ff9e794a83]: (4, 'raw') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:43:19 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9e64a6a3-fe23-4b62-8e31-b10de0c28ba1 tempest-TestInstancesWithCinderVolumes-1016534300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b3e0d200-0b06-469d-bc45-4316ce1dae72 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:43:19 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9e64a6a3-fe23-4b62-8e31-b10de0c28ba1 tempest-TestInstancesWithCinderVolumes-1016534300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b3e0d200-0b06-469d-bc45-4316ce1dae72" returned: 0 in 0.354s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:43:19 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9e64a6a3-fe23-4b62-8e31-b10de0c28ba1 tempest-TestInstancesWithCinderVolumes-1016534300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b3e0d200-0b06-469d-bc45-4316ce1dae72 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:43:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9e64a6a3-fe23-4b62-8e31-b10de0c28ba1 tempest-TestInstancesWithCinderVolumes-1016534300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b3e0d200-0b06-469d-bc45-4316ce1dae72" returned: 1 in 0.377s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:43:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9e64a6a3-fe23-4b62-8e31-b10de0c28ba1 tempest-TestInstancesWithCinderVolumes-1016534300 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b3e0d200-0b06-469d-bc45-4316ce1dae72' failed. Not Retrying. {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 21:43:20 devstack cinder-volume[82780]: DEBUG cinder.volume.volume_utils [None req-9e64a6a3-fe23-4b62-8e31-b10de0c28ba1 tempest-TestInstancesWithCinderVolumes-1016534300 None] Downloaded image 940bc637-685e-4200-8d92-93a8a1e8553a ((None, None)) to volume b3e0d200-0b06-469d-bc45-4316ce1dae72 successfully. {{(pid=82780) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 10 21:43:20 devstack cinder-volume[82780]: DEBUG cinder.image.image_utils [None req-9e64a6a3-fe23-4b62-8e31-b10de0c28ba1 tempest-TestInstancesWithCinderVolumes-1016534300 None] Temporary image 940bc637-685e-4200-8d92-93a8a1e8553a for user 084a4b0d0dba41109645d76dca8f2cbf is deleted. {{(pid=82780) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 10 21:43:20 devstack cinder-volume[82780]: DEBUG cinder.volume.volume_utils [None req-9e64a6a3-fe23-4b62-8e31-b10de0c28ba1 tempest-TestInstancesWithCinderVolumes-1016534300 None] Marking volume b3e0d200-0b06-469d-bc45-4316ce1dae72 as bootable. {{(pid=82780) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 10 21:43:20 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e64a6a3-fe23-4b62-8e31-b10de0c28ba1 tempest-TestInstancesWithCinderVolumes-1016534300 None] Copying metadata from image 940bc637-685e-4200-8d92-93a8a1e8553a to b3e0d200-0b06-469d-bc45-4316ce1dae72. {{(pid=82780) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 10 21:43:20 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e64a6a3-fe23-4b62-8e31-b10de0c28ba1 tempest-TestInstancesWithCinderVolumes-1016534300 None] Creating volume glance metadata for volume b3e0d200-0b06-469d-bc45-4316ce1dae72 backed by image 940bc637-685e-4200-8d92-93a8a1e8553a with: {'image_id': '940bc637-685e-4200-8d92-93a8a1e8553a', 'image_name': 'tempest-scenario-img--956965494', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82780) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 10 21:43:20 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-9e64a6a3-fe23-4b62-8e31-b10de0c28ba1 tempest-TestInstancesWithCinderVolumes-1016534300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef04c74f-eeb4-4fa9-91b5-dcbe581edc69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3e0d200-0b06-469d-bc45-4316ce1dae72', 'volume_size': 1, 'image_id': '940bc637-685e-4200-8d92-93a8a1e8553a', 'image_location': (None, None), 'image_meta': {'name': 'tempest-scenario-img--956965494', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f17b9098446944edadf73e13d9f6ac3c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '940bc637-685e-4200-8d92-93a8a1e8553a', 'created_at': datetime.datetime(2025, 9, 10, 19, 43, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 19, 43, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/940bc637-685e-4200-8d92-93a8a1e8553a/file', 'properties': {}}, 'image_service': }' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:43:20 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-9e64a6a3-fe23-4b62-8e31-b10de0c28ba1 tempest-TestInstancesWithCinderVolumes-1016534300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0d5995d-6586-416c-896e-0cafa368991a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:43:20 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-9e64a6a3-fe23-4b62-8e31-b10de0c28ba1 tempest-TestInstancesWithCinderVolumes-1016534300 None] Volume volume-b3e0d200-0b06-469d-bc45-4316ce1dae72 (b3e0d200-0b06-469d-bc45-4316ce1dae72): created successfully Sep 10 21:43:20 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-9e64a6a3-fe23-4b62-8e31-b10de0c28ba1 tempest-TestInstancesWithCinderVolumes-1016534300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0d5995d-6586-416c-896e-0cafa368991a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:43:20 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-9e64a6a3-fe23-4b62-8e31-b10de0c28ba1 tempest-TestInstancesWithCinderVolumes-1016534300 None] Flow 'volume_create_manager' (46457946-a579-4125-8d72-6d85b5304938) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:43:20 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-9e64a6a3-fe23-4b62-8e31-b10de0c28ba1 tempest-TestInstancesWithCinderVolumes-1016534300 None] Created volume successfully. Sep 10 21:43:30 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=9,cinder:UPDATE=7,cinder:DELETE=2,cinder:INSERT=5 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:43:30 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:UPDATE=8,cinder:SELECT=8,cinder:INSERT=4,cinder:DELETE=1 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:43:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-fde7d510-5955-4907-ba86-5ef57ab9641e req-53accae0-fba2-41dc-a9e8-ea97d4a365db tempest-TestInstancesWithCinderVolumes-1016534300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:43:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-fde7d510-5955-4907-ba86-5ef57ab9641e req-53accae0-fba2-41dc-a9e8-ea97d4a365db tempest-TestInstancesWithCinderVolumes-1016534300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:43:31 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[38263064-fa85-438f-8479-8ec6249a2d6c]: (4, 'raw') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:43:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-fde7d510-5955-4907-ba86-5ef57ab9641e req-53accae0-fba2-41dc-a9e8-ea97d4a365db tempest-TestInstancesWithCinderVolumes-1016534300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b3e0d200-0b06-469d-bc45-4316ce1dae72 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:43:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-fde7d510-5955-4907-ba86-5ef57ab9641e req-53accae0-fba2-41dc-a9e8-ea97d4a365db tempest-TestInstancesWithCinderVolumes-1016534300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b3e0d200-0b06-469d-bc45-4316ce1dae72" returned: 0 in 0.498s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:43:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-fde7d510-5955-4907-ba86-5ef57ab9641e req-53accae0-fba2-41dc-a9e8-ea97d4a365db tempest-TestInstancesWithCinderVolumes-1016534300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b3e0d200-0b06-469d-bc45-4316ce1dae72 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:43:32 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-fde7d510-5955-4907-ba86-5ef57ab9641e req-53accae0-fba2-41dc-a9e8-ea97d4a365db tempest-TestInstancesWithCinderVolumes-1016534300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b3e0d200-0b06-469d-bc45-4316ce1dae72" returned: 1 in 0.397s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:43:32 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-fde7d510-5955-4907-ba86-5ef57ab9641e req-53accae0-fba2-41dc-a9e8-ea97d4a365db tempest-TestInstancesWithCinderVolumes-1016534300 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b3e0d200-0b06-469d-bc45-4316ce1dae72' failed. Not Retrying. {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 21:43:32 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-fde7d510-5955-4907-ba86-5ef57ab9641e req-53accae0-fba2-41dc-a9e8-ea97d4a365db tempest-TestInstancesWithCinderVolumes-1016534300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.075s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:43:32 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-fde7d510-5955-4907-ba86-5ef57ab9641e req-53accae0-fba2-41dc-a9e8-ea97d4a365db tempest-TestInstancesWithCinderVolumes-1016534300 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b', 'name': 'volume-b3e0d200-0b06-469d-bc45-4316ce1dae72', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b3f6eda4-c634-4e55-8052-51751660926e', 'enforce_multipath': True} {{(pid=82780) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 21:43:32 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-fde7d510-5955-4907-ba86-5ef57ab9641e req-53accae0-fba2-41dc-a9e8-ea97d4a365db tempest-TestInstancesWithCinderVolumes-1016534300 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:43:32 devstack cinder-volume[82780]: INFO cinder.volume.manager [req-fde7d510-5955-4907-ba86-5ef57ab9641e req-53accae0-fba2-41dc-a9e8-ea97d4a365db tempest-TestInstancesWithCinderVolumes-1016534300 None] attachment_update completed successfully. Sep 10 21:43:42 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:43:42 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:43:57 devstack cinder-volume[82780]: DEBUG oslo_service.periodic_task [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82780) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 21:43:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:43:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:43:57 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:43:57 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:43:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:43:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:43:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.212s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:43:57 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:43:59 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=1 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:43:59 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:UPDATE=1 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:44:50 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-40700f2e-9063-428d-abae-7ff0e2a61dec req-14457279-992d-43ea-8d0c-8fafd2b4181a tempest-TestInstancesWithCinderVolumes-1016534300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:44:50 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-40700f2e-9063-428d-abae-7ff0e2a61dec req-14457279-992d-43ea-8d0c-8fafd2b4181a tempest-TestInstancesWithCinderVolumes-1016534300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.006s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:44:50 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[92cbb817-1be2-412c-9e7e-bfa858ce95b3]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:44:50 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-40700f2e-9063-428d-abae-7ff0e2a61dec req-14457279-992d-43ea-8d0c-8fafd2b4181a tempest-TestInstancesWithCinderVolumes-1016534300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-2763aad0-406d-4fcb-bbc7-f5ee49592002 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:44:51 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-40700f2e-9063-428d-abae-7ff0e2a61dec req-14457279-992d-43ea-8d0c-8fafd2b4181a tempest-TestInstancesWithCinderVolumes-1016534300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-2763aad0-406d-4fcb-bbc7-f5ee49592002" returned: 0 in 0.466s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:44:51 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-40700f2e-9063-428d-abae-7ff0e2a61dec req-14457279-992d-43ea-8d0c-8fafd2b4181a tempest-TestInstancesWithCinderVolumes-1016534300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.541s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:44:51 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-40700f2e-9063-428d-abae-7ff0e2a61dec req-14457279-992d-43ea-8d0c-8fafd2b4181a tempest-TestInstancesWithCinderVolumes-1016534300 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b', 'name': 'volume-2763aad0-406d-4fcb-bbc7-f5ee49592002', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '59fdf4cd-ebd2-41a7-a57f-133fa8716343', 'enforce_multipath': True} {{(pid=82780) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 21:44:51 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-40700f2e-9063-428d-abae-7ff0e2a61dec req-14457279-992d-43ea-8d0c-8fafd2b4181a tempest-TestInstancesWithCinderVolumes-1016534300 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:44:51 devstack cinder-volume[82780]: INFO cinder.volume.manager [req-40700f2e-9063-428d-abae-7ff0e2a61dec req-14457279-992d-43ea-8d0c-8fafd2b4181a tempest-TestInstancesWithCinderVolumes-1016534300 None] attachment_update completed successfully. Sep 10 21:44:57 devstack cinder-volume[82780]: DEBUG oslo_service.periodic_task [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82780) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 21:44:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:44:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:44:57 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:44:57 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:44:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:44:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:44:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.094s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:44:57 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:45:01 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:45:01 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:45:02 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-b6951932-f629-4846-b63d-d7a736fc24b9 req-33ef9456-013d-4e7b-80e1-37ba0d309939 tempest-TestInstancesWithCinderVolumes-1016534300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:45:02 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-b6951932-f629-4846-b63d-d7a736fc24b9 req-33ef9456-013d-4e7b-80e1-37ba0d309939 tempest-TestInstancesWithCinderVolumes-1016534300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:45:02 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[55749045-14bd-4219-9b8a-b0a65da1fa4f]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:45:02 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-b6951932-f629-4846-b63d-d7a736fc24b9 req-33ef9456-013d-4e7b-80e1-37ba0d309939 tempest-TestInstancesWithCinderVolumes-1016534300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-631143d7-95ba-4996-b7eb-3d2da9d770d9 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:45:02 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [req-b6951932-f629-4846-b63d-d7a736fc24b9 req-33ef9456-013d-4e7b-80e1-37ba0d309939 tempest-TestInstancesWithCinderVolumes-1016534300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-631143d7-95ba-4996-b7eb-3d2da9d770d9" returned: 0 in 0.387s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:45:02 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [req-b6951932-f629-4846-b63d-d7a736fc24b9 req-33ef9456-013d-4e7b-80e1-37ba0d309939 tempest-TestInstancesWithCinderVolumes-1016534300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.440s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:45:02 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-b6951932-f629-4846-b63d-d7a736fc24b9 req-33ef9456-013d-4e7b-80e1-37ba0d309939 tempest-TestInstancesWithCinderVolumes-1016534300 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b', 'name': 'volume-631143d7-95ba-4996-b7eb-3d2da9d770d9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd8c561a6-4204-4728-bb0a-dcd52ca08af8', 'enforce_multipath': True} {{(pid=82780) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 21:45:02 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-b6951932-f629-4846-b63d-d7a736fc24b9 req-33ef9456-013d-4e7b-80e1-37ba0d309939 tempest-TestInstancesWithCinderVolumes-1016534300 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:45:02 devstack cinder-volume[82780]: INFO cinder.volume.manager [req-b6951932-f629-4846-b63d-d7a736fc24b9 req-33ef9456-013d-4e7b-80e1-37ba0d309939 tempest-TestInstancesWithCinderVolumes-1016534300 None] attachment_update completed successfully. Sep 10 21:45:12 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:45:12 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:45:37 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-12ab6574-24bb-4a2a-ac32-e6f1ba104d8b req-68a1338e-ef60-4d55-a70b-0357e12d40b8 tempest-TestInstancesWithCinderVolumes-1016534300 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:45:37 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-12ab6574-24bb-4a2a-ac32-e6f1ba104d8b req-68a1338e-ef60-4d55-a70b-0357e12d40b8 tempest-TestInstancesWithCinderVolumes-1016534300 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:45:37 devstack cinder-volume[82780]: INFO cinder.volume.manager [req-12ab6574-24bb-4a2a-ac32-e6f1ba104d8b req-68a1338e-ef60-4d55-a70b-0357e12d40b8 tempest-TestInstancesWithCinderVolumes-1016534300 None] Terminate volume connection completed successfully. Sep 10 21:45:37 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-12ab6574-24bb-4a2a-ac32-e6f1ba104d8b req-68a1338e-ef60-4d55-a70b-0357e12d40b8 tempest-TestInstancesWithCinderVolumes-1016534300 None] Deleting attachment 59fdf4cd-ebd2-41a7-a57f-133fa8716343. {{(pid=82780) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 21:45:39 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-28a51560-3c2f-444c-b01f-b096bc8d69e5 tempest-TestInstancesWithCinderVolumes-1016534300 None] Acquiring lock "cinder-2763aad0-406d-4fcb-bbc7-f5ee49592002-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:45:39 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-28a51560-3c2f-444c-b01f-b096bc8d69e5 tempest-TestInstancesWithCinderVolumes-1016534300 None] Lock "cinder-2763aad0-406d-4fcb-bbc7-f5ee49592002-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:45:39 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-28a51560-3c2f-444c-b01f-b096bc8d69e5 tempest-TestInstancesWithCinderVolumes-1016534300 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:45:39 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-28a51560-3c2f-444c-b01f-b096bc8d69e5 tempest-TestInstancesWithCinderVolumes-1016534300 None] Acquiring lock "cinder-quobyte-2763aad0-406d-4fcb-bbc7-f5ee49592002" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:45:39 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-28a51560-3c2f-444c-b01f-b096bc8d69e5 tempest-TestInstancesWithCinderVolumes-1016534300 None] Lock "cinder-quobyte-2763aad0-406d-4fcb-bbc7-f5ee49592002" acquired by "delete_volume" :: waited 0.014s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:45:39 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9112af-0112-4776-9ddc-4e135bb2a0b4]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:45:39 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-28a51560-3c2f-444c-b01f-b096bc8d69e5 tempest-TestInstancesWithCinderVolumes-1016534300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-2763aad0-406d-4fcb-bbc7-f5ee49592002 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:45:40 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-28a51560-3c2f-444c-b01f-b096bc8d69e5 tempest-TestInstancesWithCinderVolumes-1016534300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-2763aad0-406d-4fcb-bbc7-f5ee49592002" returned: 0 in 0.543s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:45:40 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-28a51560-3c2f-444c-b01f-b096bc8d69e5 tempest-TestInstancesWithCinderVolumes-1016534300 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-2763aad0-406d-4fcb-bbc7-f5ee49592002 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:45:40 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-28a51560-3c2f-444c-b01f-b096bc8d69e5 tempest-TestInstancesWithCinderVolumes-1016534300 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-2763aad0-406d-4fcb-bbc7-f5ee49592002" returned: 0 in 0.102s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:45:40 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-28a51560-3c2f-444c-b01f-b096bc8d69e5 tempest-TestInstancesWithCinderVolumes-1016534300 None] Lock "cinder-quobyte-2763aad0-406d-4fcb-bbc7-f5ee49592002" released by "delete_volume" :: held 0.856s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:45:40 devstack cinder-volume[82780]: WARNING cinder.quota [None req-28a51560-3c2f-444c-b01f-b096bc8d69e5 tempest-TestInstancesWithCinderVolumes-1016534300 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1133063381-1965125605 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1133063381-1965125605, it is now deprecated. Please use the default quota class for default quota. Sep 10 21:45:40 devstack cinder-volume[82780]: WARNING cinder.quota [None req-28a51560-3c2f-444c-b01f-b096bc8d69e5 tempest-TestInstancesWithCinderVolumes-1016534300 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1133063381-1965125605 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1133063381-1965125605, it is now deprecated. Please use the default quota class for default quota. Sep 10 21:45:40 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-28a51560-3c2f-444c-b01f-b096bc8d69e5 tempest-TestInstancesWithCinderVolumes-1016534300 None] Created reservations ['9b26d487-2bd0-46d6-9403-2e59fce98358', 'f82f7637-bccb-47fc-860d-ca5787f8a98f', 'b9cbf113-fb05-42fc-b361-c3086bcbfa41', 'c238890d-c23d-4d0a-b29f-88fde9365741'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:45:40 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-28a51560-3c2f-444c-b01f-b096bc8d69e5 tempest-TestInstancesWithCinderVolumes-1016534300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:45:40 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-28a51560-3c2f-444c-b01f-b096bc8d69e5 tempest-TestInstancesWithCinderVolumes-1016534300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:45:40 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-28a51560-3c2f-444c-b01f-b096bc8d69e5 tempest-TestInstancesWithCinderVolumes-1016534300 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:45:40 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-28a51560-3c2f-444c-b01f-b096bc8d69e5 tempest-TestInstancesWithCinderVolumes-1016534300 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:45:40 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-28a51560-3c2f-444c-b01f-b096bc8d69e5 tempest-TestInstancesWithCinderVolumes-1016534300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:45:40 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-28a51560-3c2f-444c-b01f-b096bc8d69e5 tempest-TestInstancesWithCinderVolumes-1016534300 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:45:40 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-28a51560-3c2f-444c-b01f-b096bc8d69e5 tempest-TestInstancesWithCinderVolumes-1016534300 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.116s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:45:40 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-28a51560-3c2f-444c-b01f-b096bc8d69e5 tempest-TestInstancesWithCinderVolumes-1016534300 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:45:40 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-28a51560-3c2f-444c-b01f-b096bc8d69e5 tempest-TestInstancesWithCinderVolumes-1016534300 None] Deleted volume successfully. Sep 10 21:45:41 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-28a51560-3c2f-444c-b01f-b096bc8d69e5 tempest-TestInstancesWithCinderVolumes-1016534300 None] Lock "cinder-2763aad0-406d-4fcb-bbc7-f5ee49592002-delete_volume" released by "delete_volume" :: held 1.821s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:45:57 devstack cinder-volume[82780]: DEBUG oslo_service.periodic_task [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82780) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 21:45:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:45:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:45:57 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:45:57 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:45:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:45:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:45:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.086s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:45:57 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:45:59 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=9,cinder:UPDATE=11,cinder:INSERT=1 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:45:59 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=4,cinder:INSERT=3,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:46:08 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-6aaf5896-c91a-4b7f-b4be-3548548f213d req-01f40ab6-4667-467c-872e-915a3a0a7df3 tempest-TestInstancesWithCinderVolumes-1016534300 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:46:08 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-6aaf5896-c91a-4b7f-b4be-3548548f213d req-01f40ab6-4667-467c-872e-915a3a0a7df3 tempest-TestInstancesWithCinderVolumes-1016534300 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:46:08 devstack cinder-volume[82780]: INFO cinder.volume.manager [req-6aaf5896-c91a-4b7f-b4be-3548548f213d req-01f40ab6-4667-467c-872e-915a3a0a7df3 tempest-TestInstancesWithCinderVolumes-1016534300 None] Terminate volume connection completed successfully. Sep 10 21:46:08 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-6aaf5896-c91a-4b7f-b4be-3548548f213d req-01f40ab6-4667-467c-872e-915a3a0a7df3 tempest-TestInstancesWithCinderVolumes-1016534300 None] Deleting attachment d8c561a6-4204-4728-bb0a-dcd52ca08af8. {{(pid=82780) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 21:46:09 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-017d665c-2566-4b24-a595-55725fae22ae tempest-TestInstancesWithCinderVolumes-1016534300 None] Acquiring lock "cinder-631143d7-95ba-4996-b7eb-3d2da9d770d9-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:46:09 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-017d665c-2566-4b24-a595-55725fae22ae tempest-TestInstancesWithCinderVolumes-1016534300 None] Lock "cinder-631143d7-95ba-4996-b7eb-3d2da9d770d9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:46:09 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-017d665c-2566-4b24-a595-55725fae22ae tempest-TestInstancesWithCinderVolumes-1016534300 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:46:09 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-017d665c-2566-4b24-a595-55725fae22ae tempest-TestInstancesWithCinderVolumes-1016534300 None] Acquiring lock "cinder-quobyte-631143d7-95ba-4996-b7eb-3d2da9d770d9" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:46:09 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-017d665c-2566-4b24-a595-55725fae22ae tempest-TestInstancesWithCinderVolumes-1016534300 None] Lock "cinder-quobyte-631143d7-95ba-4996-b7eb-3d2da9d770d9" acquired by "delete_volume" :: waited 0.011s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:46:09 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c780af-eb36-4ab8-9e48-655de67be408]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:46:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-017d665c-2566-4b24-a595-55725fae22ae tempest-TestInstancesWithCinderVolumes-1016534300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-631143d7-95ba-4996-b7eb-3d2da9d770d9 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:46:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-017d665c-2566-4b24-a595-55725fae22ae tempest-TestInstancesWithCinderVolumes-1016534300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-631143d7-95ba-4996-b7eb-3d2da9d770d9" returned: 0 in 0.497s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:46:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-017d665c-2566-4b24-a595-55725fae22ae tempest-TestInstancesWithCinderVolumes-1016534300 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-631143d7-95ba-4996-b7eb-3d2da9d770d9 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:46:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-017d665c-2566-4b24-a595-55725fae22ae tempest-TestInstancesWithCinderVolumes-1016534300 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-631143d7-95ba-4996-b7eb-3d2da9d770d9" returned: 0 in 0.095s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:46:10 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-017d665c-2566-4b24-a595-55725fae22ae tempest-TestInstancesWithCinderVolumes-1016534300 None] Lock "cinder-quobyte-631143d7-95ba-4996-b7eb-3d2da9d770d9" released by "delete_volume" :: held 0.766s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:46:10 devstack cinder-volume[82780]: WARNING cinder.quota [None req-017d665c-2566-4b24-a595-55725fae22ae tempest-TestInstancesWithCinderVolumes-1016534300 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1189280530-1219894186 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1189280530-1219894186, it is now deprecated. Please use the default quota class for default quota. Sep 10 21:46:10 devstack cinder-volume[82780]: WARNING cinder.quota [None req-017d665c-2566-4b24-a595-55725fae22ae tempest-TestInstancesWithCinderVolumes-1016534300 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1189280530-1219894186 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1189280530-1219894186, it is now deprecated. Please use the default quota class for default quota. Sep 10 21:46:11 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-017d665c-2566-4b24-a595-55725fae22ae tempest-TestInstancesWithCinderVolumes-1016534300 None] Created reservations ['1e5d95b7-b71f-47e2-b140-9484914773b3', '278cf11d-894e-4413-95c7-f5fa7da3c7bf', 'd8cb1678-7016-4fd6-8918-8df5e0db3591', '75f0b893-a4ae-461d-a7bd-c0475b135e68'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:46:11 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-017d665c-2566-4b24-a595-55725fae22ae tempest-TestInstancesWithCinderVolumes-1016534300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:46:11 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-017d665c-2566-4b24-a595-55725fae22ae tempest-TestInstancesWithCinderVolumes-1016534300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.014s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:46:11 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-017d665c-2566-4b24-a595-55725fae22ae tempest-TestInstancesWithCinderVolumes-1016534300 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:46:11 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-017d665c-2566-4b24-a595-55725fae22ae tempest-TestInstancesWithCinderVolumes-1016534300 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:46:11 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-017d665c-2566-4b24-a595-55725fae22ae tempest-TestInstancesWithCinderVolumes-1016534300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:46:11 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-017d665c-2566-4b24-a595-55725fae22ae tempest-TestInstancesWithCinderVolumes-1016534300 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:46:11 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-017d665c-2566-4b24-a595-55725fae22ae tempest-TestInstancesWithCinderVolumes-1016534300 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.125s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:46:11 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-017d665c-2566-4b24-a595-55725fae22ae tempest-TestInstancesWithCinderVolumes-1016534300 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:46:11 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-017d665c-2566-4b24-a595-55725fae22ae tempest-TestInstancesWithCinderVolumes-1016534300 None] Deleted volume successfully. Sep 10 21:46:11 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-017d665c-2566-4b24-a595-55725fae22ae tempest-TestInstancesWithCinderVolumes-1016534300 None] Lock "cinder-631143d7-95ba-4996-b7eb-3d2da9d770d9-delete_volume" released by "delete_volume" :: held 2.022s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:46:19 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-af518a97-6ea9-4253-a0b0-4a442962bed0 req-1037998a-dcc4-44a1-9669-05c47fe484a9 tempest-TestInstancesWithCinderVolumes-1016534300 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:46:19 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [req-af518a97-6ea9-4253-a0b0-4a442962bed0 req-1037998a-dcc4-44a1-9669-05c47fe484a9 tempest-TestInstancesWithCinderVolumes-1016534300 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:46:19 devstack cinder-volume[82780]: INFO cinder.volume.manager [req-af518a97-6ea9-4253-a0b0-4a442962bed0 req-1037998a-dcc4-44a1-9669-05c47fe484a9 tempest-TestInstancesWithCinderVolumes-1016534300 None] Terminate volume connection completed successfully. Sep 10 21:46:19 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [req-af518a97-6ea9-4253-a0b0-4a442962bed0 req-1037998a-dcc4-44a1-9669-05c47fe484a9 tempest-TestInstancesWithCinderVolumes-1016534300 None] Deleting attachment b3f6eda4-c634-4e55-8052-51751660926e. {{(pid=82780) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 21:46:23 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-a4c89d0b-4d83-415e-8658-922c71755867 tempest-TestInstancesWithCinderVolumes-1016534300 None] Acquiring lock "cinder-b3e0d200-0b06-469d-bc45-4316ce1dae72-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:46:23 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-a4c89d0b-4d83-415e-8658-922c71755867 tempest-TestInstancesWithCinderVolumes-1016534300 None] Lock "cinder-b3e0d200-0b06-469d-bc45-4316ce1dae72-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:46:23 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-a4c89d0b-4d83-415e-8658-922c71755867 tempest-TestInstancesWithCinderVolumes-1016534300 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:46:23 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-a4c89d0b-4d83-415e-8658-922c71755867 tempest-TestInstancesWithCinderVolumes-1016534300 None] Acquiring lock "cinder-quobyte-b3e0d200-0b06-469d-bc45-4316ce1dae72" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:46:23 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-a4c89d0b-4d83-415e-8658-922c71755867 tempest-TestInstancesWithCinderVolumes-1016534300 None] Lock "cinder-quobyte-b3e0d200-0b06-469d-bc45-4316ce1dae72" acquired by "delete_volume" :: waited 0.016s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:46:23 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[6019a4a3-b351-47e5-a410-f1ff982c20c6]: (4, 'raw') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:46:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a4c89d0b-4d83-415e-8658-922c71755867 tempest-TestInstancesWithCinderVolumes-1016534300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b3e0d200-0b06-469d-bc45-4316ce1dae72 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:46:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a4c89d0b-4d83-415e-8658-922c71755867 tempest-TestInstancesWithCinderVolumes-1016534300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b3e0d200-0b06-469d-bc45-4316ce1dae72" returned: 0 in 0.388s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:46:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a4c89d0b-4d83-415e-8658-922c71755867 tempest-TestInstancesWithCinderVolumes-1016534300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b3e0d200-0b06-469d-bc45-4316ce1dae72 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:46:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a4c89d0b-4d83-415e-8658-922c71755867 tempest-TestInstancesWithCinderVolumes-1016534300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b3e0d200-0b06-469d-bc45-4316ce1dae72" returned: 1 in 0.395s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:46:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a4c89d0b-4d83-415e-8658-922c71755867 tempest-TestInstancesWithCinderVolumes-1016534300 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b3e0d200-0b06-469d-bc45-4316ce1dae72' failed. Not Retrying. {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 21:46:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a4c89d0b-4d83-415e-8658-922c71755867 tempest-TestInstancesWithCinderVolumes-1016534300 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b3e0d200-0b06-469d-bc45-4316ce1dae72 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:46:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a4c89d0b-4d83-415e-8658-922c71755867 tempest-TestInstancesWithCinderVolumes-1016534300 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-b3e0d200-0b06-469d-bc45-4316ce1dae72" returned: 0 in 0.104s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:46:24 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-a4c89d0b-4d83-415e-8658-922c71755867 tempest-TestInstancesWithCinderVolumes-1016534300 None] Lock "cinder-quobyte-b3e0d200-0b06-469d-bc45-4316ce1dae72" released by "delete_volume" :: held 1.170s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:46:25 devstack cinder-volume[82780]: WARNING cinder.quota [None req-a4c89d0b-4d83-415e-8658-922c71755867 tempest-TestInstancesWithCinderVolumes-1016534300 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-139129709-357076472 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-139129709-357076472, it is now deprecated. Please use the default quota class for default quota. Sep 10 21:46:25 devstack cinder-volume[82780]: WARNING cinder.quota [None req-a4c89d0b-4d83-415e-8658-922c71755867 tempest-TestInstancesWithCinderVolumes-1016534300 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-139129709-357076472 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-139129709-357076472, it is now deprecated. Please use the default quota class for default quota. Sep 10 21:46:25 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-a4c89d0b-4d83-415e-8658-922c71755867 tempest-TestInstancesWithCinderVolumes-1016534300 None] Created reservations ['63472e7b-a4f5-4f50-a377-6e33c5dbbabc', '9af4ffc8-bd4c-4f4b-9b77-cfdd44dbf557', 'ed46a730-76f5-43ab-8172-d8eadd32022e', 'c0c80250-1bda-4490-aa4a-70757b07c130'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:46:25 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a4c89d0b-4d83-415e-8658-922c71755867 tempest-TestInstancesWithCinderVolumes-1016534300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:46:25 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a4c89d0b-4d83-415e-8658-922c71755867 tempest-TestInstancesWithCinderVolumes-1016534300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:46:25 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a4c89d0b-4d83-415e-8658-922c71755867 tempest-TestInstancesWithCinderVolumes-1016534300 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:46:25 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a4c89d0b-4d83-415e-8658-922c71755867 tempest-TestInstancesWithCinderVolumes-1016534300 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:46:25 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a4c89d0b-4d83-415e-8658-922c71755867 tempest-TestInstancesWithCinderVolumes-1016534300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:46:25 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a4c89d0b-4d83-415e-8658-922c71755867 tempest-TestInstancesWithCinderVolumes-1016534300 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:46:25 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a4c89d0b-4d83-415e-8658-922c71755867 tempest-TestInstancesWithCinderVolumes-1016534300 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.101s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:46:25 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-a4c89d0b-4d83-415e-8658-922c71755867 tempest-TestInstancesWithCinderVolumes-1016534300 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:46:25 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-a4c89d0b-4d83-415e-8658-922c71755867 tempest-TestInstancesWithCinderVolumes-1016534300 None] Deleted volume successfully. Sep 10 21:46:25 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-a4c89d0b-4d83-415e-8658-922c71755867 tempest-TestInstancesWithCinderVolumes-1016534300 None] Lock "cinder-b3e0d200-0b06-469d-bc45-4316ce1dae72-delete_volume" released by "delete_volume" :: held 2.136s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:46:35 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=15,cinder:UPDATE=13,cinder:INSERT=5,cinder:DELETE=1 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:46:35 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=9,cinder:UPDATE=19,cinder:INSERT=3,cinder:DELETE=1 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:46:57 devstack cinder-volume[82780]: DEBUG oslo_service.periodic_task [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82780) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 21:46:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:46:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:46:57 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:46:57 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:46:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:46:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:46:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.133s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:46:57 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:46:58 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-2e83e52b-f316-4e0b-a622-3bf97fd86f1d tempest-CinderUnicodeTest-2142680273 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:46:58 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e83e52b-f316-4e0b-a622-3bf97fd86f1d tempest-CinderUnicodeTest-2142680273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:46:58 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-2e83e52b-f316-4e0b-a622-3bf97fd86f1d tempest-CinderUnicodeTest-2142680273 None] Flow 'volume_create_manager' (1adb1938-79b1-45d0-8d4a-ed732d50f8b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:46:58 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-2e83e52b-f316-4e0b-a622-3bf97fd86f1d tempest-CinderUnicodeTest-2142680273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fa9e1ac-de70-406f-ae60-d6aea6ccd39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:46:58 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-2e83e52b-f316-4e0b-a622-3bf97fd86f1d tempest-CinderUnicodeTest-2142680273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fa9e1ac-de70-406f-ae60-d6aea6ccd39b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:46:58Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0239c109-3912-4ab9-a0d4-2c35cc296aa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a147c029a66b45edb1ca60d2810a41bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:46:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:46:58Z,use_quota=True,user_id='cf12089d0ecf4704994778cfb1f97afb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:46:58 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-2e83e52b-f316-4e0b-a622-3bf97fd86f1d tempest-CinderUnicodeTest-2142680273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7c87460-fd8f-4337-a2df-d36dc58d4b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:46:58 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-2e83e52b-f316-4e0b-a622-3bf97fd86f1d tempest-CinderUnicodeTest-2142680273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7c87460-fd8f-4337-a2df-d36dc58d4b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:46:58 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-2e83e52b-f316-4e0b-a622-3bf97fd86f1d tempest-CinderUnicodeTest-2142680273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8f3a859-1062-4cca-a081-ae661436a844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:46:58 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-2e83e52b-f316-4e0b-a622-3bf97fd86f1d tempest-CinderUnicodeTest-2142680273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8f3a859-1062-4cca-a081-ae661436a844) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0239c109-3912-4ab9-a0d4-2c35cc296aa1', 'volume_name': 'volume-0239c109-3912-4ab9-a0d4-2c35cc296aa1', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:46:58 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-2e83e52b-f316-4e0b-a622-3bf97fd86f1d tempest-CinderUnicodeTest-2142680273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9a30afe-a5f6-42b2-913b-fd5d637c4837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:46:58 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-2e83e52b-f316-4e0b-a622-3bf97fd86f1d tempest-CinderUnicodeTest-2142680273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9a30afe-a5f6-42b2-913b-fd5d637c4837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:46:58 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-2e83e52b-f316-4e0b-a622-3bf97fd86f1d tempest-CinderUnicodeTest-2142680273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55bbfd15-5127-49e3-8da8-db2c243085e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:46:58 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-2e83e52b-f316-4e0b-a622-3bf97fd86f1d tempest-CinderUnicodeTest-2142680273 None] Volume 0239c109-3912-4ab9-a0d4-2c35cc296aa1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0239c109-3912-4ab9-a0d4-2c35cc296aa1', 'volume_size': 1} Sep 10 21:46:58 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-2e83e52b-f316-4e0b-a622-3bf97fd86f1d tempest-CinderUnicodeTest-2142680273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:46:58 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-2e83e52b-f316-4e0b-a622-3bf97fd86f1d tempest-CinderUnicodeTest-2142680273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:46:58 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-2e83e52b-f316-4e0b-a622-3bf97fd86f1d tempest-CinderUnicodeTest-2142680273 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:46:58Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0239c109-3912-4ab9-a0d4-2c35cc296aa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a147c029a66b45edb1ca60d2810a41bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:46:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:46:58Z,use_quota=True,user_id='cf12089d0ecf4704994778cfb1f97afb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:46:58 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-2e83e52b-f316-4e0b-a622-3bf97fd86f1d tempest-CinderUnicodeTest-2142680273 None] Creating volume 0239c109-3912-4ab9-a0d4-2c35cc296aa1 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:46:58 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-2e83e52b-f316-4e0b-a622-3bf97fd86f1d tempest-CinderUnicodeTest-2142680273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:46:58 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-2e83e52b-f316-4e0b-a622-3bf97fd86f1d tempest-CinderUnicodeTest-2142680273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:46:58 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-2e83e52b-f316-4e0b-a622-3bf97fd86f1d tempest-CinderUnicodeTest-2142680273 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:46:58 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-2e83e52b-f316-4e0b-a622-3bf97fd86f1d tempest-CinderUnicodeTest-2142680273 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:46:58 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-2e83e52b-f316-4e0b-a622-3bf97fd86f1d tempest-CinderUnicodeTest-2142680273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:46:58 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-2e83e52b-f316-4e0b-a622-3bf97fd86f1d tempest-CinderUnicodeTest-2142680273 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:46:58 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-2e83e52b-f316-4e0b-a622-3bf97fd86f1d tempest-CinderUnicodeTest-2142680273 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:46:58 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-2e83e52b-f316-4e0b-a622-3bf97fd86f1d tempest-CinderUnicodeTest-2142680273 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-0239c109-3912-4ab9-a0d4-2c35cc296aa1 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:46:58 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=146, name=volume-0239c109-3912-4ab9-a0d4-2c35cc296aa1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:46:59 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-2e83e52b-f316-4e0b-a622-3bf97fd86f1d tempest-CinderUnicodeTest-2142680273 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-0239c109-3912-4ab9-a0d4-2c35cc296aa1 1073741824" returned: 0 in 0.685s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:46:59 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-2e83e52b-f316-4e0b-a622-3bf97fd86f1d tempest-CinderUnicodeTest-2142680273 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-0239c109-3912-4ab9-a0d4-2c35cc296aa1 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:46:59 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-4fe16899-cbe7-4256-bef7-49d531b97d63 tempest-CreateVolumesFromImageTest-1973590822 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:46:59 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fe16899-cbe7-4256-bef7-49d531b97d63 tempest-CreateVolumesFromImageTest-1973590822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:46:59 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4fe16899-cbe7-4256-bef7-49d531b97d63 tempest-CreateVolumesFromImageTest-1973590822 None] Flow 'volume_create_manager' (3f1cb09b-f115-4a50-87ca-116874a6dbd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:46:59 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4fe16899-cbe7-4256-bef7-49d531b97d63 tempest-CreateVolumesFromImageTest-1973590822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3b5cd0d-5f9f-4566-a05f-7499150ea12f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:46:59 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-56bd6ee5-0ede-47e4-91b0-ceced9e52ec9 tempest-CreateVolumesFromImageTest-1973590822 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:46:59 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-56bd6ee5-0ede-47e4-91b0-ceced9e52ec9 tempest-CreateVolumesFromImageTest-1973590822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:47:00 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-56bd6ee5-0ede-47e4-91b0-ceced9e52ec9 tempest-CreateVolumesFromImageTest-1973590822 None] Flow 'volume_create_manager' (8d8f53f9-3187-458a-9bbb-bed4e626e3b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:47:00 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-56bd6ee5-0ede-47e4-91b0-ceced9e52ec9 tempest-CreateVolumesFromImageTest-1973590822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76978978-1084-4f5c-9b44-5f5e7e6c5544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:00 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4fe16899-cbe7-4256-bef7-49d531b97d63 tempest-CreateVolumesFromImageTest-1973590822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3b5cd0d-5f9f-4566-a05f-7499150ea12f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:46:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1420747678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b9ba58e-db2c-4828-b71e-198c746dcf7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c6f74fc90554338b8f8c57674f11ca4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:46:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:46:58Z,use_quota=True,user_id='40ee4783931d4807ae4dcdec3bb8083c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:00 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4fe16899-cbe7-4256-bef7-49d531b97d63 tempest-CreateVolumesFromImageTest-1973590822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b27aa47-c794-43e5-9d69-32745dbf68f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:00 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4fe16899-cbe7-4256-bef7-49d531b97d63 tempest-CreateVolumesFromImageTest-1973590822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b27aa47-c794-43e5-9d69-32745dbf68f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:00 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4fe16899-cbe7-4256-bef7-49d531b97d63 tempest-CreateVolumesFromImageTest-1973590822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0826fc1d-7b89-4a04-9782-59f20a8dd99e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:00 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4fe16899-cbe7-4256-bef7-49d531b97d63 tempest-CreateVolumesFromImageTest-1973590822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0826fc1d-7b89-4a04-9782-59f20a8dd99e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b9ba58e-db2c-4828-b71e-198c746dcf7a', 'volume_name': 'volume-5b9ba58e-db2c-4828-b71e-198c746dcf7a', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:00 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4fe16899-cbe7-4256-bef7-49d531b97d63 tempest-CreateVolumesFromImageTest-1973590822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d1cb3df-3391-4540-99ea-1f42fb211d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:00 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4fe16899-cbe7-4256-bef7-49d531b97d63 tempest-CreateVolumesFromImageTest-1973590822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d1cb3df-3391-4540-99ea-1f42fb211d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:00 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4fe16899-cbe7-4256-bef7-49d531b97d63 tempest-CreateVolumesFromImageTest-1973590822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e0d449a-498b-46f3-bbd0-b4c5313e2a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:00 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-4fe16899-cbe7-4256-bef7-49d531b97d63 tempest-CreateVolumesFromImageTest-1973590822 None] Volume 5b9ba58e-db2c-4828-b71e-198c746dcf7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b9ba58e-db2c-4828-b71e-198c746dcf7a', 'volume_size': 1} Sep 10 21:47:00 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-4fe16899-cbe7-4256-bef7-49d531b97d63 tempest-CreateVolumesFromImageTest-1973590822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:47:00 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-56bd6ee5-0ede-47e4-91b0-ceced9e52ec9 tempest-CreateVolumesFromImageTest-1973590822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76978978-1084-4f5c-9b44-5f5e7e6c5544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:46:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2101371739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a69f918-84e7-41c9-99b1-070d587a88a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c6f74fc90554338b8f8c57674f11ca4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:46:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:46:59Z,use_quota=True,user_id='40ee4783931d4807ae4dcdec3bb8083c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:00 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-56bd6ee5-0ede-47e4-91b0-ceced9e52ec9 tempest-CreateVolumesFromImageTest-1973590822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3c71622-9ec7-4a91-888a-a2b1d56c31a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:00 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-56bd6ee5-0ede-47e4-91b0-ceced9e52ec9 tempest-CreateVolumesFromImageTest-1973590822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3c71622-9ec7-4a91-888a-a2b1d56c31a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:00 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-56bd6ee5-0ede-47e4-91b0-ceced9e52ec9 tempest-CreateVolumesFromImageTest-1973590822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6f0764f-4414-413e-af8c-aff0c6126bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:00 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-56bd6ee5-0ede-47e4-91b0-ceced9e52ec9 tempest-CreateVolumesFromImageTest-1973590822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6f0764f-4414-413e-af8c-aff0c6126bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a69f918-84e7-41c9-99b1-070d587a88a1', 'volume_name': 'volume-9a69f918-84e7-41c9-99b1-070d587a88a1', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:00 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-56bd6ee5-0ede-47e4-91b0-ceced9e52ec9 tempest-CreateVolumesFromImageTest-1973590822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36f2513d-005b-4831-ab83-654b5d6930ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:00 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-56bd6ee5-0ede-47e4-91b0-ceced9e52ec9 tempest-CreateVolumesFromImageTest-1973590822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36f2513d-005b-4831-ab83-654b5d6930ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:00 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-56bd6ee5-0ede-47e4-91b0-ceced9e52ec9 tempest-CreateVolumesFromImageTest-1973590822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89835617-c8a9-4bb3-a061-f8ed6fda79b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:00 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-56bd6ee5-0ede-47e4-91b0-ceced9e52ec9 tempest-CreateVolumesFromImageTest-1973590822 None] Volume 9a69f918-84e7-41c9-99b1-070d587a88a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a69f918-84e7-41c9-99b1-070d587a88a1', 'volume_size': 1} Sep 10 21:47:00 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-56bd6ee5-0ede-47e4-91b0-ceced9e52ec9 tempest-CreateVolumesFromImageTest-1973590822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:47:00 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-66888740-38b0-4c1e-ada2-5da8a1f586fd tempest-CreateVolumesFromImageTest-1973590822 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:47:00 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-66888740-38b0-4c1e-ada2-5da8a1f586fd tempest-CreateVolumesFromImageTest-1973590822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:47:00 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-66888740-38b0-4c1e-ada2-5da8a1f586fd tempest-CreateVolumesFromImageTest-1973590822 None] Flow 'volume_create_manager' (289e3966-266f-4024-b76c-227da3bef1ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:47:00 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-66888740-38b0-4c1e-ada2-5da8a1f586fd tempest-CreateVolumesFromImageTest-1973590822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aa9fc1b-8b03-416e-a844-4da8cea480b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:00 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-2e83e52b-f316-4e0b-a622-3bf97fd86f1d tempest-CinderUnicodeTest-2142680273 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-0239c109-3912-4ab9-a0d4-2c35cc296aa1" returned: 0 in 1.370s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:00 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-66888740-38b0-4c1e-ada2-5da8a1f586fd tempest-CreateVolumesFromImageTest-1973590822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aa9fc1b-8b03-416e-a844-4da8cea480b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:46:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-605254187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df52c8a9-813f-46b7-b449-4e248045ee58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c6f74fc90554338b8f8c57674f11ca4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:47:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:47:00Z,use_quota=True,user_id='40ee4783931d4807ae4dcdec3bb8083c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:00 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-66888740-38b0-4c1e-ada2-5da8a1f586fd tempest-CreateVolumesFromImageTest-1973590822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5af0b0a-f605-4d26-acef-4efbefde1f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:00 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-66888740-38b0-4c1e-ada2-5da8a1f586fd tempest-CreateVolumesFromImageTest-1973590822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5af0b0a-f605-4d26-acef-4efbefde1f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:00 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-66888740-38b0-4c1e-ada2-5da8a1f586fd tempest-CreateVolumesFromImageTest-1973590822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c995805-d2d6-4e75-a9e9-ac91a11dde5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:00 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-66888740-38b0-4c1e-ada2-5da8a1f586fd tempest-CreateVolumesFromImageTest-1973590822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c995805-d2d6-4e75-a9e9-ac91a11dde5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df52c8a9-813f-46b7-b449-4e248045ee58', 'volume_name': 'volume-df52c8a9-813f-46b7-b449-4e248045ee58', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:00 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-66888740-38b0-4c1e-ada2-5da8a1f586fd tempest-CreateVolumesFromImageTest-1973590822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1489b18-da78-4bc5-bbaf-7772761ac994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:00 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-66888740-38b0-4c1e-ada2-5da8a1f586fd tempest-CreateVolumesFromImageTest-1973590822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1489b18-da78-4bc5-bbaf-7772761ac994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:00 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-66888740-38b0-4c1e-ada2-5da8a1f586fd tempest-CreateVolumesFromImageTest-1973590822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ac51726-9947-4878-8802-a4fc49f7b8ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:00 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-66888740-38b0-4c1e-ada2-5da8a1f586fd tempest-CreateVolumesFromImageTest-1973590822 None] Volume df52c8a9-813f-46b7-b449-4e248045ee58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df52c8a9-813f-46b7-b449-4e248045ee58', 'volume_size': 1} Sep 10 21:47:00 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-66888740-38b0-4c1e-ada2-5da8a1f586fd tempest-CreateVolumesFromImageTest-1973590822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:47:00 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-2e83e52b-f316-4e0b-a622-3bf97fd86f1d tempest-CinderUnicodeTest-2142680273 None] <== create_volume: return (2150ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:47:00 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-2e83e52b-f316-4e0b-a622-3bf97fd86f1d tempest-CinderUnicodeTest-2142680273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.157s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:47:00 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-4fe16899-cbe7-4256-bef7-49d531b97d63 tempest-CreateVolumesFromImageTest-1973590822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.432s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:47:00 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-4fe16899-cbe7-4256-bef7-49d531b97d63 tempest-CreateVolumesFromImageTest-1973590822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:46:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1420747678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b9ba58e-db2c-4828-b71e-198c746dcf7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c6f74fc90554338b8f8c57674f11ca4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:46:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:46:58Z,use_quota=True,user_id='40ee4783931d4807ae4dcdec3bb8083c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:47:00 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-4fe16899-cbe7-4256-bef7-49d531b97d63 tempest-CreateVolumesFromImageTest-1973590822 None] Creating volume 5b9ba58e-db2c-4828-b71e-198c746dcf7a {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:47:00 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-4fe16899-cbe7-4256-bef7-49d531b97d63 tempest-CreateVolumesFromImageTest-1973590822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:47:00 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-4fe16899-cbe7-4256-bef7-49d531b97d63 tempest-CreateVolumesFromImageTest-1973590822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:47:00 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-4fe16899-cbe7-4256-bef7-49d531b97d63 tempest-CreateVolumesFromImageTest-1973590822 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:47:00 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-4fe16899-cbe7-4256-bef7-49d531b97d63 tempest-CreateVolumesFromImageTest-1973590822 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:47:00 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-4fe16899-cbe7-4256-bef7-49d531b97d63 tempest-CreateVolumesFromImageTest-1973590822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:47:00 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-4fe16899-cbe7-4256-bef7-49d531b97d63 tempest-CreateVolumesFromImageTest-1973590822 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:47:00 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-4fe16899-cbe7-4256-bef7-49d531b97d63 tempest-CreateVolumesFromImageTest-1973590822 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:47:00 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4fe16899-cbe7-4256-bef7-49d531b97d63 tempest-CreateVolumesFromImageTest-1973590822 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5b9ba58e-db2c-4828-b71e-198c746dcf7a 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:01 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=147, name=volume-5b9ba58e-db2c-4828-b71e-198c746dcf7a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:47:01 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-2e83e52b-f316-4e0b-a622-3bf97fd86f1d tempest-CinderUnicodeTest-2142680273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55bbfd15-5127-49e3-8da8-db2c243085e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0239c109-3912-4ab9-a0d4-2c35cc296aa1', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:01 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-2e83e52b-f316-4e0b-a622-3bf97fd86f1d tempest-CinderUnicodeTest-2142680273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (854ae7db-9ca7-4d41-a1ed-a6a72190033e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:01 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-82d0ae0a-8f19-4394-a78e-38fa2056923b tempest-CreateVolumesFromImageTest-1973590822 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:47:01 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-82d0ae0a-8f19-4394-a78e-38fa2056923b tempest-CreateVolumesFromImageTest-1973590822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:47:01 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-82d0ae0a-8f19-4394-a78e-38fa2056923b tempest-CreateVolumesFromImageTest-1973590822 None] Flow 'volume_create_manager' (2c5ffa6c-bce7-4878-af81-c9eb180787eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:47:01 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-82d0ae0a-8f19-4394-a78e-38fa2056923b tempest-CreateVolumesFromImageTest-1973590822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23055057-b9c7-4427-8698-289febdaf426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4fe16899-cbe7-4256-bef7-49d531b97d63 tempest-CreateVolumesFromImageTest-1973590822 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5b9ba58e-db2c-4828-b71e-198c746dcf7a 1073741824" returned: 0 in 1.123s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4fe16899-cbe7-4256-bef7-49d531b97d63 tempest-CreateVolumesFromImageTest-1973590822 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5b9ba58e-db2c-4828-b71e-198c746dcf7a {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:02 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-9ad6aee6-7b97-478f-b31b-f9775a213082 tempest-CreateVolumesFromImageTest-1973590822 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:47:02 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ad6aee6-7b97-478f-b31b-f9775a213082 tempest-CreateVolumesFromImageTest-1973590822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:47:02 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-9ad6aee6-7b97-478f-b31b-f9775a213082 tempest-CreateVolumesFromImageTest-1973590822 None] Flow 'volume_create_manager' (81bd7c2a-c918-4a1c-ba7d-3b44a94489c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:47:02 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-9ad6aee6-7b97-478f-b31b-f9775a213082 tempest-CreateVolumesFromImageTest-1973590822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2822216-014d-40a9-84f0-fb7b0f903c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:02 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-9ad6aee6-7b97-478f-b31b-f9775a213082 tempest-CreateVolumesFromImageTest-1973590822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2822216-014d-40a9-84f0-fb7b0f903c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:47:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1425191221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e1f8be4-b9c0-4edf-a6b8-40ad167c2897,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c6f74fc90554338b8f8c57674f11ca4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:47:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:47:01Z,use_quota=True,user_id='40ee4783931d4807ae4dcdec3bb8083c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:02 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-9ad6aee6-7b97-478f-b31b-f9775a213082 tempest-CreateVolumesFromImageTest-1973590822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4ef8948-ae51-4006-97a4-e328096aafe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:02 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-9ad6aee6-7b97-478f-b31b-f9775a213082 tempest-CreateVolumesFromImageTest-1973590822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4ef8948-ae51-4006-97a4-e328096aafe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:02 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-9ad6aee6-7b97-478f-b31b-f9775a213082 tempest-CreateVolumesFromImageTest-1973590822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e0803c8-4cf7-4519-b6fe-0942d28be947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:02 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-9ad6aee6-7b97-478f-b31b-f9775a213082 tempest-CreateVolumesFromImageTest-1973590822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e0803c8-4cf7-4519-b6fe-0942d28be947) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e1f8be4-b9c0-4edf-a6b8-40ad167c2897', 'volume_name': 'volume-5e1f8be4-b9c0-4edf-a6b8-40ad167c2897', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:02 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-9ad6aee6-7b97-478f-b31b-f9775a213082 tempest-CreateVolumesFromImageTest-1973590822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ddaa806-3c23-4954-8a69-8cb1bcbe034d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:02 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-9ad6aee6-7b97-478f-b31b-f9775a213082 tempest-CreateVolumesFromImageTest-1973590822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ddaa806-3c23-4954-8a69-8cb1bcbe034d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:02 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-9ad6aee6-7b97-478f-b31b-f9775a213082 tempest-CreateVolumesFromImageTest-1973590822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edc88f86-973e-4f0f-b89c-b562c0363e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:02 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-9ad6aee6-7b97-478f-b31b-f9775a213082 tempest-CreateVolumesFromImageTest-1973590822 None] Volume 5e1f8be4-b9c0-4edf-a6b8-40ad167c2897: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e1f8be4-b9c0-4edf-a6b8-40ad167c2897', 'volume_size': 1} Sep 10 21:47:02 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-9ad6aee6-7b97-478f-b31b-f9775a213082 tempest-CreateVolumesFromImageTest-1973590822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:47:02 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-2e83e52b-f316-4e0b-a622-3bf97fd86f1d tempest-CinderUnicodeTest-2142680273 None] Volume volume-0239c109-3912-4ab9-a0d4-2c35cc296aa1 (0239c109-3912-4ab9-a0d4-2c35cc296aa1): created successfully Sep 10 21:47:02 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-2e83e52b-f316-4e0b-a622-3bf97fd86f1d tempest-CinderUnicodeTest-2142680273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (854ae7db-9ca7-4d41-a1ed-a6a72190033e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:02 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-2e83e52b-f316-4e0b-a622-3bf97fd86f1d tempest-CinderUnicodeTest-2142680273 None] Flow 'volume_create_manager' (1adb1938-79b1-45d0-8d4a-ed732d50f8b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:47:02 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-82d0ae0a-8f19-4394-a78e-38fa2056923b tempest-CreateVolumesFromImageTest-1973590822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23055057-b9c7-4427-8698-289febdaf426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:47:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1536367142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9303c491-24ed-4550-bc8e-f9c39818d8e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c6f74fc90554338b8f8c57674f11ca4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:47:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:47:00Z,use_quota=True,user_id='40ee4783931d4807ae4dcdec3bb8083c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:02 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-82d0ae0a-8f19-4394-a78e-38fa2056923b tempest-CreateVolumesFromImageTest-1973590822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec545d32-c6f7-4182-9e04-bba16c089cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:02 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-82d0ae0a-8f19-4394-a78e-38fa2056923b tempest-CreateVolumesFromImageTest-1973590822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec545d32-c6f7-4182-9e04-bba16c089cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:02 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-82d0ae0a-8f19-4394-a78e-38fa2056923b tempest-CreateVolumesFromImageTest-1973590822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fb920a3-e96d-4620-87d5-aadc162b5ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:02 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-82d0ae0a-8f19-4394-a78e-38fa2056923b tempest-CreateVolumesFromImageTest-1973590822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fb920a3-e96d-4620-87d5-aadc162b5ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9303c491-24ed-4550-bc8e-f9c39818d8e6', 'volume_name': 'volume-9303c491-24ed-4550-bc8e-f9c39818d8e6', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:02 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-82d0ae0a-8f19-4394-a78e-38fa2056923b tempest-CreateVolumesFromImageTest-1973590822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92676172-de86-4f8e-9e3d-4de7f43b77e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:02 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-82d0ae0a-8f19-4394-a78e-38fa2056923b tempest-CreateVolumesFromImageTest-1973590822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92676172-de86-4f8e-9e3d-4de7f43b77e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:02 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-82d0ae0a-8f19-4394-a78e-38fa2056923b tempest-CreateVolumesFromImageTest-1973590822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8a3279c-377a-4476-b4e5-30bbafd0a3ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:02 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-82d0ae0a-8f19-4394-a78e-38fa2056923b tempest-CreateVolumesFromImageTest-1973590822 None] Volume 9303c491-24ed-4550-bc8e-f9c39818d8e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9303c491-24ed-4550-bc8e-f9c39818d8e6', 'volume_size': 1} Sep 10 21:47:02 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-82d0ae0a-8f19-4394-a78e-38fa2056923b tempest-CreateVolumesFromImageTest-1973590822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:47:02 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4fe16899-cbe7-4256-bef7-49d531b97d63 tempest-CreateVolumesFromImageTest-1973590822 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5b9ba58e-db2c-4828-b71e-198c746dcf7a" returned: 0 in 0.815s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:02 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-4fe16899-cbe7-4256-bef7-49d531b97d63 tempest-CreateVolumesFromImageTest-1973590822 None] <== create_volume: return (1969ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:47:02 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-4fe16899-cbe7-4256-bef7-49d531b97d63 tempest-CreateVolumesFromImageTest-1973590822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.998s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:47:02 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-56bd6ee5-0ede-47e4-91b0-ceced9e52ec9 tempest-CreateVolumesFromImageTest-1973590822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.206s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:47:02 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-56bd6ee5-0ede-47e4-91b0-ceced9e52ec9 tempest-CreateVolumesFromImageTest-1973590822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:46:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2101371739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a69f918-84e7-41c9-99b1-070d587a88a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c6f74fc90554338b8f8c57674f11ca4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:46:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:46:59Z,use_quota=True,user_id='40ee4783931d4807ae4dcdec3bb8083c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:47:02 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-56bd6ee5-0ede-47e4-91b0-ceced9e52ec9 tempest-CreateVolumesFromImageTest-1973590822 None] Creating volume 9a69f918-84e7-41c9-99b1-070d587a88a1 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:47:02 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-56bd6ee5-0ede-47e4-91b0-ceced9e52ec9 tempest-CreateVolumesFromImageTest-1973590822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:47:02 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-56bd6ee5-0ede-47e4-91b0-ceced9e52ec9 tempest-CreateVolumesFromImageTest-1973590822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:47:02 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-56bd6ee5-0ede-47e4-91b0-ceced9e52ec9 tempest-CreateVolumesFromImageTest-1973590822 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:47:02 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-56bd6ee5-0ede-47e4-91b0-ceced9e52ec9 tempest-CreateVolumesFromImageTest-1973590822 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:47:02 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-56bd6ee5-0ede-47e4-91b0-ceced9e52ec9 tempest-CreateVolumesFromImageTest-1973590822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:47:02 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-56bd6ee5-0ede-47e4-91b0-ceced9e52ec9 tempest-CreateVolumesFromImageTest-1973590822 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:47:02 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-56bd6ee5-0ede-47e4-91b0-ceced9e52ec9 tempest-CreateVolumesFromImageTest-1973590822 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:47:02 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-56bd6ee5-0ede-47e4-91b0-ceced9e52ec9 tempest-CreateVolumesFromImageTest-1973590822 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-9a69f918-84e7-41c9-99b1-070d587a88a1 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:03 devstack quobyte-client[82807]: System call of process 101319 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:47:03 devstack quobyte-client[82807]: System call of process 101319 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:47:03 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=148, name=volume-9a69f918-84e7-41c9-99b1-070d587a88a1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:47:03 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4fe16899-cbe7-4256-bef7-49d531b97d63 tempest-CreateVolumesFromImageTest-1973590822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e0d449a-498b-46f3-bbd0-b4c5313e2a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b9ba58e-db2c-4828-b71e-198c746dcf7a', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:03 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4fe16899-cbe7-4256-bef7-49d531b97d63 tempest-CreateVolumesFromImageTest-1973590822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd644ca7-89b6-4fa4-9f1e-d2e31934cd16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:03 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-2e83e52b-f316-4e0b-a622-3bf97fd86f1d tempest-CinderUnicodeTest-2142680273 None] Created volume successfully. Sep 10 21:47:03 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-56bd6ee5-0ede-47e4-91b0-ceced9e52ec9 tempest-CreateVolumesFromImageTest-1973590822 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-9a69f918-84e7-41c9-99b1-070d587a88a1 1073741824" returned: 0 in 0.627s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:03 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-56bd6ee5-0ede-47e4-91b0-ceced9e52ec9 tempest-CreateVolumesFromImageTest-1973590822 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-9a69f918-84e7-41c9-99b1-070d587a88a1 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:03 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-4fe16899-cbe7-4256-bef7-49d531b97d63 tempest-CreateVolumesFromImageTest-1973590822 None] Volume volume-5b9ba58e-db2c-4828-b71e-198c746dcf7a (5b9ba58e-db2c-4828-b71e-198c746dcf7a): created successfully Sep 10 21:47:03 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4fe16899-cbe7-4256-bef7-49d531b97d63 tempest-CreateVolumesFromImageTest-1973590822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd644ca7-89b6-4fa4-9f1e-d2e31934cd16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:03 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4fe16899-cbe7-4256-bef7-49d531b97d63 tempest-CreateVolumesFromImageTest-1973590822 None] Flow 'volume_create_manager' (3f1cb09b-f115-4a50-87ca-116874a6dbd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:47:03 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-56bd6ee5-0ede-47e4-91b0-ceced9e52ec9 tempest-CreateVolumesFromImageTest-1973590822 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-9a69f918-84e7-41c9-99b1-070d587a88a1" returned: 0 in 0.535s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:03 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-56bd6ee5-0ede-47e4-91b0-ceced9e52ec9 tempest-CreateVolumesFromImageTest-1973590822 None] <== create_volume: return (1191ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:47:03 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-56bd6ee5-0ede-47e4-91b0-ceced9e52ec9 tempest-CreateVolumesFromImageTest-1973590822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.200s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:47:03 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-66888740-38b0-4c1e-ada2-5da8a1f586fd tempest-CreateVolumesFromImageTest-1973590822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.283s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:47:04 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-66888740-38b0-4c1e-ada2-5da8a1f586fd tempest-CreateVolumesFromImageTest-1973590822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:46:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-605254187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df52c8a9-813f-46b7-b449-4e248045ee58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c6f74fc90554338b8f8c57674f11ca4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:47:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:47:00Z,use_quota=True,user_id='40ee4783931d4807ae4dcdec3bb8083c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:47:04 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-66888740-38b0-4c1e-ada2-5da8a1f586fd tempest-CreateVolumesFromImageTest-1973590822 None] Creating volume df52c8a9-813f-46b7-b449-4e248045ee58 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:47:04 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-66888740-38b0-4c1e-ada2-5da8a1f586fd tempest-CreateVolumesFromImageTest-1973590822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:47:04 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-66888740-38b0-4c1e-ada2-5da8a1f586fd tempest-CreateVolumesFromImageTest-1973590822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:47:04 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-66888740-38b0-4c1e-ada2-5da8a1f586fd tempest-CreateVolumesFromImageTest-1973590822 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:47:04 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-66888740-38b0-4c1e-ada2-5da8a1f586fd tempest-CreateVolumesFromImageTest-1973590822 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:47:04 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-66888740-38b0-4c1e-ada2-5da8a1f586fd tempest-CreateVolumesFromImageTest-1973590822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:47:04 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-66888740-38b0-4c1e-ada2-5da8a1f586fd tempest-CreateVolumesFromImageTest-1973590822 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:47:04 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-66888740-38b0-4c1e-ada2-5da8a1f586fd tempest-CreateVolumesFromImageTest-1973590822 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:47:04 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-66888740-38b0-4c1e-ada2-5da8a1f586fd tempest-CreateVolumesFromImageTest-1973590822 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-df52c8a9-813f-46b7-b449-4e248045ee58 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:04 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-4fe16899-cbe7-4256-bef7-49d531b97d63 tempest-CreateVolumesFromImageTest-1973590822 None] Created volume successfully. Sep 10 21:47:04 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=149, name=volume-df52c8a9-813f-46b7-b449-4e248045ee58, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:47:04 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:47:04 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:47:04 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] Flow 'volume_create_manager' (bcccb962-aabb-4131-8d09-82cdbf83619c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:47:04 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c525d46-07d1-4f56-870f-54300e47229f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:04 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c525d46-07d1-4f56-870f-54300e47229f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:47:03Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2584c329-f960-42c2-b5bb-d343fcac9d2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdf97ce8480c458cb1f3600a7af0e2b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:47:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:47:04Z,use_quota=True,user_id='eb036dda0f244bc5bcf3718e2a45f929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:04 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (632dbae8-949c-4307-bd66-73f8f17c0669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:04 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (632dbae8-949c-4307-bd66-73f8f17c0669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:04 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b507522-89ff-4b13-a4de-a8d1498018c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:04 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-56bd6ee5-0ede-47e4-91b0-ceced9e52ec9 tempest-CreateVolumesFromImageTest-1973590822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89835617-c8a9-4bb3-a061-f8ed6fda79b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a69f918-84e7-41c9-99b1-070d587a88a1', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:04 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-56bd6ee5-0ede-47e4-91b0-ceced9e52ec9 tempest-CreateVolumesFromImageTest-1973590822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6af7458-fac4-4b2b-9b48-2ff0d9cd6090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:04 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-66888740-38b0-4c1e-ada2-5da8a1f586fd tempest-CreateVolumesFromImageTest-1973590822 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-df52c8a9-813f-46b7-b449-4e248045ee58 1073741824" returned: 0 in 0.773s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:04 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-66888740-38b0-4c1e-ada2-5da8a1f586fd tempest-CreateVolumesFromImageTest-1973590822 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-df52c8a9-813f-46b7-b449-4e248045ee58 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:05 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-56bd6ee5-0ede-47e4-91b0-ceced9e52ec9 tempest-CreateVolumesFromImageTest-1973590822 None] Volume volume-9a69f918-84e7-41c9-99b1-070d587a88a1 (9a69f918-84e7-41c9-99b1-070d587a88a1): created successfully Sep 10 21:47:05 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-56bd6ee5-0ede-47e4-91b0-ceced9e52ec9 tempest-CreateVolumesFromImageTest-1973590822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6af7458-fac4-4b2b-9b48-2ff0d9cd6090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:05 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-56bd6ee5-0ede-47e4-91b0-ceced9e52ec9 tempest-CreateVolumesFromImageTest-1973590822 None] Flow 'volume_create_manager' (8d8f53f9-3187-458a-9bbb-bed4e626e3b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:47:05 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-c9e2a977-2e9f-4d53-bd0f-3f1094124262 tempest-CinderUnicodeTest-2142680273 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:47:05 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9e2a977-2e9f-4d53-bd0f-3f1094124262 tempest-CinderUnicodeTest-2142680273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:47:05 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c9e2a977-2e9f-4d53-bd0f-3f1094124262 tempest-CinderUnicodeTest-2142680273 None] Flow 'volume_create_manager' (886a8fa9-bb90-4f39-8b7a-94c280093eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:47:05 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c9e2a977-2e9f-4d53-bd0f-3f1094124262 tempest-CinderUnicodeTest-2142680273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5850fb21-2cdc-4715-b01b-bffca66857d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:05 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c9e2a977-2e9f-4d53-bd0f-3f1094124262 tempest-CinderUnicodeTest-2142680273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5850fb21-2cdc-4715-b01b-bffca66857d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:47:03Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-354389409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac9b5975-7ffb-4efd-a6f5-173e8490dec3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a147c029a66b45edb1ca60d2810a41bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:47:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:47:04Z,use_quota=True,user_id='cf12089d0ecf4704994778cfb1f97afb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:05 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c9e2a977-2e9f-4d53-bd0f-3f1094124262 tempest-CinderUnicodeTest-2142680273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a85ca364-4f60-4f06-8597-4a32e9b47555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:05 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c9e2a977-2e9f-4d53-bd0f-3f1094124262 tempest-CinderUnicodeTest-2142680273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a85ca364-4f60-4f06-8597-4a32e9b47555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:05 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c9e2a977-2e9f-4d53-bd0f-3f1094124262 tempest-CinderUnicodeTest-2142680273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24ffc616-1f90-4432-8d74-754dfdb60c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:05 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c9e2a977-2e9f-4d53-bd0f-3f1094124262 tempest-CinderUnicodeTest-2142680273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24ffc616-1f90-4432-8d74-754dfdb60c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac9b5975-7ffb-4efd-a6f5-173e8490dec3', 'volume_name': 'volume-ac9b5975-7ffb-4efd-a6f5-173e8490dec3', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:05 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c9e2a977-2e9f-4d53-bd0f-3f1094124262 tempest-CinderUnicodeTest-2142680273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9812d89-a7f2-454a-952d-938fc4ccab9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:05 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c9e2a977-2e9f-4d53-bd0f-3f1094124262 tempest-CinderUnicodeTest-2142680273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9812d89-a7f2-454a-952d-938fc4ccab9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:05 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c9e2a977-2e9f-4d53-bd0f-3f1094124262 tempest-CinderUnicodeTest-2142680273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c602968-c496-46a9-83ee-f49ba67d64de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:05 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-c9e2a977-2e9f-4d53-bd0f-3f1094124262 tempest-CinderUnicodeTest-2142680273 None] Volume ac9b5975-7ffb-4efd-a6f5-173e8490dec3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac9b5975-7ffb-4efd-a6f5-173e8490dec3', 'volume_size': 1} Sep 10 21:47:05 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-c9e2a977-2e9f-4d53-bd0f-3f1094124262 tempest-CinderUnicodeTest-2142680273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:47:05 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-66888740-38b0-4c1e-ada2-5da8a1f586fd tempest-CreateVolumesFromImageTest-1973590822 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-df52c8a9-813f-46b7-b449-4e248045ee58" returned: 0 in 0.601s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:05 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-66888740-38b0-4c1e-ada2-5da8a1f586fd tempest-CreateVolumesFromImageTest-1973590822 None] <== create_volume: return (1392ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:47:05 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-66888740-38b0-4c1e-ada2-5da8a1f586fd tempest-CreateVolumesFromImageTest-1973590822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.402s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:47:05 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-9ad6aee6-7b97-478f-b31b-f9775a213082 tempest-CreateVolumesFromImageTest-1973590822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.774s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:47:05 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-9ad6aee6-7b97-478f-b31b-f9775a213082 tempest-CreateVolumesFromImageTest-1973590822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:47:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1425191221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e1f8be4-b9c0-4edf-a6b8-40ad167c2897,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c6f74fc90554338b8f8c57674f11ca4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:47:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:47:01Z,use_quota=True,user_id='40ee4783931d4807ae4dcdec3bb8083c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:47:05 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-9ad6aee6-7b97-478f-b31b-f9775a213082 tempest-CreateVolumesFromImageTest-1973590822 None] Creating volume 5e1f8be4-b9c0-4edf-a6b8-40ad167c2897 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:47:05 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-9ad6aee6-7b97-478f-b31b-f9775a213082 tempest-CreateVolumesFromImageTest-1973590822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:47:05 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-9ad6aee6-7b97-478f-b31b-f9775a213082 tempest-CreateVolumesFromImageTest-1973590822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:47:05 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-9ad6aee6-7b97-478f-b31b-f9775a213082 tempest-CreateVolumesFromImageTest-1973590822 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:47:05 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-9ad6aee6-7b97-478f-b31b-f9775a213082 tempest-CreateVolumesFromImageTest-1973590822 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:47:05 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-9ad6aee6-7b97-478f-b31b-f9775a213082 tempest-CreateVolumesFromImageTest-1973590822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:47:05 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-9ad6aee6-7b97-478f-b31b-f9775a213082 tempest-CreateVolumesFromImageTest-1973590822 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:47:05 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-9ad6aee6-7b97-478f-b31b-f9775a213082 tempest-CreateVolumesFromImageTest-1973590822 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:47:05 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9ad6aee6-7b97-478f-b31b-f9775a213082 tempest-CreateVolumesFromImageTest-1973590822 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5e1f8be4-b9c0-4edf-a6b8-40ad167c2897 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:05 devstack quobyte-client[82807]: System call of process 101327 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:47:05 devstack quobyte-client[82807]: System call of process 101327 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:47:05 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=150, name=volume-5e1f8be4-b9c0-4edf-a6b8-40ad167c2897, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:47:05 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-56bd6ee5-0ede-47e4-91b0-ceced9e52ec9 tempest-CreateVolumesFromImageTest-1973590822 None] Created volume successfully. Sep 10 21:47:05 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-66888740-38b0-4c1e-ada2-5da8a1f586fd tempest-CreateVolumesFromImageTest-1973590822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ac51726-9947-4878-8802-a4fc49f7b8ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df52c8a9-813f-46b7-b449-4e248045ee58', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:05 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-66888740-38b0-4c1e-ada2-5da8a1f586fd tempest-CreateVolumesFromImageTest-1973590822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e61ab12-2757-439b-8559-3838822b6dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:06 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b507522-89ff-4b13-a4de-a8d1498018c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2584c329-f960-42c2-b5bb-d343fcac9d2e', 'volume_name': 'volume-2584c329-f960-42c2-b5bb-d343fcac9d2e', 'volume_size': 1, 'image_id': '6dfcebc6-14a5-4934-9b63-791cd42b6fa3', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2041981a10fe58fd499058110f0397e4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bdf97ce8480c458cb1f3600a7af0e2b0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5d2cf5a9b5551d735ac77a36997467056369926dfecffec031be92cdeddd68d10c3fd589cc5cfc113b3f765bb3c13ee854e85f38f09bb148734830841b0226b9', 'id': '6dfcebc6-14a5-4934-9b63-791cd42b6fa3', 'created_at': datetime.datetime(2025, 9, 10, 19, 46, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 19, 47, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6dfcebc6-14a5-4934-9b63-791cd42b6fa3/file', 'properties': {}}, 'image_service': }' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:06 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c9360db-283c-4ae8-9d7b-c65abd7dc613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:06 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c9360db-283c-4ae8-9d7b-c65abd7dc613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:06 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62b7d789-4ab7-4f39-a5ee-3ee9ce39fa5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:06 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] Volume 2584c329-f960-42c2-b5bb-d343fcac9d2e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2584c329-f960-42c2-b5bb-d343fcac9d2e', 'volume_size': 1, 'image_id': '6dfcebc6-14a5-4934-9b63-791cd42b6fa3', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2041981a10fe58fd499058110f0397e4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bdf97ce8480c458cb1f3600a7af0e2b0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5d2cf5a9b5551d735ac77a36997467056369926dfecffec031be92cdeddd68d10c3fd589cc5cfc113b3f765bb3c13ee854e85f38f09bb148734830841b0226b9', 'id': '6dfcebc6-14a5-4934-9b63-791cd42b6fa3', 'created_at': datetime.datetime(2025, 9, 10, 19, 46, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 19, 47, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6dfcebc6-14a5-4934-9b63-791cd42b6fa3/file', 'properties': {}}, 'image_service': } Sep 10 21:47:06 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] Cloning 2584c329-f960-42c2-b5bb-d343fcac9d2e from image 6dfcebc6-14a5-4934-9b63-791cd42b6fa3 at location (None, None). {{(pid=82780) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1083}} Sep 10 21:47:06 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9ad6aee6-7b97-478f-b31b-f9775a213082 tempest-CreateVolumesFromImageTest-1973590822 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5e1f8be4-b9c0-4edf-a6b8-40ad167c2897 1073741824" returned: 0 in 0.676s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:06 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9ad6aee6-7b97-478f-b31b-f9775a213082 tempest-CreateVolumesFromImageTest-1973590822 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5e1f8be4-b9c0-4edf-a6b8-40ad167c2897 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:06 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-66888740-38b0-4c1e-ada2-5da8a1f586fd tempest-CreateVolumesFromImageTest-1973590822 None] Volume volume-df52c8a9-813f-46b7-b449-4e248045ee58 (df52c8a9-813f-46b7-b449-4e248045ee58): created successfully Sep 10 21:47:06 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-66888740-38b0-4c1e-ada2-5da8a1f586fd tempest-CreateVolumesFromImageTest-1973590822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e61ab12-2757-439b-8559-3838822b6dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:06 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-66888740-38b0-4c1e-ada2-5da8a1f586fd tempest-CreateVolumesFromImageTest-1973590822 None] Flow 'volume_create_manager' (289e3966-266f-4024-b76c-227da3bef1ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:47:06 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9ad6aee6-7b97-478f-b31b-f9775a213082 tempest-CreateVolumesFromImageTest-1973590822 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5e1f8be4-b9c0-4edf-a6b8-40ad167c2897" returned: 0 in 0.367s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:06 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-9ad6aee6-7b97-478f-b31b-f9775a213082 tempest-CreateVolumesFromImageTest-1973590822 None] <== create_volume: return (1063ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:47:06 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-9ad6aee6-7b97-478f-b31b-f9775a213082 tempest-CreateVolumesFromImageTest-1973590822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:47:06 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-82d0ae0a-8f19-4394-a78e-38fa2056923b tempest-CreateVolumesFromImageTest-1973590822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.730s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:47:06 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-82d0ae0a-8f19-4394-a78e-38fa2056923b tempest-CreateVolumesFromImageTest-1973590822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:47:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1536367142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9303c491-24ed-4550-bc8e-f9c39818d8e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c6f74fc90554338b8f8c57674f11ca4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:47:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:47:00Z,use_quota=True,user_id='40ee4783931d4807ae4dcdec3bb8083c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:47:06 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-82d0ae0a-8f19-4394-a78e-38fa2056923b tempest-CreateVolumesFromImageTest-1973590822 None] Creating volume 9303c491-24ed-4550-bc8e-f9c39818d8e6 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:47:06 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-82d0ae0a-8f19-4394-a78e-38fa2056923b tempest-CreateVolumesFromImageTest-1973590822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:47:06 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-82d0ae0a-8f19-4394-a78e-38fa2056923b tempest-CreateVolumesFromImageTest-1973590822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:47:06 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-82d0ae0a-8f19-4394-a78e-38fa2056923b tempest-CreateVolumesFromImageTest-1973590822 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:47:06 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-82d0ae0a-8f19-4394-a78e-38fa2056923b tempest-CreateVolumesFromImageTest-1973590822 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:47:06 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-82d0ae0a-8f19-4394-a78e-38fa2056923b tempest-CreateVolumesFromImageTest-1973590822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:47:06 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-82d0ae0a-8f19-4394-a78e-38fa2056923b tempest-CreateVolumesFromImageTest-1973590822 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:47:06 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-82d0ae0a-8f19-4394-a78e-38fa2056923b tempest-CreateVolumesFromImageTest-1973590822 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:47:06 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-82d0ae0a-8f19-4394-a78e-38fa2056923b tempest-CreateVolumesFromImageTest-1973590822 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-9303c491-24ed-4550-bc8e-f9c39818d8e6 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:06 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=151, name=volume-9303c491-24ed-4550-bc8e-f9c39818d8e6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:47:06 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-66888740-38b0-4c1e-ada2-5da8a1f586fd tempest-CreateVolumesFromImageTest-1973590822 None] Created volume successfully. Sep 10 21:47:06 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-9ad6aee6-7b97-478f-b31b-f9775a213082 tempest-CreateVolumesFromImageTest-1973590822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edc88f86-973e-4f0f-b89c-b562c0363e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e1f8be4-b9c0-4edf-a6b8-40ad167c2897', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:06 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-9ad6aee6-7b97-478f-b31b-f9775a213082 tempest-CreateVolumesFromImageTest-1973590822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53578643-63d1-4c1f-82de-3732643abf3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:07 devstack cinder-volume[82780]: DEBUG cinder.image.image_utils [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6dfcebc6-14a5-4934-9b63-791cd42b6fa3_78y2gjhmdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=82780) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 10 21:47:07 devstack cinder-volume[82780]: INFO cinder.image.image_utils [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] Image download 0.00 MB at 0.00 MB/s Sep 10 21:47:07 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-9ad6aee6-7b97-478f-b31b-f9775a213082 tempest-CreateVolumesFromImageTest-1973590822 None] Volume volume-5e1f8be4-b9c0-4edf-a6b8-40ad167c2897 (5e1f8be4-b9c0-4edf-a6b8-40ad167c2897): created successfully Sep 10 21:47:07 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-9ad6aee6-7b97-478f-b31b-f9775a213082 tempest-CreateVolumesFromImageTest-1973590822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53578643-63d1-4c1f-82de-3732643abf3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:07 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-9ad6aee6-7b97-478f-b31b-f9775a213082 tempest-CreateVolumesFromImageTest-1973590822 None] Flow 'volume_create_manager' (81bd7c2a-c918-4a1c-ba7d-3b44a94489c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:47:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-82d0ae0a-8f19-4394-a78e-38fa2056923b tempest-CreateVolumesFromImageTest-1973590822 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-9303c491-24ed-4550-bc8e-f9c39818d8e6 1073741824" returned: 0 in 0.651s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-82d0ae0a-8f19-4394-a78e-38fa2056923b tempest-CreateVolumesFromImageTest-1973590822 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-9303c491-24ed-4550-bc8e-f9c39818d8e6 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:07 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc4eefa-887c-44e5-aa6e-42e3475ef874]: (4, 'raw') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:47:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6dfcebc6-14a5-4934-9b63-791cd42b6fa3_78y2gjhmdevstack@QuobyteHD {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:07 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-9ad6aee6-7b97-478f-b31b-f9775a213082 tempest-CreateVolumesFromImageTest-1973590822 None] Created volume successfully. Sep 10 21:47:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-82d0ae0a-8f19-4394-a78e-38fa2056923b tempest-CreateVolumesFromImageTest-1973590822 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-9303c491-24ed-4550-bc8e-f9c39818d8e6" returned: 0 in 0.410s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:07 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-82d0ae0a-8f19-4394-a78e-38fa2056923b tempest-CreateVolumesFromImageTest-1973590822 None] <== create_volume: return (1110ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:47:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-82d0ae0a-8f19-4394-a78e-38fa2056923b tempest-CreateVolumesFromImageTest-1973590822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:47:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-c9e2a977-2e9f-4d53-bd0f-3f1094124262 tempest-CinderUnicodeTest-2142680273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.290s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:47:07 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-c9e2a977-2e9f-4d53-bd0f-3f1094124262 tempest-CinderUnicodeTest-2142680273 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:47:03Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-354389409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac9b5975-7ffb-4efd-a6f5-173e8490dec3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a147c029a66b45edb1ca60d2810a41bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:47:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:47:04Z,use_quota=True,user_id='cf12089d0ecf4704994778cfb1f97afb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:47:07 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-c9e2a977-2e9f-4d53-bd0f-3f1094124262 tempest-CinderUnicodeTest-2142680273 None] Creating volume ac9b5975-7ffb-4efd-a6f5-173e8490dec3 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:47:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-c9e2a977-2e9f-4d53-bd0f-3f1094124262 tempest-CinderUnicodeTest-2142680273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:47:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-c9e2a977-2e9f-4d53-bd0f-3f1094124262 tempest-CinderUnicodeTest-2142680273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:47:07 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-c9e2a977-2e9f-4d53-bd0f-3f1094124262 tempest-CinderUnicodeTest-2142680273 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:47:07 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-c9e2a977-2e9f-4d53-bd0f-3f1094124262 tempest-CinderUnicodeTest-2142680273 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:47:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-c9e2a977-2e9f-4d53-bd0f-3f1094124262 tempest-CinderUnicodeTest-2142680273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:47:07 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-c9e2a977-2e9f-4d53-bd0f-3f1094124262 tempest-CinderUnicodeTest-2142680273 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:47:07 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-c9e2a977-2e9f-4d53-bd0f-3f1094124262 tempest-CinderUnicodeTest-2142680273 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:47:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c9e2a977-2e9f-4d53-bd0f-3f1094124262 tempest-CinderUnicodeTest-2142680273 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ac9b5975-7ffb-4efd-a6f5-173e8490dec3 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:07 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=152, name=volume-ac9b5975-7ffb-4efd-a6f5-173e8490dec3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:47:07 devstack sudo[101335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6dfcebc6-14a5-4934-9b63-791cd42b6fa3_78y2gjhmdevstack@QuobyteHD Sep 10 21:47:08 devstack sudo[101335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 21:47:08 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-82d0ae0a-8f19-4394-a78e-38fa2056923b tempest-CreateVolumesFromImageTest-1973590822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8a3279c-377a-4476-b4e5-30bbafd0a3ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9303c491-24ed-4550-bc8e-f9c39818d8e6', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:08 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-82d0ae0a-8f19-4394-a78e-38fa2056923b tempest-CreateVolumesFromImageTest-1973590822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08cb4809-0292-4eed-a7ba-b0983fdaaa01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:08 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-82d0ae0a-8f19-4394-a78e-38fa2056923b tempest-CreateVolumesFromImageTest-1973590822 None] Volume volume-9303c491-24ed-4550-bc8e-f9c39818d8e6 (9303c491-24ed-4550-bc8e-f9c39818d8e6): created successfully Sep 10 21:47:08 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-82d0ae0a-8f19-4394-a78e-38fa2056923b tempest-CreateVolumesFromImageTest-1973590822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08cb4809-0292-4eed-a7ba-b0983fdaaa01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:08 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-82d0ae0a-8f19-4394-a78e-38fa2056923b tempest-CreateVolumesFromImageTest-1973590822 None] Flow 'volume_create_manager' (2c5ffa6c-bce7-4878-af81-c9eb180787eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:47:08 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c9e2a977-2e9f-4d53-bd0f-3f1094124262 tempest-CinderUnicodeTest-2142680273 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ac9b5975-7ffb-4efd-a6f5-173e8490dec3 1073741824" returned: 0 in 0.620s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:08 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c9e2a977-2e9f-4d53-bd0f-3f1094124262 tempest-CinderUnicodeTest-2142680273 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ac9b5975-7ffb-4efd-a6f5-173e8490dec3 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:08 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-82d0ae0a-8f19-4394-a78e-38fa2056923b tempest-CreateVolumesFromImageTest-1973590822 None] Created volume successfully. Sep 10 21:47:08 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c9e2a977-2e9f-4d53-bd0f-3f1094124262 tempest-CinderUnicodeTest-2142680273 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ac9b5975-7ffb-4efd-a6f5-173e8490dec3" returned: 0 in 0.332s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:08 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-c9e2a977-2e9f-4d53-bd0f-3f1094124262 tempest-CinderUnicodeTest-2142680273 None] <== create_volume: return (995ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:47:08 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-c9e2a977-2e9f-4d53-bd0f-3f1094124262 tempest-CinderUnicodeTest-2142680273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:47:08 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c9e2a977-2e9f-4d53-bd0f-3f1094124262 tempest-CinderUnicodeTest-2142680273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c602968-c496-46a9-83ee-f49ba67d64de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac9b5975-7ffb-4efd-a6f5-173e8490dec3', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:08 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c9e2a977-2e9f-4d53-bd0f-3f1094124262 tempest-CinderUnicodeTest-2142680273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16e7b5cc-f6a5-4d2b-8b27-4fe96172f299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:08 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-c9e2a977-2e9f-4d53-bd0f-3f1094124262 tempest-CinderUnicodeTest-2142680273 None] Volume volume-ac9b5975-7ffb-4efd-a6f5-173e8490dec3 (ac9b5975-7ffb-4efd-a6f5-173e8490dec3): created successfully Sep 10 21:47:08 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c9e2a977-2e9f-4d53-bd0f-3f1094124262 tempest-CinderUnicodeTest-2142680273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16e7b5cc-f6a5-4d2b-8b27-4fe96172f299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:08 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c9e2a977-2e9f-4d53-bd0f-3f1094124262 tempest-CinderUnicodeTest-2142680273 None] Flow 'volume_create_manager' (886a8fa9-bb90-4f39-8b7a-94c280093eb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:47:08 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-c9e2a977-2e9f-4d53-bd0f-3f1094124262 tempest-CinderUnicodeTest-2142680273 None] Created volume successfully. Sep 10 21:47:10 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-7c5e161d-2d20-4699-9d95-e03f143fad94 tempest-CreateVolumesFromImageTest-1973590822 None] Acquiring lock "cinder-5e1f8be4-b9c0-4edf-a6b8-40ad167c2897-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:47:10 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-7c5e161d-2d20-4699-9d95-e03f143fad94 tempest-CreateVolumesFromImageTest-1973590822 None] Lock "cinder-5e1f8be4-b9c0-4edf-a6b8-40ad167c2897-delete_volume" acquired by "delete_volume" :: waited 0.296s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:47:10 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-ac1e8ef6-acfa-4db6-a11c-cf4306e1b6c6 tempest-CinderUnicodeTest-2142680273 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:47:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-ac1e8ef6-acfa-4db6-a11c-cf4306e1b6c6 tempest-CinderUnicodeTest-2142680273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:47:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-ac1e8ef6-acfa-4db6-a11c-cf4306e1b6c6 tempest-CinderUnicodeTest-2142680273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:47:10 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-ac1e8ef6-acfa-4db6-a11c-cf4306e1b6c6 tempest-CinderUnicodeTest-2142680273 None] Creating offline snapshot 9d77c1ef-98ed-40fe-b4ff-063668557296 of volume ac9b5975-7ffb-4efd-a6f5-173e8490dec3 {{(pid=82780) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 21:47:10 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-7c5e161d-2d20-4699-9d95-e03f143fad94 tempest-CreateVolumesFromImageTest-1973590822 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:47:10 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-7c5e161d-2d20-4699-9d95-e03f143fad94 tempest-CreateVolumesFromImageTest-1973590822 None] Acquiring lock "cinder-quobyte-5e1f8be4-b9c0-4edf-a6b8-40ad167c2897" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:47:10 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c94c70-ffeb-4379-8d60-b59ea6f33b25]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:47:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ac1e8ef6-acfa-4db6-a11c-cf4306e1b6c6 tempest-CinderUnicodeTest-2142680273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ac9b5975-7ffb-4efd-a6f5-173e8490dec3 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:10 devstack sudo[101335]: pam_unix(sudo:session): session closed for user root Sep 10 21:47:10 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-7c5e161d-2d20-4699-9d95-e03f143fad94 tempest-CreateVolumesFromImageTest-1973590822 None] Lock "cinder-quobyte-5e1f8be4-b9c0-4edf-a6b8-40ad167c2897" acquired by "delete_volume" :: waited 0.352s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:47:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6dfcebc6-14a5-4934-9b63-791cd42b6fa3_78y2gjhmdevstack@QuobyteHD" returned: 0 in 3.597s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6dfcebc6-14a5-4934-9b63-791cd42b6fa3_78y2gjhmdevstack@QuobyteHD {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:11 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f0419b-802a-42d7-8554-b44670b7cbfe]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:47:11 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-7c5e161d-2d20-4699-9d95-e03f143fad94 tempest-CreateVolumesFromImageTest-1973590822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5e1f8be4-b9c0-4edf-a6b8-40ad167c2897 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:11 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ac1e8ef6-acfa-4db6-a11c-cf4306e1b6c6 tempest-CinderUnicodeTest-2142680273 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ac9b5975-7ffb-4efd-a6f5-173e8490dec3" returned: 0 in 0.755s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:11 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ac1e8ef6-acfa-4db6-a11c-cf4306e1b6c6 tempest-CinderUnicodeTest-2142680273 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ac9b5975-7ffb-4efd-a6f5-173e8490dec3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ac9b5975-7ffb-4efd-a6f5-173e8490dec3.9d77c1ef-98ed-40fe-b4ff-063668557296 1G {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:11 devstack sudo[101377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6dfcebc6-14a5-4934-9b63-791cd42b6fa3_78y2gjhmdevstack@QuobyteHD Sep 10 21:47:11 devstack sudo[101377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 21:47:11 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=153, name=volume-ac9b5975-7ffb-4efd-a6f5-173e8490dec3.9d77c1ef-98ed-40fe-b4ff-063668557296, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:47:11 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ac1e8ef6-acfa-4db6-a11c-cf4306e1b6c6 tempest-CinderUnicodeTest-2142680273 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ac9b5975-7ffb-4efd-a6f5-173e8490dec3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ac9b5975-7ffb-4efd-a6f5-173e8490dec3.9d77c1ef-98ed-40fe-b4ff-063668557296 1G" returned: 0 in 0.357s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:11 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ac1e8ef6-acfa-4db6-a11c-cf4306e1b6c6 tempest-CinderUnicodeTest-2142680273 None] Running cmd (subprocess): qemu-img rebase -u -b volume-ac9b5975-7ffb-4efd-a6f5-173e8490dec3 -F qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ac9b5975-7ffb-4efd-a6f5-173e8490dec3.9d77c1ef-98ed-40fe-b4ff-063668557296 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:11 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-7c5e161d-2d20-4699-9d95-e03f143fad94 tempest-CreateVolumesFromImageTest-1973590822 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5e1f8be4-b9c0-4edf-a6b8-40ad167c2897" returned: 0 in 0.849s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:11 devstack quobyte-client[82807]: System call of process 101387 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:47:11 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-7c5e161d-2d20-4699-9d95-e03f143fad94 tempest-CreateVolumesFromImageTest-1973590822 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5e1f8be4-b9c0-4edf-a6b8-40ad167c2897 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:12 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ac1e8ef6-acfa-4db6-a11c-cf4306e1b6c6 tempest-CinderUnicodeTest-2142680273 None] CMD "qemu-img rebase -u -b volume-ac9b5975-7ffb-4efd-a6f5-173e8490dec3 -F qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ac9b5975-7ffb-4efd-a6f5-173e8490dec3.9d77c1ef-98ed-40fe-b4ff-063668557296" returned: 0 in 0.282s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:12 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-ac1e8ef6-acfa-4db6-a11c-cf4306e1b6c6 tempest-CinderUnicodeTest-2142680273 None] File path /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ac9b5975-7ffb-4efd-a6f5-173e8490dec3.9d77c1ef-98ed-40fe-b4ff-063668557296 is being set with permissions: 660 {{(pid=82780) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 21:47:12 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ac1e8ef6-acfa-4db6-a11c-cf4306e1b6c6 tempest-CinderUnicodeTest-2142680273 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ac9b5975-7ffb-4efd-a6f5-173e8490dec3.9d77c1ef-98ed-40fe-b4ff-063668557296 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:12 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-7c5e161d-2d20-4699-9d95-e03f143fad94 tempest-CreateVolumesFromImageTest-1973590822 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5e1f8be4-b9c0-4edf-a6b8-40ad167c2897" returned: 0 in 0.269s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:12 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ac1e8ef6-acfa-4db6-a11c-cf4306e1b6c6 tempest-CinderUnicodeTest-2142680273 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ac9b5975-7ffb-4efd-a6f5-173e8490dec3.9d77c1ef-98ed-40fe-b4ff-063668557296" returned: 0 in 0.238s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:12 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-ac1e8ef6-acfa-4db6-a11c-cf4306e1b6c6 tempest-CinderUnicodeTest-2142680273 None] Setting permissions: /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ac9b5975-7ffb-4efd-a6f5-173e8490dec3 -> 1000:1000 {{(pid=82780) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 21:47:12 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ac1e8ef6-acfa-4db6-a11c-cf4306e1b6c6 tempest-CinderUnicodeTest-2142680273 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ac9b5975-7ffb-4efd-a6f5-173e8490dec3 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ac9b5975-7ffb-4efd-a6f5-173e8490dec3.9d77c1ef-98ed-40fe-b4ff-063668557296 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:12 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-7c5e161d-2d20-4699-9d95-e03f143fad94 tempest-CreateVolumesFromImageTest-1973590822 None] Lock "cinder-quobyte-5e1f8be4-b9c0-4edf-a6b8-40ad167c2897" released by "delete_volume" :: held 1.655s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:47:12 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ac1e8ef6-acfa-4db6-a11c-cf4306e1b6c6 tempest-CinderUnicodeTest-2142680273 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ac9b5975-7ffb-4efd-a6f5-173e8490dec3 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ac9b5975-7ffb-4efd-a6f5-173e8490dec3.9d77c1ef-98ed-40fe-b4ff-063668557296" returned: 0 in 0.446s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:12 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ac1e8ef6-acfa-4db6-a11c-cf4306e1b6c6 tempest-CinderUnicodeTest-2142680273 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ac9b5975-7ffb-4efd-a6f5-173e8490dec3.info {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:13 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ac1e8ef6-acfa-4db6-a11c-cf4306e1b6c6 tempest-CinderUnicodeTest-2142680273 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ac9b5975-7ffb-4efd-a6f5-173e8490dec3.info" returned: 0 in 0.374s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:13 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-ac1e8ef6-acfa-4db6-a11c-cf4306e1b6c6 tempest-CinderUnicodeTest-2142680273 None] File path /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ac9b5975-7ffb-4efd-a6f5-173e8490dec3.info is being set with permissions: 660 {{(pid=82780) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 21:47:13 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ac1e8ef6-acfa-4db6-a11c-cf4306e1b6c6 tempest-CinderUnicodeTest-2142680273 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ac9b5975-7ffb-4efd-a6f5-173e8490dec3.info {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:13 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ac1e8ef6-acfa-4db6-a11c-cf4306e1b6c6 tempest-CinderUnicodeTest-2142680273 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ac9b5975-7ffb-4efd-a6f5-173e8490dec3.info" returned: 0 in 0.445s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:13 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-ac1e8ef6-acfa-4db6-a11c-cf4306e1b6c6 tempest-CinderUnicodeTest-2142680273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.292s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:47:14 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-ac1e8ef6-acfa-4db6-a11c-cf4306e1b6c6 tempest-CinderUnicodeTest-2142680273 None] Create snapshot completed successfully Sep 10 21:47:14 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-7c5e161d-2d20-4699-9d95-e03f143fad94 tempest-CreateVolumesFromImageTest-1973590822 None] Created reservations ['284fb447-06d9-4e5f-abcf-0f091e18b7ef', '0277a7c4-cf32-4904-a1c3-61d392534391', '4c286ea2-6f6c-4652-a9da-804a139d54d4', 'e09ec173-d7ee-4ce3-847f-86f5ff1655ad'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:47:14 devstack sudo[101377]: pam_unix(sudo:session): session closed for user root Sep 10 21:47:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6dfcebc6-14a5-4934-9b63-791cd42b6fa3_78y2gjhmdevstack@QuobyteHD" returned: 1 in 3.264s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6dfcebc6-14a5-4934-9b63-791cd42b6fa3_78y2gjhmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 21:47:14 devstack cinder-volume[82780]: DEBUG cinder.image.image_utils [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] Temporary image 6dfcebc6-14a5-4934-9b63-791cd42b6fa3 is fetched for user eb036dda0f244bc5bcf3718e2a45f929. {{(pid=82780) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 10 21:47:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-7c5e161d-2d20-4699-9d95-e03f143fad94 tempest-CreateVolumesFromImageTest-1973590822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:47:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-7c5e161d-2d20-4699-9d95-e03f143fad94 tempest-CreateVolumesFromImageTest-1973590822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:47:14 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-7c5e161d-2d20-4699-9d95-e03f143fad94 tempest-CreateVolumesFromImageTest-1973590822 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:47:14 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-7c5e161d-2d20-4699-9d95-e03f143fad94 tempest-CreateVolumesFromImageTest-1973590822 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:47:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-7c5e161d-2d20-4699-9d95-e03f143fad94 tempest-CreateVolumesFromImageTest-1973590822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:47:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-7c5e161d-2d20-4699-9d95-e03f143fad94 tempest-CreateVolumesFromImageTest-1973590822 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:14 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-94c98593-5c78-4d84-8a1c-99a507ff362b tempest-CreateVolumesFromImageTest-1973590822 None] Acquiring lock "cinder-9303c491-24ed-4550-bc8e-f9c39818d8e6-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:47:14 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-14f4e361-14f7-4339-9d8f-b2cd0064df2e tempest-CinderUnicodeTest-2142680273 None] Acquiring lock "cinder-9d77c1ef-98ed-40fe-b4ff-063668557296-delete_snapshot" by "delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:47:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-7c5e161d-2d20-4699-9d95-e03f143fad94 tempest-CreateVolumesFromImageTest-1973590822 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.554s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:14 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-7c5e161d-2d20-4699-9d95-e03f143fad94 tempest-CreateVolumesFromImageTest-1973590822 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:47:15 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-7c5e161d-2d20-4699-9d95-e03f143fad94 tempest-CreateVolumesFromImageTest-1973590822 None] Deleted volume successfully. Sep 10 21:47:15 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-14f4e361-14f7-4339-9d8f-b2cd0064df2e tempest-CinderUnicodeTest-2142680273 None] Lock "cinder-9d77c1ef-98ed-40fe-b4ff-063668557296-delete_snapshot" acquired by "delete_snapshot" :: waited 0.146s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:47:15 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-14f4e361-14f7-4339-9d8f-b2cd0064df2e tempest-CinderUnicodeTest-2142680273 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:47:15 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-14f4e361-14f7-4339-9d8f-b2cd0064df2e tempest-CinderUnicodeTest-2142680273 None] Acquiring lock "cinder-quobyte-ac9b5975-7ffb-4efd-a6f5-173e8490dec3" by "delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:47:15 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-94c98593-5c78-4d84-8a1c-99a507ff362b tempest-CreateVolumesFromImageTest-1973590822 None] Lock "cinder-9303c491-24ed-4550-bc8e-f9c39818d8e6-delete_volume" acquired by "delete_volume" :: waited 0.241s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:47:15 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e4d4c5e-4fe0-4ccb-956c-2d752d9ff924]: (4, 'raw') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:47:15 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6dfcebc6-14a5-4934-9b63-791cd42b6fa3_78y2gjhmdevstack@QuobyteHD {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:15 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-14f4e361-14f7-4339-9d8f-b2cd0064df2e tempest-CinderUnicodeTest-2142680273 None] Lock "cinder-quobyte-ac9b5975-7ffb-4efd-a6f5-173e8490dec3" acquired by "delete_snapshot" :: waited 0.164s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:47:15 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-14f4e361-14f7-4339-9d8f-b2cd0064df2e tempest-CinderUnicodeTest-2142680273 None] Acquiring lock "cinder-quobyte-9d77c1ef-98ed-40fe-b4ff-063668557296" by "_delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:47:15 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-7c5e161d-2d20-4699-9d95-e03f143fad94 tempest-CreateVolumesFromImageTest-1973590822 None] Lock "cinder-5e1f8be4-b9c0-4edf-a6b8-40ad167c2897-delete_volume" released by "delete_volume" :: held 5.047s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:47:15 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-14f4e361-14f7-4339-9d8f-b2cd0064df2e tempest-CinderUnicodeTest-2142680273 None] Lock "cinder-quobyte-9d77c1ef-98ed-40fe-b4ff-063668557296" acquired by "_delete_snapshot" :: waited 0.253s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:47:15 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-14f4e361-14f7-4339-9d8f-b2cd0064df2e tempest-CinderUnicodeTest-2142680273 None] Deleting offline snapshot 9d77c1ef-98ed-40fe-b4ff-063668557296 of volume ac9b5975-7ffb-4efd-a6f5-173e8490dec3 {{(pid=82780) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 21:47:15 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-14f4e361-14f7-4339-9d8f-b2cd0064df2e tempest-CinderUnicodeTest-2142680273 None] snapshot_file for this snap is: volume-ac9b5975-7ffb-4efd-a6f5-173e8490dec3.9d77c1ef-98ed-40fe-b4ff-063668557296 {{(pid=82780) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 21:47:15 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e054c8-3477-4ba1-baf0-dda44f718c0f]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:47:15 devstack sudo[101401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6dfcebc6-14a5-4934-9b63-791cd42b6fa3_78y2gjhmdevstack@QuobyteHD Sep 10 21:47:15 devstack sudo[101401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 21:47:15 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-94c98593-5c78-4d84-8a1c-99a507ff362b tempest-CreateVolumesFromImageTest-1973590822 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:47:15 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-94c98593-5c78-4d84-8a1c-99a507ff362b tempest-CreateVolumesFromImageTest-1973590822 None] Acquiring lock "cinder-quobyte-9303c491-24ed-4550-bc8e-f9c39818d8e6" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:47:15 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-14f4e361-14f7-4339-9d8f-b2cd0064df2e tempest-CinderUnicodeTest-2142680273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ac9b5975-7ffb-4efd-a6f5-173e8490dec3.9d77c1ef-98ed-40fe-b4ff-063668557296 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:15 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-94c98593-5c78-4d84-8a1c-99a507ff362b tempest-CreateVolumesFromImageTest-1973590822 None] Lock "cinder-quobyte-9303c491-24ed-4550-bc8e-f9c39818d8e6" acquired by "delete_volume" :: waited 0.231s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:47:16 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[20292976-aa0b-466c-9779-f9cff72df5ea]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:47:16 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-94c98593-5c78-4d84-8a1c-99a507ff362b tempest-CreateVolumesFromImageTest-1973590822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-9303c491-24ed-4550-bc8e-f9c39818d8e6 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:16 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-14f4e361-14f7-4339-9d8f-b2cd0064df2e tempest-CinderUnicodeTest-2142680273 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ac9b5975-7ffb-4efd-a6f5-173e8490dec3.9d77c1ef-98ed-40fe-b4ff-063668557296" returned: 0 in 0.806s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:16 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-14f4e361-14f7-4339-9d8f-b2cd0064df2e tempest-CinderUnicodeTest-2142680273 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac9b5975-7ffb-4efd-a6f5-173e8490dec3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82780) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 21:47:16 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1348ebe-95b6-4d7c-bb3f-d37e6c9b2bc1]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:47:16 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-14f4e361-14f7-4339-9d8f-b2cd0064df2e tempest-CinderUnicodeTest-2142680273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ac9b5975-7ffb-4efd-a6f5-173e8490dec3 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:16 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-94c98593-5c78-4d84-8a1c-99a507ff362b tempest-CreateVolumesFromImageTest-1973590822 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-9303c491-24ed-4550-bc8e-f9c39818d8e6" returned: 0 in 0.803s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:16 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-94c98593-5c78-4d84-8a1c-99a507ff362b tempest-CreateVolumesFromImageTest-1973590822 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-9303c491-24ed-4550-bc8e-f9c39818d8e6 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-94c98593-5c78-4d84-8a1c-99a507ff362b tempest-CreateVolumesFromImageTest-1973590822 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-9303c491-24ed-4550-bc8e-f9c39818d8e6" returned: 0 in 0.242s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:17 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-94c98593-5c78-4d84-8a1c-99a507ff362b tempest-CreateVolumesFromImageTest-1973590822 None] Lock "cinder-quobyte-9303c491-24ed-4550-bc8e-f9c39818d8e6" released by "delete_volume" :: held 1.440s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:47:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-14f4e361-14f7-4339-9d8f-b2cd0064df2e tempest-CinderUnicodeTest-2142680273 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ac9b5975-7ffb-4efd-a6f5-173e8490dec3" returned: 0 in 0.961s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-14f4e361-14f7-4339-9d8f-b2cd0064df2e tempest-CinderUnicodeTest-2142680273 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ac9b5975-7ffb-4efd-a6f5-173e8490dec3.9d77c1ef-98ed-40fe-b4ff-063668557296 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:17 devstack quobyte-client[82807]: System call of process 101415 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:47:18 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-14f4e361-14f7-4339-9d8f-b2cd0064df2e tempest-CinderUnicodeTest-2142680273 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ac9b5975-7ffb-4efd-a6f5-173e8490dec3.9d77c1ef-98ed-40fe-b4ff-063668557296" returned: 0 in 0.494s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:18 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-14f4e361-14f7-4339-9d8f-b2cd0064df2e tempest-CinderUnicodeTest-2142680273 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ac9b5975-7ffb-4efd-a6f5-173e8490dec3.9d77c1ef-98ed-40fe-b4ff-063668557296 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:18 devstack sudo[101401]: pam_unix(sudo:session): session closed for user root Sep 10 21:47:18 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6dfcebc6-14a5-4934-9b63-791cd42b6fa3_78y2gjhmdevstack@QuobyteHD" returned: 0 in 3.437s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:18 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6dfcebc6-14a5-4934-9b63-791cd42b6fa3_78y2gjhmdevstack@QuobyteHD {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:18 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-14f4e361-14f7-4339-9d8f-b2cd0064df2e tempest-CinderUnicodeTest-2142680273 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ac9b5975-7ffb-4efd-a6f5-173e8490dec3.9d77c1ef-98ed-40fe-b4ff-063668557296" returned: 0 in 0.498s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:18 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-14f4e361-14f7-4339-9d8f-b2cd0064df2e tempest-CinderUnicodeTest-2142680273 None] Lock "cinder-quobyte-9d77c1ef-98ed-40fe-b4ff-063668557296" released by "_delete_snapshot" :: held 3.370s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:47:18 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-94c98593-5c78-4d84-8a1c-99a507ff362b tempest-CreateVolumesFromImageTest-1973590822 None] Created reservations ['aaf0e024-2c28-4c52-b335-d0cdb92ed1aa', '08b092c3-0301-4679-b48c-91147f700872', '876add00-6f6f-407d-ad52-1cb2a3a4b030', '0137309b-da1b-404f-8cfd-0b86fe9911d1'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:47:18 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-14f4e361-14f7-4339-9d8f-b2cd0064df2e tempest-CinderUnicodeTest-2142680273 None] Lock "cinder-quobyte-ac9b5975-7ffb-4efd-a6f5-173e8490dec3" released by "delete_snapshot" :: held 3.768s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:47:19 devstack sudo[101419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6dfcebc6-14a5-4934-9b63-791cd42b6fa3_78y2gjhmdevstack@QuobyteHD Sep 10 21:47:19 devstack sudo[101419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 21:47:19 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-14f4e361-14f7-4339-9d8f-b2cd0064df2e tempest-CinderUnicodeTest-2142680273 None] Created reservations ['c6fc3329-0be9-4ecf-8e66-dc7134e421ba', '71a5d11c-c953-42f0-a3e8-e21d698b9a43', 'b179d768-1749-4e43-9430-2603ba605630', 'e83df9d9-0a74-4fae-a1ae-aee7612f6be7'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:47:19 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-94c98593-5c78-4d84-8a1c-99a507ff362b tempest-CreateVolumesFromImageTest-1973590822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:47:19 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-94c98593-5c78-4d84-8a1c-99a507ff362b tempest-CreateVolumesFromImageTest-1973590822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:47:19 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-94c98593-5c78-4d84-8a1c-99a507ff362b tempest-CreateVolumesFromImageTest-1973590822 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:47:19 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-94c98593-5c78-4d84-8a1c-99a507ff362b tempest-CreateVolumesFromImageTest-1973590822 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:47:19 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-94c98593-5c78-4d84-8a1c-99a507ff362b tempest-CreateVolumesFromImageTest-1973590822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:47:19 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-94c98593-5c78-4d84-8a1c-99a507ff362b tempest-CreateVolumesFromImageTest-1973590822 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:19 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-14f4e361-14f7-4339-9d8f-b2cd0064df2e tempest-CinderUnicodeTest-2142680273 None] Delete snapshot completed successfully. Sep 10 21:47:19 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-e1f0c20d-1db0-4eba-b8e8-a4bb8d7f89b2 tempest-CreateVolumesFromImageTest-1973590822 None] Acquiring lock "cinder-df52c8a9-813f-46b7-b449-4e248045ee58-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:47:19 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-14f4e361-14f7-4339-9d8f-b2cd0064df2e tempest-CinderUnicodeTest-2142680273 None] Lock "cinder-9d77c1ef-98ed-40fe-b4ff-063668557296-delete_snapshot" released by "delete_snapshot" :: held 4.855s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:47:19 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-94c98593-5c78-4d84-8a1c-99a507ff362b tempest-CreateVolumesFromImageTest-1973590822 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.555s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:19 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-94c98593-5c78-4d84-8a1c-99a507ff362b tempest-CreateVolumesFromImageTest-1973590822 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:47:19 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-e1f0c20d-1db0-4eba-b8e8-a4bb8d7f89b2 tempest-CreateVolumesFromImageTest-1973590822 None] Lock "cinder-df52c8a9-813f-46b7-b449-4e248045ee58-delete_volume" acquired by "delete_volume" :: waited 0.130s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:47:20 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-94c98593-5c78-4d84-8a1c-99a507ff362b tempest-CreateVolumesFromImageTest-1973590822 None] Deleted volume successfully. Sep 10 21:47:20 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-94c98593-5c78-4d84-8a1c-99a507ff362b tempest-CreateVolumesFromImageTest-1973590822 None] Lock "cinder-9303c491-24ed-4550-bc8e-f9c39818d8e6-delete_volume" released by "delete_volume" :: held 5.098s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:47:20 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-e1f0c20d-1db0-4eba-b8e8-a4bb8d7f89b2 tempest-CreateVolumesFromImageTest-1973590822 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:47:20 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-e1f0c20d-1db0-4eba-b8e8-a4bb8d7f89b2 tempest-CreateVolumesFromImageTest-1973590822 None] Acquiring lock "cinder-quobyte-df52c8a9-813f-46b7-b449-4e248045ee58" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:47:20 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-e1f0c20d-1db0-4eba-b8e8-a4bb8d7f89b2 tempest-CreateVolumesFromImageTest-1973590822 None] Lock "cinder-quobyte-df52c8a9-813f-46b7-b449-4e248045ee58" acquired by "delete_volume" :: waited 0.018s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:47:20 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f633c3-28bf-453d-836b-2dc6b23abfe3]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:47:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e1f0c20d-1db0-4eba-b8e8-a4bb8d7f89b2 tempest-CreateVolumesFromImageTest-1973590822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-df52c8a9-813f-46b7-b449-4e248045ee58 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:20 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-c2d12f26-a0c8-4ced-bdc5-5833d786f096 tempest-CinderUnicodeTest-2142680273 None] Acquiring lock "cinder-ac9b5975-7ffb-4efd-a6f5-173e8490dec3-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:47:21 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-c2d12f26-a0c8-4ced-bdc5-5833d786f096 tempest-CinderUnicodeTest-2142680273 None] Lock "cinder-ac9b5975-7ffb-4efd-a6f5-173e8490dec3-delete_volume" acquired by "delete_volume" :: waited 0.153s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:47:21 devstack quobyte-client[82807]: System call of process 101423 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:47:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e1f0c20d-1db0-4eba-b8e8-a4bb8d7f89b2 tempest-CreateVolumesFromImageTest-1973590822 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-df52c8a9-813f-46b7-b449-4e248045ee58" returned: 0 in 1.048s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e1f0c20d-1db0-4eba-b8e8-a4bb8d7f89b2 tempest-CreateVolumesFromImageTest-1973590822 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-df52c8a9-813f-46b7-b449-4e248045ee58 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:21 devstack sudo[101419]: pam_unix(sudo:session): session closed for user root Sep 10 21:47:21 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-c2d12f26-a0c8-4ced-bdc5-5833d786f096 tempest-CinderUnicodeTest-2142680273 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:47:21 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-c2d12f26-a0c8-4ced-bdc5-5833d786f096 tempest-CinderUnicodeTest-2142680273 None] Acquiring lock "cinder-quobyte-ac9b5975-7ffb-4efd-a6f5-173e8490dec3" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:47:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6dfcebc6-14a5-4934-9b63-791cd42b6fa3_78y2gjhmdevstack@QuobyteHD" returned: 1 in 3.217s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6dfcebc6-14a5-4934-9b63-791cd42b6fa3_78y2gjhmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 21:47:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:47:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:47:21 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:47:03Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2584c329-f960-42c2-b5bb-d343fcac9d2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdf97ce8480c458cb1f3600a7af0e2b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:47:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:47:04Z,use_quota=True,user_id='eb036dda0f244bc5bcf3718e2a45f929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:47:21 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] Creating volume 2584c329-f960-42c2-b5bb-d343fcac9d2e {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:47:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:47:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:47:21 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:47:21 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:47:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:47:21 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:47:21 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:47:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-2584c329-f960-42c2-b5bb-d343fcac9d2e 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e1f0c20d-1db0-4eba-b8e8-a4bb8d7f89b2 tempest-CreateVolumesFromImageTest-1973590822 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-df52c8a9-813f-46b7-b449-4e248045ee58" returned: 0 in 0.525s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:21 devstack quobyte-client[82807]: System call of process 101431 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:47:21 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=155, name=volume-2584c329-f960-42c2-b5bb-d343fcac9d2e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:47:22 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-c2d12f26-a0c8-4ced-bdc5-5833d786f096 tempest-CinderUnicodeTest-2142680273 None] Lock "cinder-quobyte-ac9b5975-7ffb-4efd-a6f5-173e8490dec3" acquired by "delete_volume" :: waited 0.360s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:47:22 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-e1f0c20d-1db0-4eba-b8e8-a4bb8d7f89b2 tempest-CreateVolumesFromImageTest-1973590822 None] Lock "cinder-quobyte-df52c8a9-813f-46b7-b449-4e248045ee58" released by "delete_volume" :: held 1.874s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:47:22 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d9b759-1ed9-4adb-bb05-4e5c26bda46d]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:47:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c2d12f26-a0c8-4ced-bdc5-5833d786f096 tempest-CinderUnicodeTest-2142680273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ac9b5975-7ffb-4efd-a6f5-173e8490dec3 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-2584c329-f960-42c2-b5bb-d343fcac9d2e 1073741824" returned: 0 in 0.723s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-2584c329-f960-42c2-b5bb-d343fcac9d2e {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-2584c329-f960-42c2-b5bb-d343fcac9d2e" returned: 0 in 0.259s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:22 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] <== create_volume: return (1038ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:47:22 devstack quobyte-client[82807]: System call of process 101434 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:47:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:47:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c2d12f26-a0c8-4ced-bdc5-5833d786f096 tempest-CinderUnicodeTest-2142680273 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ac9b5975-7ffb-4efd-a6f5-173e8490dec3" returned: 0 in 0.659s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c2d12f26-a0c8-4ced-bdc5-5833d786f096 tempest-CinderUnicodeTest-2142680273 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ac9b5975-7ffb-4efd-a6f5-173e8490dec3 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:23 devstack cinder-volume[82780]: DEBUG cinder.volume.volume_utils [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] Attempting download of 6dfcebc6-14a5-4934-9b63-791cd42b6fa3 ((None, None)) to volume 2584c329-f960-42c2-b5bb-d343fcac9d2e. {{(pid=82780) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 10 21:47:23 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-e1f0c20d-1db0-4eba-b8e8-a4bb8d7f89b2 tempest-CreateVolumesFromImageTest-1973590822 None] Created reservations ['59aa0011-d7a9-421c-9a2d-e9a2e8de82ba', '1ab16b85-519a-4ec3-a161-689e0c692803', 'f6bad87e-3e18-46ac-bd39-1a5e07efabde', '84703804-6b78-4fef-8310-b3c0073ffd6c'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:47:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c2d12f26-a0c8-4ced-bdc5-5833d786f096 tempest-CinderUnicodeTest-2142680273 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-ac9b5975-7ffb-4efd-a6f5-173e8490dec3" returned: 0 in 0.418s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:23 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-c2d12f26-a0c8-4ced-bdc5-5833d786f096 tempest-CinderUnicodeTest-2142680273 None] Lock "cinder-quobyte-ac9b5975-7ffb-4efd-a6f5-173e8490dec3" released by "delete_volume" :: held 1.324s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:47:23 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[3318b764-f6a9-4080-be62-0182e25b769e]: (4, 'raw') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:47:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6dfcebc6-14a5-4934-9b63-791cd42b6fa3_0sp6099p {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-e1f0c20d-1db0-4eba-b8e8-a4bb8d7f89b2 tempest-CreateVolumesFromImageTest-1973590822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:47:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-e1f0c20d-1db0-4eba-b8e8-a4bb8d7f89b2 tempest-CreateVolumesFromImageTest-1973590822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.026s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:47:23 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-e1f0c20d-1db0-4eba-b8e8-a4bb8d7f89b2 tempest-CreateVolumesFromImageTest-1973590822 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:47:23 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-e1f0c20d-1db0-4eba-b8e8-a4bb8d7f89b2 tempest-CreateVolumesFromImageTest-1973590822 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:47:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-e1f0c20d-1db0-4eba-b8e8-a4bb8d7f89b2 tempest-CreateVolumesFromImageTest-1973590822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:47:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e1f0c20d-1db0-4eba-b8e8-a4bb8d7f89b2 tempest-CreateVolumesFromImageTest-1973590822 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:24 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-c2d12f26-a0c8-4ced-bdc5-5833d786f096 tempest-CinderUnicodeTest-2142680273 None] Created reservations ['b56a952e-c0fe-4be4-a0ff-f2fbf49ed2ed', 'befadd36-80f3-4d92-9d2f-197c91f071eb', '029c001c-33f7-464f-8ba3-3ca2fe369ebc', 'e9a8791e-a323-4f1b-b2cf-4a7431e26b8e'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:47:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e1f0c20d-1db0-4eba-b8e8-a4bb8d7f89b2 tempest-CreateVolumesFromImageTest-1973590822 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.316s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6dfcebc6-14a5-4934-9b63-791cd42b6fa3_0sp6099p" returned: 0 in 0.718s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:24 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-e1f0c20d-1db0-4eba-b8e8-a4bb8d7f89b2 tempest-CreateVolumesFromImageTest-1973590822 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:47:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6dfcebc6-14a5-4934-9b63-791cd42b6fa3_0sp6099p {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:24 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-e1f0c20d-1db0-4eba-b8e8-a4bb8d7f89b2 tempest-CreateVolumesFromImageTest-1973590822 None] Deleted volume successfully. Sep 10 21:47:24 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-63706429-42bc-4b1f-a29b-a2f424ec9f08 tempest-CreateVolumesFromImageTest-1973590822 None] Acquiring lock "cinder-9a69f918-84e7-41c9-99b1-070d587a88a1-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:47:24 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-e1f0c20d-1db0-4eba-b8e8-a4bb8d7f89b2 tempest-CreateVolumesFromImageTest-1973590822 None] Lock "cinder-df52c8a9-813f-46b7-b449-4e248045ee58-delete_volume" released by "delete_volume" :: held 4.922s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:47:24 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-63706429-42bc-4b1f-a29b-a2f424ec9f08 tempest-CreateVolumesFromImageTest-1973590822 None] Lock "cinder-9a69f918-84e7-41c9-99b1-070d587a88a1-delete_volume" acquired by "delete_volume" :: waited 0.191s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:47:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6dfcebc6-14a5-4934-9b63-791cd42b6fa3_0sp6099p" returned: 1 in 0.645s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6dfcebc6-14a5-4934-9b63-791cd42b6fa3_0sp6099p' failed. Not Retrying. {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 21:47:24 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b55ef199-4c14-4431-9bb2-2c055007bfd2]: (4, 'raw') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:47:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6dfcebc6-14a5-4934-9b63-791cd42b6fa3_78y2gjhmdevstack@QuobyteHD {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:25 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-c2d12f26-a0c8-4ced-bdc5-5833d786f096 tempest-CinderUnicodeTest-2142680273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:47:25 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-c2d12f26-a0c8-4ced-bdc5-5833d786f096 tempest-CinderUnicodeTest-2142680273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.035s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:47:25 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-c2d12f26-a0c8-4ced-bdc5-5833d786f096 tempest-CinderUnicodeTest-2142680273 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:47:25 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-c2d12f26-a0c8-4ced-bdc5-5833d786f096 tempest-CinderUnicodeTest-2142680273 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:47:25 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-c2d12f26-a0c8-4ced-bdc5-5833d786f096 tempest-CinderUnicodeTest-2142680273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:47:25 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c2d12f26-a0c8-4ced-bdc5-5833d786f096 tempest-CinderUnicodeTest-2142680273 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:25 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-5f614e8a-8f24-439c-94d7-ad6941a90243 tempest-CinderUnicodeTest-2142680273 None] Acquiring lock "cinder-0239c109-3912-4ab9-a0d4-2c35cc296aa1-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:47:26 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-63706429-42bc-4b1f-a29b-a2f424ec9f08 tempest-CreateVolumesFromImageTest-1973590822 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:47:26 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-63706429-42bc-4b1f-a29b-a2f424ec9f08 tempest-CreateVolumesFromImageTest-1973590822 None] Acquiring lock "cinder-quobyte-9a69f918-84e7-41c9-99b1-070d587a88a1" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:47:26 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c2d12f26-a0c8-4ced-bdc5-5833d786f096 tempest-CinderUnicodeTest-2142680273 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.549s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:26 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6dfcebc6-14a5-4934-9b63-791cd42b6fa3_78y2gjhmdevstack@QuobyteHD" returned: 0 in 1.033s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:26 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-c2d12f26-a0c8-4ced-bdc5-5833d786f096 tempest-CinderUnicodeTest-2142680273 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:47:26 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-c2d12f26-a0c8-4ced-bdc5-5833d786f096 tempest-CinderUnicodeTest-2142680273 None] Deleted volume successfully. Sep 10 21:47:26 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6dfcebc6-14a5-4934-9b63-791cd42b6fa3_78y2gjhmdevstack@QuobyteHD {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:26 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-5f614e8a-8f24-439c-94d7-ad6941a90243 tempest-CinderUnicodeTest-2142680273 None] Lock "cinder-0239c109-3912-4ab9-a0d4-2c35cc296aa1-delete_volume" acquired by "delete_volume" :: waited 0.462s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:47:26 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-63706429-42bc-4b1f-a29b-a2f424ec9f08 tempest-CreateVolumesFromImageTest-1973590822 None] Lock "cinder-quobyte-9a69f918-84e7-41c9-99b1-070d587a88a1" acquired by "delete_volume" :: waited 0.559s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:47:26 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[1562be38-e8c2-4925-8c6d-6ad64b16a89b]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:47:26 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-63706429-42bc-4b1f-a29b-a2f424ec9f08 tempest-CreateVolumesFromImageTest-1973590822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-9a69f918-84e7-41c9-99b1-070d587a88a1 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:26 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-c2d12f26-a0c8-4ced-bdc5-5833d786f096 tempest-CinderUnicodeTest-2142680273 None] Lock "cinder-ac9b5975-7ffb-4efd-a6f5-173e8490dec3-delete_volume" released by "delete_volume" :: held 5.859s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:47:27 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6dfcebc6-14a5-4934-9b63-791cd42b6fa3_78y2gjhmdevstack@QuobyteHD" returned: 1 in 0.958s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:27 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6dfcebc6-14a5-4934-9b63-791cd42b6fa3_78y2gjhmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 21:47:27 devstack cinder-volume[82780]: DEBUG cinder.image.image_utils [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] 6dfcebc6-14a5-4934-9b63-791cd42b6fa3 was raw, converting to raw {{(pid=82780) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 10 21:47:27 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] Running cmd (subprocess): qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6dfcebc6-14a5-4934-9b63-791cd42b6fa3_78y2gjhmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-2584c329-f960-42c2-b5bb-d343fcac9d2e {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:27 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-5f614e8a-8f24-439c-94d7-ad6941a90243 tempest-CinderUnicodeTest-2142680273 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:47:27 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=155, name=volume-2584c329-f960-42c2-b5bb-d343fcac9d2e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:47:27 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-5f614e8a-8f24-439c-94d7-ad6941a90243 tempest-CinderUnicodeTest-2142680273 None] Acquiring lock "cinder-quobyte-0239c109-3912-4ab9-a0d4-2c35cc296aa1" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:47:27 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-63706429-42bc-4b1f-a29b-a2f424ec9f08 tempest-CreateVolumesFromImageTest-1973590822 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-9a69f918-84e7-41c9-99b1-070d587a88a1" returned: 0 in 0.792s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:27 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] CMD "qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6dfcebc6-14a5-4934-9b63-791cd42b6fa3_78y2gjhmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-2584c329-f960-42c2-b5bb-d343fcac9d2e" returned: 0 in 0.324s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:27 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-63706429-42bc-4b1f-a29b-a2f424ec9f08 tempest-CreateVolumesFromImageTest-1973590822 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-9a69f918-84e7-41c9-99b1-070d587a88a1 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:27 devstack cinder-volume[82780]: DEBUG cinder.image.image_utils [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6dfcebc6-14a5-4934-9b63-791cd42b6fa3_78y2gjhmdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-2584c329-f960-42c2-b5bb-d343fcac9d2e {{(pid=82780) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 10 21:47:27 devstack cinder-volume[82780]: INFO cinder.image.image_utils [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] Converted 0.00 MB image at 0.00 MB/s Sep 10 21:47:27 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-2584c329-f960-42c2-b5bb-d343fcac9d2e 1G {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:27 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-63706429-42bc-4b1f-a29b-a2f424ec9f08 tempest-CreateVolumesFromImageTest-1973590822 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-9a69f918-84e7-41c9-99b1-070d587a88a1" returned: 0 in 0.281s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:27 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-5f614e8a-8f24-439c-94d7-ad6941a90243 tempest-CinderUnicodeTest-2142680273 None] Lock "cinder-quobyte-0239c109-3912-4ab9-a0d4-2c35cc296aa1" acquired by "delete_volume" :: waited 0.446s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:47:27 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-63706429-42bc-4b1f-a29b-a2f424ec9f08 tempest-CreateVolumesFromImageTest-1973590822 None] Lock "cinder-quobyte-9a69f918-84e7-41c9-99b1-070d587a88a1" released by "delete_volume" :: held 1.222s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:47:27 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3430d39-23da-483d-9bb9-ce0ba5b9b597]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:47:27 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-2584c329-f960-42c2-b5bb-d343fcac9d2e 1G" returned: 0 in 0.379s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:27 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-5f614e8a-8f24-439c-94d7-ad6941a90243 tempest-CinderUnicodeTest-2142680273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-0239c109-3912-4ab9-a0d4-2c35cc296aa1 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:28 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[aabac3f4-d7df-4e28-81ed-072228e20d51]: (4, 'raw') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:47:28 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-2584c329-f960-42c2-b5bb-d343fcac9d2e {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:28 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-63706429-42bc-4b1f-a29b-a2f424ec9f08 tempest-CreateVolumesFromImageTest-1973590822 None] Created reservations ['2de32174-ad5f-4962-9013-f324eb540dff', 'ed5bb6c6-eeba-4469-a501-027121b0f8f7', '454d13a8-bcbc-447e-8f6a-58cda38bcc92', '3663105b-f82b-4308-a504-e190d9a4eb01'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:47:28 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-5f614e8a-8f24-439c-94d7-ad6941a90243 tempest-CinderUnicodeTest-2142680273 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-0239c109-3912-4ab9-a0d4-2c35cc296aa1" returned: 0 in 0.804s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:28 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-5f614e8a-8f24-439c-94d7-ad6941a90243 tempest-CinderUnicodeTest-2142680273 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-0239c109-3912-4ab9-a0d4-2c35cc296aa1 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:29 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-5f614e8a-8f24-439c-94d7-ad6941a90243 tempest-CinderUnicodeTest-2142680273 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-0239c109-3912-4ab9-a0d4-2c35cc296aa1" returned: 0 in 0.295s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:29 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-2584c329-f960-42c2-b5bb-d343fcac9d2e" returned: 0 in 0.882s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:29 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-2584c329-f960-42c2-b5bb-d343fcac9d2e {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:29 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-5f614e8a-8f24-439c-94d7-ad6941a90243 tempest-CinderUnicodeTest-2142680273 None] Lock "cinder-quobyte-0239c109-3912-4ab9-a0d4-2c35cc296aa1" released by "delete_volume" :: held 1.730s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:47:29 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-63706429-42bc-4b1f-a29b-a2f424ec9f08 tempest-CreateVolumesFromImageTest-1973590822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:47:29 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-63706429-42bc-4b1f-a29b-a2f424ec9f08 tempest-CreateVolumesFromImageTest-1973590822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:47:29 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-63706429-42bc-4b1f-a29b-a2f424ec9f08 tempest-CreateVolumesFromImageTest-1973590822 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:47:29 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-63706429-42bc-4b1f-a29b-a2f424ec9f08 tempest-CreateVolumesFromImageTest-1973590822 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:47:29 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-63706429-42bc-4b1f-a29b-a2f424ec9f08 tempest-CreateVolumesFromImageTest-1973590822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:47:29 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-63706429-42bc-4b1f-a29b-a2f424ec9f08 tempest-CreateVolumesFromImageTest-1973590822 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:29 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-2584c329-f960-42c2-b5bb-d343fcac9d2e" returned: 1 in 0.732s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:29 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-2584c329-f960-42c2-b5bb-d343fcac9d2e' failed. Not Retrying. {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 21:47:29 devstack cinder-volume[82780]: DEBUG cinder.volume.volume_utils [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] Downloaded image 6dfcebc6-14a5-4934-9b63-791cd42b6fa3 ((None, None)) to volume 2584c329-f960-42c2-b5bb-d343fcac9d2e successfully. {{(pid=82780) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 10 21:47:29 devstack cinder-volume[82780]: DEBUG cinder.image.image_utils [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] Temporary image 6dfcebc6-14a5-4934-9b63-791cd42b6fa3 for user eb036dda0f244bc5bcf3718e2a45f929 is deleted. {{(pid=82780) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 10 21:47:29 devstack cinder-volume[82780]: DEBUG cinder.volume.volume_utils [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] Marking volume 2584c329-f960-42c2-b5bb-d343fcac9d2e as bootable. {{(pid=82780) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 10 21:47:30 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-63706429-42bc-4b1f-a29b-a2f424ec9f08 tempest-CreateVolumesFromImageTest-1973590822 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.354s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:30 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-63706429-42bc-4b1f-a29b-a2f424ec9f08 tempest-CreateVolumesFromImageTest-1973590822 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:47:30 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-63706429-42bc-4b1f-a29b-a2f424ec9f08 tempest-CreateVolumesFromImageTest-1973590822 None] Deleted volume successfully. Sep 10 21:47:30 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-5f614e8a-8f24-439c-94d7-ad6941a90243 tempest-CinderUnicodeTest-2142680273 None] Created reservations ['a28274dd-d916-4bca-84a8-ecdf89fe3e10', '34f56c8f-5bdc-4338-9870-f1e5622f0bfe', 'e3564c6d-8da0-4eba-860a-3a5beba288c7', '62d41d40-1843-418d-8782-d95eee1041eb'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:47:30 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] Copying metadata from image 6dfcebc6-14a5-4934-9b63-791cd42b6fa3 to 2584c329-f960-42c2-b5bb-d343fcac9d2e. {{(pid=82780) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 10 21:47:30 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] Creating volume glance metadata for volume 2584c329-f960-42c2-b5bb-d343fcac9d2e backed by image 6dfcebc6-14a5-4934-9b63-791cd42b6fa3 with: {'image_id': '6dfcebc6-14a5-4934-9b63-791cd42b6fa3', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '2041981a10fe58fd499058110f0397e4', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=82780) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 10 21:47:30 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-09a46a9a-f362-4049-b0bc-1add41feed84 tempest-CreateVolumesFromImageTest-1973590822 None] Acquiring lock "cinder-5b9ba58e-db2c-4828-b71e-198c746dcf7a-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:47:30 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-09a46a9a-f362-4049-b0bc-1add41feed84 tempest-CreateVolumesFromImageTest-1973590822 None] Lock "cinder-5b9ba58e-db2c-4828-b71e-198c746dcf7a-delete_volume" acquired by "delete_volume" :: waited 0.172s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:47:30 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-63706429-42bc-4b1f-a29b-a2f424ec9f08 tempest-CreateVolumesFromImageTest-1973590822 None] Lock "cinder-9a69f918-84e7-41c9-99b1-070d587a88a1-delete_volume" released by "delete_volume" :: held 5.496s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:47:30 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-5f614e8a-8f24-439c-94d7-ad6941a90243 tempest-CinderUnicodeTest-2142680273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:47:30 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-5f614e8a-8f24-439c-94d7-ad6941a90243 tempest-CinderUnicodeTest-2142680273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:47:30 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-5f614e8a-8f24-439c-94d7-ad6941a90243 tempest-CinderUnicodeTest-2142680273 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:47:30 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-5f614e8a-8f24-439c-94d7-ad6941a90243 tempest-CinderUnicodeTest-2142680273 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:47:30 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-5f614e8a-8f24-439c-94d7-ad6941a90243 tempest-CinderUnicodeTest-2142680273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:47:30 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-5f614e8a-8f24-439c-94d7-ad6941a90243 tempest-CinderUnicodeTest-2142680273 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:30 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-5f614e8a-8f24-439c-94d7-ad6941a90243 tempest-CinderUnicodeTest-2142680273 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.379s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:30 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-5f614e8a-8f24-439c-94d7-ad6941a90243 tempest-CinderUnicodeTest-2142680273 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:47:30 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62b7d789-4ab7-4f39-a5ee-3ee9ce39fa5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2584c329-f960-42c2-b5bb-d343fcac9d2e', 'volume_size': 1, 'image_id': '6dfcebc6-14a5-4934-9b63-791cd42b6fa3', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2041981a10fe58fd499058110f0397e4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bdf97ce8480c458cb1f3600a7af0e2b0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5d2cf5a9b5551d735ac77a36997467056369926dfecffec031be92cdeddd68d10c3fd589cc5cfc113b3f765bb3c13ee854e85f38f09bb148734830841b0226b9', 'id': '6dfcebc6-14a5-4934-9b63-791cd42b6fa3', 'created_at': datetime.datetime(2025, 9, 10, 19, 46, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 19, 47, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6dfcebc6-14a5-4934-9b63-791cd42b6fa3/file', 'properties': {}}, 'image_service': }' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:30 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cef150eb-f09b-43fb-b7a0-770b84eb5680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:30 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-5f614e8a-8f24-439c-94d7-ad6941a90243 tempest-CinderUnicodeTest-2142680273 None] Deleted volume successfully. Sep 10 21:47:30 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] Volume volume-2584c329-f960-42c2-b5bb-d343fcac9d2e (2584c329-f960-42c2-b5bb-d343fcac9d2e): created successfully Sep 10 21:47:30 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cef150eb-f09b-43fb-b7a0-770b84eb5680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:30 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] Flow 'volume_create_manager' (bcccb962-aabb-4131-8d09-82cdbf83619c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:47:31 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-09a46a9a-f362-4049-b0bc-1add41feed84 tempest-CreateVolumesFromImageTest-1973590822 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:47:31 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-09a46a9a-f362-4049-b0bc-1add41feed84 tempest-CreateVolumesFromImageTest-1973590822 None] Acquiring lock "cinder-quobyte-5b9ba58e-db2c-4828-b71e-198c746dcf7a" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:47:31 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-e1de5e22-94f5-4c24-bc8b-7993daad68b8 tempest-VolumeImageDependencyTests-416048335 None] Created volume successfully. Sep 10 21:47:31 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-5f614e8a-8f24-439c-94d7-ad6941a90243 tempest-CinderUnicodeTest-2142680273 None] Lock "cinder-0239c109-3912-4ab9-a0d4-2c35cc296aa1-delete_volume" released by "delete_volume" :: held 4.704s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:47:31 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-09a46a9a-f362-4049-b0bc-1add41feed84 tempest-CreateVolumesFromImageTest-1973590822 None] Lock "cinder-quobyte-5b9ba58e-db2c-4828-b71e-198c746dcf7a" acquired by "delete_volume" :: waited 0.051s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:47:31 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7019124-d19c-4a5c-b3a6-01823163492c]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:47:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-09a46a9a-f362-4049-b0bc-1add41feed84 tempest-CreateVolumesFromImageTest-1973590822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5b9ba58e-db2c-4828-b71e-198c746dcf7a {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-09a46a9a-f362-4049-b0bc-1add41feed84 tempest-CreateVolumesFromImageTest-1973590822 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5b9ba58e-db2c-4828-b71e-198c746dcf7a" returned: 0 in 0.530s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-09a46a9a-f362-4049-b0bc-1add41feed84 tempest-CreateVolumesFromImageTest-1973590822 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5b9ba58e-db2c-4828-b71e-198c746dcf7a {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-09a46a9a-f362-4049-b0bc-1add41feed84 tempest-CreateVolumesFromImageTest-1973590822 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-5b9ba58e-db2c-4828-b71e-198c746dcf7a" returned: 0 in 0.133s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:32 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-09a46a9a-f362-4049-b0bc-1add41feed84 tempest-CreateVolumesFromImageTest-1973590822 None] Lock "cinder-quobyte-5b9ba58e-db2c-4828-b71e-198c746dcf7a" released by "delete_volume" :: held 0.905s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:47:32 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-ec57daa5-cc90-44b8-9929-e29828444c37 tempest-VolumeImageDependencyTests-416048335 None] Acquiring lock "cinder-2584c329-f960-42c2-b5bb-d343fcac9d2e-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:47:32 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-ec57daa5-cc90-44b8-9929-e29828444c37 tempest-VolumeImageDependencyTests-416048335 None] Lock "cinder-2584c329-f960-42c2-b5bb-d343fcac9d2e-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:47:32 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-09a46a9a-f362-4049-b0bc-1add41feed84 tempest-CreateVolumesFromImageTest-1973590822 None] Created reservations ['047c7ea9-8816-422b-937d-291f5469df44', '6fef922e-63ff-4bc9-a3a2-7be8a9c0acd9', 'd7ce04b9-ac96-4510-a7d2-cbfbff003517', '1b0b7474-c623-465a-92a2-58e3c2203609'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:47:32 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-ec57daa5-cc90-44b8-9929-e29828444c37 tempest-VolumeImageDependencyTests-416048335 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:47:32 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-ec57daa5-cc90-44b8-9929-e29828444c37 tempest-VolumeImageDependencyTests-416048335 None] Acquiring lock "cinder-quobyte-2584c329-f960-42c2-b5bb-d343fcac9d2e" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:47:32 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-ec57daa5-cc90-44b8-9929-e29828444c37 tempest-VolumeImageDependencyTests-416048335 None] Lock "cinder-quobyte-2584c329-f960-42c2-b5bb-d343fcac9d2e" acquired by "delete_volume" :: waited 0.033s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:47:32 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6028c7c-6514-48f1-9d1e-69230b95b304]: (4, 'raw') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:47:32 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ec57daa5-cc90-44b8-9929-e29828444c37 tempest-VolumeImageDependencyTests-416048335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-2584c329-f960-42c2-b5bb-d343fcac9d2e {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:33 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-09a46a9a-f362-4049-b0bc-1add41feed84 tempest-CreateVolumesFromImageTest-1973590822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:47:33 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-09a46a9a-f362-4049-b0bc-1add41feed84 tempest-CreateVolumesFromImageTest-1973590822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.017s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:47:33 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-09a46a9a-f362-4049-b0bc-1add41feed84 tempest-CreateVolumesFromImageTest-1973590822 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:47:33 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-09a46a9a-f362-4049-b0bc-1add41feed84 tempest-CreateVolumesFromImageTest-1973590822 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:47:33 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-09a46a9a-f362-4049-b0bc-1add41feed84 tempest-CreateVolumesFromImageTest-1973590822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:47:33 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-09a46a9a-f362-4049-b0bc-1add41feed84 tempest-CreateVolumesFromImageTest-1973590822 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:33 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-09a46a9a-f362-4049-b0bc-1add41feed84 tempest-CreateVolumesFromImageTest-1973590822 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.130s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:33 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ec57daa5-cc90-44b8-9929-e29828444c37 tempest-VolumeImageDependencyTests-416048335 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-2584c329-f960-42c2-b5bb-d343fcac9d2e" returned: 0 in 0.670s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:33 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-09a46a9a-f362-4049-b0bc-1add41feed84 tempest-CreateVolumesFromImageTest-1973590822 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:47:33 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ec57daa5-cc90-44b8-9929-e29828444c37 tempest-VolumeImageDependencyTests-416048335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-2584c329-f960-42c2-b5bb-d343fcac9d2e {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:33 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-09a46a9a-f362-4049-b0bc-1add41feed84 tempest-CreateVolumesFromImageTest-1973590822 None] Deleted volume successfully. Sep 10 21:47:34 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-09a46a9a-f362-4049-b0bc-1add41feed84 tempest-CreateVolumesFromImageTest-1973590822 None] Lock "cinder-5b9ba58e-db2c-4828-b71e-198c746dcf7a-delete_volume" released by "delete_volume" :: held 3.658s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:47:34 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ec57daa5-cc90-44b8-9929-e29828444c37 tempest-VolumeImageDependencyTests-416048335 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-2584c329-f960-42c2-b5bb-d343fcac9d2e" returned: 1 in 0.731s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:34 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ec57daa5-cc90-44b8-9929-e29828444c37 tempest-VolumeImageDependencyTests-416048335 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-2584c329-f960-42c2-b5bb-d343fcac9d2e' failed. Not Retrying. {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 21:47:34 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ec57daa5-cc90-44b8-9929-e29828444c37 tempest-VolumeImageDependencyTests-416048335 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-2584c329-f960-42c2-b5bb-d343fcac9d2e {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:34 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ec57daa5-cc90-44b8-9929-e29828444c37 tempest-VolumeImageDependencyTests-416048335 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-2584c329-f960-42c2-b5bb-d343fcac9d2e" returned: 0 in 0.194s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:34 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-ec57daa5-cc90-44b8-9929-e29828444c37 tempest-VolumeImageDependencyTests-416048335 None] Lock "cinder-quobyte-2584c329-f960-42c2-b5bb-d343fcac9d2e" released by "delete_volume" :: held 2.064s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:47:35 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-ec57daa5-cc90-44b8-9929-e29828444c37 tempest-VolumeImageDependencyTests-416048335 None] Created reservations ['9090fcab-8806-4fd7-82d9-5f2d8d06bae0', '8a622c24-efc2-43d5-9a61-86c3030470fa', 'c62421c0-6818-4780-93a6-d0534f92e906', 'c2bf4e0a-087c-4237-9f39-03d685ade8e9'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:47:35 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-ec57daa5-cc90-44b8-9929-e29828444c37 tempest-VolumeImageDependencyTests-416048335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:47:35 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-ec57daa5-cc90-44b8-9929-e29828444c37 tempest-VolumeImageDependencyTests-416048335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:47:35 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-ec57daa5-cc90-44b8-9929-e29828444c37 tempest-VolumeImageDependencyTests-416048335 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:47:35 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-ec57daa5-cc90-44b8-9929-e29828444c37 tempest-VolumeImageDependencyTests-416048335 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:47:35 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-ec57daa5-cc90-44b8-9929-e29828444c37 tempest-VolumeImageDependencyTests-416048335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:47:35 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ec57daa5-cc90-44b8-9929-e29828444c37 tempest-VolumeImageDependencyTests-416048335 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:35 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ec57daa5-cc90-44b8-9929-e29828444c37 tempest-VolumeImageDependencyTests-416048335 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.125s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:35 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-ec57daa5-cc90-44b8-9929-e29828444c37 tempest-VolumeImageDependencyTests-416048335 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:47:35 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-ec57daa5-cc90-44b8-9929-e29828444c37 tempest-VolumeImageDependencyTests-416048335 None] Deleted volume successfully. Sep 10 21:47:35 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-ec57daa5-cc90-44b8-9929-e29828444c37 tempest-VolumeImageDependencyTests-416048335 None] Lock "cinder-2584c329-f960-42c2-b5bb-d343fcac9d2e-delete_volume" released by "delete_volume" :: held 3.273s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:47:39 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-4b25ad71-51e2-4b0b-a26e-a1dd81290a8c tempest-CreateVolumesFromSnapshotTest-776027083 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:47:39 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b25ad71-51e2-4b0b-a26e-a1dd81290a8c tempest-CreateVolumesFromSnapshotTest-776027083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:47:39 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4b25ad71-51e2-4b0b-a26e-a1dd81290a8c tempest-CreateVolumesFromSnapshotTest-776027083 None] Flow 'volume_create_manager' (6be8e0e0-7824-4fc7-b0a9-93657b6068c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:47:39 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4b25ad71-51e2-4b0b-a26e-a1dd81290a8c tempest-CreateVolumesFromSnapshotTest-776027083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49ad3af2-8ea0-436e-9816-b34d211a47a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:39 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4b25ad71-51e2-4b0b-a26e-a1dd81290a8c tempest-CreateVolumesFromSnapshotTest-776027083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49ad3af2-8ea0-436e-9816-b34d211a47a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:47:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2035479561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f64d823-9c4d-491f-9632-ed781716fb88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f84c625149f40e69ae2e74bcb651110',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:47:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:47:39Z,use_quota=True,user_id='6679ba6936834603aacd52b56f4d0101',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:39 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4b25ad71-51e2-4b0b-a26e-a1dd81290a8c tempest-CreateVolumesFromSnapshotTest-776027083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a27f74b-3100-4e42-961e-ebdb2bc9deab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:39 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4b25ad71-51e2-4b0b-a26e-a1dd81290a8c tempest-CreateVolumesFromSnapshotTest-776027083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a27f74b-3100-4e42-961e-ebdb2bc9deab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:39 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4b25ad71-51e2-4b0b-a26e-a1dd81290a8c tempest-CreateVolumesFromSnapshotTest-776027083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d199a0b-9dc2-4985-a841-6965c0bf67d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:39 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4b25ad71-51e2-4b0b-a26e-a1dd81290a8c tempest-CreateVolumesFromSnapshotTest-776027083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d199a0b-9dc2-4985-a841-6965c0bf67d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f64d823-9c4d-491f-9632-ed781716fb88', 'volume_name': 'volume-6f64d823-9c4d-491f-9632-ed781716fb88', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:39 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4b25ad71-51e2-4b0b-a26e-a1dd81290a8c tempest-CreateVolumesFromSnapshotTest-776027083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae08a0c2-c2b9-4690-85e5-6da526e967af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:39 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4b25ad71-51e2-4b0b-a26e-a1dd81290a8c tempest-CreateVolumesFromSnapshotTest-776027083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae08a0c2-c2b9-4690-85e5-6da526e967af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:39 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4b25ad71-51e2-4b0b-a26e-a1dd81290a8c tempest-CreateVolumesFromSnapshotTest-776027083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (802257bd-8b6f-4e67-9e02-b00c2886a4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:39 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-4b25ad71-51e2-4b0b-a26e-a1dd81290a8c tempest-CreateVolumesFromSnapshotTest-776027083 None] Volume 6f64d823-9c4d-491f-9632-ed781716fb88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f64d823-9c4d-491f-9632-ed781716fb88', 'volume_size': 1} Sep 10 21:47:39 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-4b25ad71-51e2-4b0b-a26e-a1dd81290a8c tempest-CreateVolumesFromSnapshotTest-776027083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:47:39 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-4b25ad71-51e2-4b0b-a26e-a1dd81290a8c tempest-CreateVolumesFromSnapshotTest-776027083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.011s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:47:39 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-4b25ad71-51e2-4b0b-a26e-a1dd81290a8c tempest-CreateVolumesFromSnapshotTest-776027083 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:47:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2035479561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f64d823-9c4d-491f-9632-ed781716fb88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f84c625149f40e69ae2e74bcb651110',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:47:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:47:39Z,use_quota=True,user_id='6679ba6936834603aacd52b56f4d0101',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:47:39 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-4b25ad71-51e2-4b0b-a26e-a1dd81290a8c tempest-CreateVolumesFromSnapshotTest-776027083 None] Creating volume 6f64d823-9c4d-491f-9632-ed781716fb88 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:47:39 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-4b25ad71-51e2-4b0b-a26e-a1dd81290a8c tempest-CreateVolumesFromSnapshotTest-776027083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:47:39 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-4b25ad71-51e2-4b0b-a26e-a1dd81290a8c tempest-CreateVolumesFromSnapshotTest-776027083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:47:39 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-4b25ad71-51e2-4b0b-a26e-a1dd81290a8c tempest-CreateVolumesFromSnapshotTest-776027083 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:47:39 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-4b25ad71-51e2-4b0b-a26e-a1dd81290a8c tempest-CreateVolumesFromSnapshotTest-776027083 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:47:39 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-4b25ad71-51e2-4b0b-a26e-a1dd81290a8c tempest-CreateVolumesFromSnapshotTest-776027083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:47:39 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-4b25ad71-51e2-4b0b-a26e-a1dd81290a8c tempest-CreateVolumesFromSnapshotTest-776027083 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:47:39 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-4b25ad71-51e2-4b0b-a26e-a1dd81290a8c tempest-CreateVolumesFromSnapshotTest-776027083 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:47:39 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4b25ad71-51e2-4b0b-a26e-a1dd81290a8c tempest-CreateVolumesFromSnapshotTest-776027083 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-6f64d823-9c4d-491f-9632-ed781716fb88 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:39 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=156, name=volume-6f64d823-9c4d-491f-9632-ed781716fb88, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:47:40 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4b25ad71-51e2-4b0b-a26e-a1dd81290a8c tempest-CreateVolumesFromSnapshotTest-776027083 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-6f64d823-9c4d-491f-9632-ed781716fb88 1073741824" returned: 0 in 0.615s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:40 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4b25ad71-51e2-4b0b-a26e-a1dd81290a8c tempest-CreateVolumesFromSnapshotTest-776027083 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-6f64d823-9c4d-491f-9632-ed781716fb88 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:40 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-4b25ad71-51e2-4b0b-a26e-a1dd81290a8c tempest-CreateVolumesFromSnapshotTest-776027083 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-6f64d823-9c4d-491f-9632-ed781716fb88" returned: 0 in 0.147s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:40 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-4b25ad71-51e2-4b0b-a26e-a1dd81290a8c tempest-CreateVolumesFromSnapshotTest-776027083 None] <== create_volume: return (869ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:47:40 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-4b25ad71-51e2-4b0b-a26e-a1dd81290a8c tempest-CreateVolumesFromSnapshotTest-776027083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:47:40 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4b25ad71-51e2-4b0b-a26e-a1dd81290a8c tempest-CreateVolumesFromSnapshotTest-776027083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (802257bd-8b6f-4e67-9e02-b00c2886a4f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f64d823-9c4d-491f-9632-ed781716fb88', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:40 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4b25ad71-51e2-4b0b-a26e-a1dd81290a8c tempest-CreateVolumesFromSnapshotTest-776027083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6db53f6c-747b-49cd-b57d-a72567b889d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:40 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-4b25ad71-51e2-4b0b-a26e-a1dd81290a8c tempest-CreateVolumesFromSnapshotTest-776027083 None] Volume volume-6f64d823-9c4d-491f-9632-ed781716fb88 (6f64d823-9c4d-491f-9632-ed781716fb88): created successfully Sep 10 21:47:40 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4b25ad71-51e2-4b0b-a26e-a1dd81290a8c tempest-CreateVolumesFromSnapshotTest-776027083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6db53f6c-747b-49cd-b57d-a72567b889d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:40 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-4b25ad71-51e2-4b0b-a26e-a1dd81290a8c tempest-CreateVolumesFromSnapshotTest-776027083 None] Flow 'volume_create_manager' (6be8e0e0-7824-4fc7-b0a9-93657b6068c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:47:40 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-4b25ad71-51e2-4b0b-a26e-a1dd81290a8c tempest-CreateVolumesFromSnapshotTest-776027083 None] Created volume successfully. Sep 10 21:47:41 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-f2a088a3-6193-43b3-8e7d-b92205a2c7ae tempest-CreateVolumesFromSnapshotTest-776027083 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:47:41 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-f2a088a3-6193-43b3-8e7d-b92205a2c7ae tempest-CreateVolumesFromSnapshotTest-776027083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:47:41 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-f2a088a3-6193-43b3-8e7d-b92205a2c7ae tempest-CreateVolumesFromSnapshotTest-776027083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:47:41 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-f2a088a3-6193-43b3-8e7d-b92205a2c7ae tempest-CreateVolumesFromSnapshotTest-776027083 None] Creating offline snapshot 17af7c4f-306d-405f-a49f-e8879694ee20 of volume 6f64d823-9c4d-491f-9632-ed781716fb88 {{(pid=82780) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 21:47:41 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[72bce738-5edc-4863-a08a-a5e5d513bd39]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:47:41 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f2a088a3-6193-43b3-8e7d-b92205a2c7ae tempest-CreateVolumesFromSnapshotTest-776027083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-6f64d823-9c4d-491f-9632-ed781716fb88 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:42 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f2a088a3-6193-43b3-8e7d-b92205a2c7ae tempest-CreateVolumesFromSnapshotTest-776027083 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-6f64d823-9c4d-491f-9632-ed781716fb88" returned: 0 in 0.575s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:42 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f2a088a3-6193-43b3-8e7d-b92205a2c7ae tempest-CreateVolumesFromSnapshotTest-776027083 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-6f64d823-9c4d-491f-9632-ed781716fb88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-6f64d823-9c4d-491f-9632-ed781716fb88.17af7c4f-306d-405f-a49f-e8879694ee20 1G {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:42 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=157, name=volume-6f64d823-9c4d-491f-9632-ed781716fb88.17af7c4f-306d-405f-a49f-e8879694ee20, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:47:42 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f2a088a3-6193-43b3-8e7d-b92205a2c7ae tempest-CreateVolumesFromSnapshotTest-776027083 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-6f64d823-9c4d-491f-9632-ed781716fb88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-6f64d823-9c4d-491f-9632-ed781716fb88.17af7c4f-306d-405f-a49f-e8879694ee20 1G" returned: 0 in 0.384s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:42 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f2a088a3-6193-43b3-8e7d-b92205a2c7ae tempest-CreateVolumesFromSnapshotTest-776027083 None] Running cmd (subprocess): qemu-img rebase -u -b volume-6f64d823-9c4d-491f-9632-ed781716fb88 -F qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-6f64d823-9c4d-491f-9632-ed781716fb88.17af7c4f-306d-405f-a49f-e8879694ee20 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:43 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f2a088a3-6193-43b3-8e7d-b92205a2c7ae tempest-CreateVolumesFromSnapshotTest-776027083 None] CMD "qemu-img rebase -u -b volume-6f64d823-9c4d-491f-9632-ed781716fb88 -F qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-6f64d823-9c4d-491f-9632-ed781716fb88.17af7c4f-306d-405f-a49f-e8879694ee20" returned: 0 in 0.271s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:43 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-f2a088a3-6193-43b3-8e7d-b92205a2c7ae tempest-CreateVolumesFromSnapshotTest-776027083 None] File path /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-6f64d823-9c4d-491f-9632-ed781716fb88.17af7c4f-306d-405f-a49f-e8879694ee20 is being set with permissions: 660 {{(pid=82780) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 21:47:43 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f2a088a3-6193-43b3-8e7d-b92205a2c7ae tempest-CreateVolumesFromSnapshotTest-776027083 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-6f64d823-9c4d-491f-9632-ed781716fb88.17af7c4f-306d-405f-a49f-e8879694ee20 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:43 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f2a088a3-6193-43b3-8e7d-b92205a2c7ae tempest-CreateVolumesFromSnapshotTest-776027083 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-6f64d823-9c4d-491f-9632-ed781716fb88.17af7c4f-306d-405f-a49f-e8879694ee20" returned: 0 in 0.158s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:43 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-f2a088a3-6193-43b3-8e7d-b92205a2c7ae tempest-CreateVolumesFromSnapshotTest-776027083 None] Setting permissions: /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-6f64d823-9c4d-491f-9632-ed781716fb88 -> 1000:1000 {{(pid=82780) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 21:47:43 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f2a088a3-6193-43b3-8e7d-b92205a2c7ae tempest-CreateVolumesFromSnapshotTest-776027083 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-6f64d823-9c4d-491f-9632-ed781716fb88 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-6f64d823-9c4d-491f-9632-ed781716fb88.17af7c4f-306d-405f-a49f-e8879694ee20 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:43 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f2a088a3-6193-43b3-8e7d-b92205a2c7ae tempest-CreateVolumesFromSnapshotTest-776027083 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-6f64d823-9c4d-491f-9632-ed781716fb88 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-6f64d823-9c4d-491f-9632-ed781716fb88.17af7c4f-306d-405f-a49f-e8879694ee20" returned: 0 in 0.184s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:43 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f2a088a3-6193-43b3-8e7d-b92205a2c7ae tempest-CreateVolumesFromSnapshotTest-776027083 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-6f64d823-9c4d-491f-9632-ed781716fb88.info {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:43 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f2a088a3-6193-43b3-8e7d-b92205a2c7ae tempest-CreateVolumesFromSnapshotTest-776027083 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-6f64d823-9c4d-491f-9632-ed781716fb88.info" returned: 0 in 0.181s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:43 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-f2a088a3-6193-43b3-8e7d-b92205a2c7ae tempest-CreateVolumesFromSnapshotTest-776027083 None] File path /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-6f64d823-9c4d-491f-9632-ed781716fb88.info is being set with permissions: 660 {{(pid=82780) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 21:47:43 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f2a088a3-6193-43b3-8e7d-b92205a2c7ae tempest-CreateVolumesFromSnapshotTest-776027083 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-6f64d823-9c4d-491f-9632-ed781716fb88.info {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:44 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-f2a088a3-6193-43b3-8e7d-b92205a2c7ae tempest-CreateVolumesFromSnapshotTest-776027083 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-6f64d823-9c4d-491f-9632-ed781716fb88.info" returned: 0 in 0.166s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:44 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-f2a088a3-6193-43b3-8e7d-b92205a2c7ae tempest-CreateVolumesFromSnapshotTest-776027083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.516s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:47:44 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-f2a088a3-6193-43b3-8e7d-b92205a2c7ae tempest-CreateVolumesFromSnapshotTest-776027083 None] Create snapshot completed successfully Sep 10 21:47:45 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-405cc071-8546-4c95-a054-254a869eeb1e tempest-CreateVolumesFromSnapshotTest-776027083 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:47:45 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-405cc071-8546-4c95-a054-254a869eeb1e tempest-CreateVolumesFromSnapshotTest-776027083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:47:45 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-405cc071-8546-4c95-a054-254a869eeb1e tempest-CreateVolumesFromSnapshotTest-776027083 None] Flow 'volume_create_manager' (7f4d39c2-a192-455e-89f2-d95b1d097113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:47:45 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-405cc071-8546-4c95-a054-254a869eeb1e tempest-CreateVolumesFromSnapshotTest-776027083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d36f31e7-37f4-49cd-971c-59fa363b9a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:45 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-405cc071-8546-4c95-a054-254a869eeb1e tempest-CreateVolumesFromSnapshotTest-776027083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d36f31e7-37f4-49cd-971c-59fa363b9a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:47:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-325248110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f32ed04-f253-4690-b59f-24ba9aa80202,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f84c625149f40e69ae2e74bcb651110',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:47:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:47:45Z,use_quota=True,user_id='6679ba6936834603aacd52b56f4d0101',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:45 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-405cc071-8546-4c95-a054-254a869eeb1e tempest-CreateVolumesFromSnapshotTest-776027083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9378c8f9-9c50-411a-8f09-5e69f793471b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:45 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-405cc071-8546-4c95-a054-254a869eeb1e tempest-CreateVolumesFromSnapshotTest-776027083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9378c8f9-9c50-411a-8f09-5e69f793471b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:45 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-405cc071-8546-4c95-a054-254a869eeb1e tempest-CreateVolumesFromSnapshotTest-776027083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e248442-3c43-490e-b62b-bc67793212d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:45 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-405cc071-8546-4c95-a054-254a869eeb1e tempest-CreateVolumesFromSnapshotTest-776027083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e248442-3c43-490e-b62b-bc67793212d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f32ed04-f253-4690-b59f-24ba9aa80202', 'volume_name': 'volume-2f32ed04-f253-4690-b59f-24ba9aa80202', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:45 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-405cc071-8546-4c95-a054-254a869eeb1e tempest-CreateVolumesFromSnapshotTest-776027083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d82b4155-35b5-46aa-ab6f-3f1c2fda014e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:45 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-405cc071-8546-4c95-a054-254a869eeb1e tempest-CreateVolumesFromSnapshotTest-776027083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d82b4155-35b5-46aa-ab6f-3f1c2fda014e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:45 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-405cc071-8546-4c95-a054-254a869eeb1e tempest-CreateVolumesFromSnapshotTest-776027083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76110dd4-133c-4dbb-8e45-0e96f0c96900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:45 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-405cc071-8546-4c95-a054-254a869eeb1e tempest-CreateVolumesFromSnapshotTest-776027083 None] Volume 2f32ed04-f253-4690-b59f-24ba9aa80202: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f32ed04-f253-4690-b59f-24ba9aa80202', 'volume_size': 1} Sep 10 21:47:45 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-405cc071-8546-4c95-a054-254a869eeb1e tempest-CreateVolumesFromSnapshotTest-776027083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:47:45 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-405cc071-8546-4c95-a054-254a869eeb1e tempest-CreateVolumesFromSnapshotTest-776027083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:47:45 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-405cc071-8546-4c95-a054-254a869eeb1e tempest-CreateVolumesFromSnapshotTest-776027083 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:47:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-325248110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f32ed04-f253-4690-b59f-24ba9aa80202,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f84c625149f40e69ae2e74bcb651110',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:47:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:47:45Z,use_quota=True,user_id='6679ba6936834603aacd52b56f4d0101',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:47:45 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-405cc071-8546-4c95-a054-254a869eeb1e tempest-CreateVolumesFromSnapshotTest-776027083 None] Creating volume 2f32ed04-f253-4690-b59f-24ba9aa80202 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:47:45 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-405cc071-8546-4c95-a054-254a869eeb1e tempest-CreateVolumesFromSnapshotTest-776027083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:47:45 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-405cc071-8546-4c95-a054-254a869eeb1e tempest-CreateVolumesFromSnapshotTest-776027083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:47:45 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-405cc071-8546-4c95-a054-254a869eeb1e tempest-CreateVolumesFromSnapshotTest-776027083 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:47:45 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-405cc071-8546-4c95-a054-254a869eeb1e tempest-CreateVolumesFromSnapshotTest-776027083 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:47:45 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-405cc071-8546-4c95-a054-254a869eeb1e tempest-CreateVolumesFromSnapshotTest-776027083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:47:45 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-405cc071-8546-4c95-a054-254a869eeb1e tempest-CreateVolumesFromSnapshotTest-776027083 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:47:45 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-405cc071-8546-4c95-a054-254a869eeb1e tempest-CreateVolumesFromSnapshotTest-776027083 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:47:45 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-405cc071-8546-4c95-a054-254a869eeb1e tempest-CreateVolumesFromSnapshotTest-776027083 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-2f32ed04-f253-4690-b59f-24ba9aa80202 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:45 devstack quobyte-client[82807]: System call of process 101505 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:47:45 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=159, name=volume-2f32ed04-f253-4690-b59f-24ba9aa80202, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:47:46 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-405cc071-8546-4c95-a054-254a869eeb1e tempest-CreateVolumesFromSnapshotTest-776027083 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-2f32ed04-f253-4690-b59f-24ba9aa80202 1073741824" returned: 0 in 0.916s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:46 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-405cc071-8546-4c95-a054-254a869eeb1e tempest-CreateVolumesFromSnapshotTest-776027083 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-2f32ed04-f253-4690-b59f-24ba9aa80202 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:46 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-b0fc8004-c751-4d19-a558-ffc1af573335 tempest-CreateVolumesFromSnapshotTest-776027083 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:47:47 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0fc8004-c751-4d19-a558-ffc1af573335 tempest-CreateVolumesFromSnapshotTest-776027083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:47:47 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-b0fc8004-c751-4d19-a558-ffc1af573335 tempest-CreateVolumesFromSnapshotTest-776027083 None] Flow 'volume_create_manager' (d2b6f46f-ba7a-42e1-91d3-146cc1005d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:47:47 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-b0fc8004-c751-4d19-a558-ffc1af573335 tempest-CreateVolumesFromSnapshotTest-776027083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f16e956a-9ded-4946-a7d7-46cd39ee25fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:47 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-405cc071-8546-4c95-a054-254a869eeb1e tempest-CreateVolumesFromSnapshotTest-776027083 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-2f32ed04-f253-4690-b59f-24ba9aa80202" returned: 0 in 0.820s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:47 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-b0fc8004-c751-4d19-a558-ffc1af573335 tempest-CreateVolumesFromSnapshotTest-776027083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f16e956a-9ded-4946-a7d7-46cd39ee25fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:47:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1698263703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71d6c77d-686c-4d6f-b554-8be257472477,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f84c625149f40e69ae2e74bcb651110',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:47:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:47:46Z,use_quota=True,user_id='6679ba6936834603aacd52b56f4d0101',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:47 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-b0fc8004-c751-4d19-a558-ffc1af573335 tempest-CreateVolumesFromSnapshotTest-776027083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ec22e37-49a2-47b1-8abd-59e9e1ebfe4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:47 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-b0fc8004-c751-4d19-a558-ffc1af573335 tempest-CreateVolumesFromSnapshotTest-776027083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ec22e37-49a2-47b1-8abd-59e9e1ebfe4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:47 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-b0fc8004-c751-4d19-a558-ffc1af573335 tempest-CreateVolumesFromSnapshotTest-776027083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56371bdb-c335-4130-901b-da3e476efad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:47 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-b0fc8004-c751-4d19-a558-ffc1af573335 tempest-CreateVolumesFromSnapshotTest-776027083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56371bdb-c335-4130-901b-da3e476efad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71d6c77d-686c-4d6f-b554-8be257472477', 'volume_name': 'volume-71d6c77d-686c-4d6f-b554-8be257472477', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:47 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-b0fc8004-c751-4d19-a558-ffc1af573335 tempest-CreateVolumesFromSnapshotTest-776027083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6facc130-7623-46c6-8e02-c1174ecc5624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:47 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-b0fc8004-c751-4d19-a558-ffc1af573335 tempest-CreateVolumesFromSnapshotTest-776027083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6facc130-7623-46c6-8e02-c1174ecc5624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:47 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-b0fc8004-c751-4d19-a558-ffc1af573335 tempest-CreateVolumesFromSnapshotTest-776027083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (784200dd-72f0-4ede-9fd8-5954a94292a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:47 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-b0fc8004-c751-4d19-a558-ffc1af573335 tempest-CreateVolumesFromSnapshotTest-776027083 None] Volume 71d6c77d-686c-4d6f-b554-8be257472477: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71d6c77d-686c-4d6f-b554-8be257472477', 'volume_size': 1} Sep 10 21:47:47 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-b0fc8004-c751-4d19-a558-ffc1af573335 tempest-CreateVolumesFromSnapshotTest-776027083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:47:47 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-405cc071-8546-4c95-a054-254a869eeb1e tempest-CreateVolumesFromSnapshotTest-776027083 None] <== create_volume: return (1901ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:47:47 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-405cc071-8546-4c95-a054-254a869eeb1e tempest-CreateVolumesFromSnapshotTest-776027083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.910s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:47:47 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-b0fc8004-c751-4d19-a558-ffc1af573335 tempest-CreateVolumesFromSnapshotTest-776027083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.018s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:47:47 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-b0fc8004-c751-4d19-a558-ffc1af573335 tempest-CreateVolumesFromSnapshotTest-776027083 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:47:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1698263703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71d6c77d-686c-4d6f-b554-8be257472477,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f84c625149f40e69ae2e74bcb651110',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:47:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:47:46Z,use_quota=True,user_id='6679ba6936834603aacd52b56f4d0101',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:47:47 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-b0fc8004-c751-4d19-a558-ffc1af573335 tempest-CreateVolumesFromSnapshotTest-776027083 None] Creating volume 71d6c77d-686c-4d6f-b554-8be257472477 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:47:47 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-b0fc8004-c751-4d19-a558-ffc1af573335 tempest-CreateVolumesFromSnapshotTest-776027083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:47:47 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-b0fc8004-c751-4d19-a558-ffc1af573335 tempest-CreateVolumesFromSnapshotTest-776027083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:47:47 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-b0fc8004-c751-4d19-a558-ffc1af573335 tempest-CreateVolumesFromSnapshotTest-776027083 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:47:47 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-b0fc8004-c751-4d19-a558-ffc1af573335 tempest-CreateVolumesFromSnapshotTest-776027083 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:47:47 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-b0fc8004-c751-4d19-a558-ffc1af573335 tempest-CreateVolumesFromSnapshotTest-776027083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:47:47 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-b0fc8004-c751-4d19-a558-ffc1af573335 tempest-CreateVolumesFromSnapshotTest-776027083 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:47:47 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-b0fc8004-c751-4d19-a558-ffc1af573335 tempest-CreateVolumesFromSnapshotTest-776027083 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:47:47 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b0fc8004-c751-4d19-a558-ffc1af573335 tempest-CreateVolumesFromSnapshotTest-776027083 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-71d6c77d-686c-4d6f-b554-8be257472477 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:47 devstack quobyte-client[82807]: System call of process 101509 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:47:47 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=160, name=volume-71d6c77d-686c-4d6f-b554-8be257472477, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:47:48 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-b3e86ef7-e4e0-46b4-b766-4cb5c2e94f7d tempest-CreateVolumesFromSnapshotTest-776027083 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:47:48 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3e86ef7-e4e0-46b4-b766-4cb5c2e94f7d tempest-CreateVolumesFromSnapshotTest-776027083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:47:48 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-b3e86ef7-e4e0-46b4-b766-4cb5c2e94f7d tempest-CreateVolumesFromSnapshotTest-776027083 None] Flow 'volume_create_manager' (53dc93e9-bdbc-44b3-aec1-3f7be3942163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:47:48 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-b3e86ef7-e4e0-46b4-b766-4cb5c2e94f7d tempest-CreateVolumesFromSnapshotTest-776027083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89b28d64-8c75-4749-b8e0-2ee2da44e1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:48 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-405cc071-8546-4c95-a054-254a869eeb1e tempest-CreateVolumesFromSnapshotTest-776027083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76110dd4-133c-4dbb-8e45-0e96f0c96900) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f32ed04-f253-4690-b59f-24ba9aa80202', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:48 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-405cc071-8546-4c95-a054-254a869eeb1e tempest-CreateVolumesFromSnapshotTest-776027083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (330523be-42dc-4ad5-92db-25174dfb77fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:48 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-b3e86ef7-e4e0-46b4-b766-4cb5c2e94f7d tempest-CreateVolumesFromSnapshotTest-776027083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89b28d64-8c75-4749-b8e0-2ee2da44e1c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:47:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2121583937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=971e7855-4f3f-4f80-bc88-483a6e078636,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f84c625149f40e69ae2e74bcb651110',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:47:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:47:47Z,use_quota=True,user_id='6679ba6936834603aacd52b56f4d0101',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:48 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-b3e86ef7-e4e0-46b4-b766-4cb5c2e94f7d tempest-CreateVolumesFromSnapshotTest-776027083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (766021f9-7c85-4caa-b3e4-6e4179ca25bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:48 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-b3e86ef7-e4e0-46b4-b766-4cb5c2e94f7d tempest-CreateVolumesFromSnapshotTest-776027083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (766021f9-7c85-4caa-b3e4-6e4179ca25bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:48 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-b3e86ef7-e4e0-46b4-b766-4cb5c2e94f7d tempest-CreateVolumesFromSnapshotTest-776027083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09e83fb5-e015-4d51-b29e-822d7b153700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:48 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-b3e86ef7-e4e0-46b4-b766-4cb5c2e94f7d tempest-CreateVolumesFromSnapshotTest-776027083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09e83fb5-e015-4d51-b29e-822d7b153700) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '971e7855-4f3f-4f80-bc88-483a6e078636', 'volume_name': 'volume-971e7855-4f3f-4f80-bc88-483a6e078636', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:48 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-b3e86ef7-e4e0-46b4-b766-4cb5c2e94f7d tempest-CreateVolumesFromSnapshotTest-776027083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a3c2cc1-bca1-4e67-82ea-adc4050025a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:48 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-b3e86ef7-e4e0-46b4-b766-4cb5c2e94f7d tempest-CreateVolumesFromSnapshotTest-776027083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a3c2cc1-bca1-4e67-82ea-adc4050025a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:48 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-b3e86ef7-e4e0-46b4-b766-4cb5c2e94f7d tempest-CreateVolumesFromSnapshotTest-776027083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cb5dbf0-5985-4cfc-b733-e8c782f1efbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:48 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-b3e86ef7-e4e0-46b4-b766-4cb5c2e94f7d tempest-CreateVolumesFromSnapshotTest-776027083 None] Volume 971e7855-4f3f-4f80-bc88-483a6e078636: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-971e7855-4f3f-4f80-bc88-483a6e078636', 'volume_size': 1} Sep 10 21:47:48 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-b3e86ef7-e4e0-46b4-b766-4cb5c2e94f7d tempest-CreateVolumesFromSnapshotTest-776027083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:47:48 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-e73d1820-b18f-4291-82be-657d0d6866d7 tempest-CreateVolumesFromSnapshotTest-776027083 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:47:48 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-e73d1820-b18f-4291-82be-657d0d6866d7 tempest-CreateVolumesFromSnapshotTest-776027083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:47:48 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-e73d1820-b18f-4291-82be-657d0d6866d7 tempest-CreateVolumesFromSnapshotTest-776027083 None] Flow 'volume_create_manager' (59247cbd-da64-4a9e-9168-0f0aa4c2bc88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:47:48 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-e73d1820-b18f-4291-82be-657d0d6866d7 tempest-CreateVolumesFromSnapshotTest-776027083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f26e4e8f-4994-47b4-85f3-eafda74da09c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:48 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-2239a999-5799-4864-bcc9-c71b01efbcda tempest-CreateVolumesFromSnapshotTest-776027083 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:47:48 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-2239a999-5799-4864-bcc9-c71b01efbcda tempest-CreateVolumesFromSnapshotTest-776027083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:47:48 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-2239a999-5799-4864-bcc9-c71b01efbcda tempest-CreateVolumesFromSnapshotTest-776027083 None] Flow 'volume_create_manager' (5fb82674-95f8-4a75-affc-80c25c40406a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:47:48 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-2239a999-5799-4864-bcc9-c71b01efbcda tempest-CreateVolumesFromSnapshotTest-776027083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a653fbad-9fdd-488c-9207-7b42cc0ce693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:48 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b0fc8004-c751-4d19-a558-ffc1af573335 tempest-CreateVolumesFromSnapshotTest-776027083 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-71d6c77d-686c-4d6f-b554-8be257472477 1073741824" returned: 0 in 1.452s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:48 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b0fc8004-c751-4d19-a558-ffc1af573335 tempest-CreateVolumesFromSnapshotTest-776027083 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-71d6c77d-686c-4d6f-b554-8be257472477 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:49 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-405cc071-8546-4c95-a054-254a869eeb1e tempest-CreateVolumesFromSnapshotTest-776027083 None] Volume volume-2f32ed04-f253-4690-b59f-24ba9aa80202 (2f32ed04-f253-4690-b59f-24ba9aa80202): created successfully Sep 10 21:47:49 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-405cc071-8546-4c95-a054-254a869eeb1e tempest-CreateVolumesFromSnapshotTest-776027083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (330523be-42dc-4ad5-92db-25174dfb77fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:49 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-405cc071-8546-4c95-a054-254a869eeb1e tempest-CreateVolumesFromSnapshotTest-776027083 None] Flow 'volume_create_manager' (7f4d39c2-a192-455e-89f2-d95b1d097113) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:47:49 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-e73d1820-b18f-4291-82be-657d0d6866d7 tempest-CreateVolumesFromSnapshotTest-776027083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f26e4e8f-4994-47b4-85f3-eafda74da09c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:47:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1570089848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f86b3a22-c544-43d8-b2ed-7986ab99bb40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f84c625149f40e69ae2e74bcb651110',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:47:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:47:47Z,use_quota=True,user_id='6679ba6936834603aacd52b56f4d0101',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:49 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-e73d1820-b18f-4291-82be-657d0d6866d7 tempest-CreateVolumesFromSnapshotTest-776027083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8173973-8673-48b1-9ada-10b2f72c9f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:49 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-e73d1820-b18f-4291-82be-657d0d6866d7 tempest-CreateVolumesFromSnapshotTest-776027083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8173973-8673-48b1-9ada-10b2f72c9f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:49 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-e73d1820-b18f-4291-82be-657d0d6866d7 tempest-CreateVolumesFromSnapshotTest-776027083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5f8a4d9-df00-43f4-b220-60cc3c218704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:49 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-e73d1820-b18f-4291-82be-657d0d6866d7 tempest-CreateVolumesFromSnapshotTest-776027083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5f8a4d9-df00-43f4-b220-60cc3c218704) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f86b3a22-c544-43d8-b2ed-7986ab99bb40', 'volume_name': 'volume-f86b3a22-c544-43d8-b2ed-7986ab99bb40', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:49 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-e73d1820-b18f-4291-82be-657d0d6866d7 tempest-CreateVolumesFromSnapshotTest-776027083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceabf65d-6444-4622-919c-56c3f84436a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:49 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-e73d1820-b18f-4291-82be-657d0d6866d7 tempest-CreateVolumesFromSnapshotTest-776027083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceabf65d-6444-4622-919c-56c3f84436a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:49 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-e73d1820-b18f-4291-82be-657d0d6866d7 tempest-CreateVolumesFromSnapshotTest-776027083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c41a991-8747-4bdc-a595-e4f545735f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:49 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-e73d1820-b18f-4291-82be-657d0d6866d7 tempest-CreateVolumesFromSnapshotTest-776027083 None] Volume f86b3a22-c544-43d8-b2ed-7986ab99bb40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f86b3a22-c544-43d8-b2ed-7986ab99bb40', 'volume_size': 1} Sep 10 21:47:49 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-e73d1820-b18f-4291-82be-657d0d6866d7 tempest-CreateVolumesFromSnapshotTest-776027083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:47:49 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-405cc071-8546-4c95-a054-254a869eeb1e tempest-CreateVolumesFromSnapshotTest-776027083 None] Created volume successfully. Sep 10 21:47:49 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-2239a999-5799-4864-bcc9-c71b01efbcda tempest-CreateVolumesFromSnapshotTest-776027083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a653fbad-9fdd-488c-9207-7b42cc0ce693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:47:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1551152305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99d44596-9ecb-4ff3-b8f1-2665c0914dd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f84c625149f40e69ae2e74bcb651110',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:47:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:47:48Z,use_quota=True,user_id='6679ba6936834603aacd52b56f4d0101',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:49 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-2239a999-5799-4864-bcc9-c71b01efbcda tempest-CreateVolumesFromSnapshotTest-776027083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dbbb3c8-0e5e-441f-80c0-8d7e772dd756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:49 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-2239a999-5799-4864-bcc9-c71b01efbcda tempest-CreateVolumesFromSnapshotTest-776027083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dbbb3c8-0e5e-441f-80c0-8d7e772dd756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:49 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-2239a999-5799-4864-bcc9-c71b01efbcda tempest-CreateVolumesFromSnapshotTest-776027083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd6caae0-0731-4eef-9a44-f92f82d770b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:49 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-2239a999-5799-4864-bcc9-c71b01efbcda tempest-CreateVolumesFromSnapshotTest-776027083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd6caae0-0731-4eef-9a44-f92f82d770b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99d44596-9ecb-4ff3-b8f1-2665c0914dd8', 'volume_name': 'volume-99d44596-9ecb-4ff3-b8f1-2665c0914dd8', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:49 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-2239a999-5799-4864-bcc9-c71b01efbcda tempest-CreateVolumesFromSnapshotTest-776027083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e04cbd43-6a04-4450-b2a5-e08d8ae037f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:49 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-2239a999-5799-4864-bcc9-c71b01efbcda tempest-CreateVolumesFromSnapshotTest-776027083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e04cbd43-6a04-4450-b2a5-e08d8ae037f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:49 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-2239a999-5799-4864-bcc9-c71b01efbcda tempest-CreateVolumesFromSnapshotTest-776027083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d0d2e78-2406-4c8c-a3e5-9e286e873662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:49 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-2239a999-5799-4864-bcc9-c71b01efbcda tempest-CreateVolumesFromSnapshotTest-776027083 None] Volume 99d44596-9ecb-4ff3-b8f1-2665c0914dd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99d44596-9ecb-4ff3-b8f1-2665c0914dd8', 'volume_size': 1} Sep 10 21:47:49 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-2239a999-5799-4864-bcc9-c71b01efbcda tempest-CreateVolumesFromSnapshotTest-776027083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:47:49 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b0fc8004-c751-4d19-a558-ffc1af573335 tempest-CreateVolumesFromSnapshotTest-776027083 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-71d6c77d-686c-4d6f-b554-8be257472477" returned: 0 in 0.818s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:49 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-b0fc8004-c751-4d19-a558-ffc1af573335 tempest-CreateVolumesFromSnapshotTest-776027083 None] <== create_volume: return (2289ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:47:49 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-b0fc8004-c751-4d19-a558-ffc1af573335 tempest-CreateVolumesFromSnapshotTest-776027083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.298s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:47:49 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-b3e86ef7-e4e0-46b4-b766-4cb5c2e94f7d tempest-CreateVolumesFromSnapshotTest-776027083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.085s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:47:49 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-b3e86ef7-e4e0-46b4-b766-4cb5c2e94f7d tempest-CreateVolumesFromSnapshotTest-776027083 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:47:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2121583937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=971e7855-4f3f-4f80-bc88-483a6e078636,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f84c625149f40e69ae2e74bcb651110',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:47:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:47:47Z,use_quota=True,user_id='6679ba6936834603aacd52b56f4d0101',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:47:49 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-b3e86ef7-e4e0-46b4-b766-4cb5c2e94f7d tempest-CreateVolumesFromSnapshotTest-776027083 None] Creating volume 971e7855-4f3f-4f80-bc88-483a6e078636 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:47:49 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-b3e86ef7-e4e0-46b4-b766-4cb5c2e94f7d tempest-CreateVolumesFromSnapshotTest-776027083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:47:49 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-b3e86ef7-e4e0-46b4-b766-4cb5c2e94f7d tempest-CreateVolumesFromSnapshotTest-776027083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:47:49 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-b3e86ef7-e4e0-46b4-b766-4cb5c2e94f7d tempest-CreateVolumesFromSnapshotTest-776027083 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:47:49 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-b3e86ef7-e4e0-46b4-b766-4cb5c2e94f7d tempest-CreateVolumesFromSnapshotTest-776027083 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:47:49 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-b3e86ef7-e4e0-46b4-b766-4cb5c2e94f7d tempest-CreateVolumesFromSnapshotTest-776027083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:47:49 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-b3e86ef7-e4e0-46b4-b766-4cb5c2e94f7d tempest-CreateVolumesFromSnapshotTest-776027083 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:47:49 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-b3e86ef7-e4e0-46b4-b766-4cb5c2e94f7d tempest-CreateVolumesFromSnapshotTest-776027083 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:47:49 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b3e86ef7-e4e0-46b4-b766-4cb5c2e94f7d tempest-CreateVolumesFromSnapshotTest-776027083 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-971e7855-4f3f-4f80-bc88-483a6e078636 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:50 devstack quobyte-client[82807]: System call of process 101514 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:47:50 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=161, name=volume-971e7855-4f3f-4f80-bc88-483a6e078636, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:47:50 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-b0fc8004-c751-4d19-a558-ffc1af573335 tempest-CreateVolumesFromSnapshotTest-776027083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (784200dd-72f0-4ede-9fd8-5954a94292a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71d6c77d-686c-4d6f-b554-8be257472477', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:50 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-b0fc8004-c751-4d19-a558-ffc1af573335 tempest-CreateVolumesFromSnapshotTest-776027083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fc63344-d20a-4407-ac10-cf167e8fbcbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:50 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-b0fc8004-c751-4d19-a558-ffc1af573335 tempest-CreateVolumesFromSnapshotTest-776027083 None] Volume volume-71d6c77d-686c-4d6f-b554-8be257472477 (71d6c77d-686c-4d6f-b554-8be257472477): created successfully Sep 10 21:47:50 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-b0fc8004-c751-4d19-a558-ffc1af573335 tempest-CreateVolumesFromSnapshotTest-776027083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fc63344-d20a-4407-ac10-cf167e8fbcbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:50 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-b0fc8004-c751-4d19-a558-ffc1af573335 tempest-CreateVolumesFromSnapshotTest-776027083 None] Flow 'volume_create_manager' (d2b6f46f-ba7a-42e1-91d3-146cc1005d56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:47:50 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b3e86ef7-e4e0-46b4-b766-4cb5c2e94f7d tempest-CreateVolumesFromSnapshotTest-776027083 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-971e7855-4f3f-4f80-bc88-483a6e078636 1073741824" returned: 0 in 0.557s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:50 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b3e86ef7-e4e0-46b4-b766-4cb5c2e94f7d tempest-CreateVolumesFromSnapshotTest-776027083 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-971e7855-4f3f-4f80-bc88-483a6e078636 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:50 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-b0fc8004-c751-4d19-a558-ffc1af573335 tempest-CreateVolumesFromSnapshotTest-776027083 None] Created volume successfully. Sep 10 21:47:50 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b3e86ef7-e4e0-46b4-b766-4cb5c2e94f7d tempest-CreateVolumesFromSnapshotTest-776027083 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-971e7855-4f3f-4f80-bc88-483a6e078636" returned: 0 in 0.291s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:50 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-b3e86ef7-e4e0-46b4-b766-4cb5c2e94f7d tempest-CreateVolumesFromSnapshotTest-776027083 None] <== create_volume: return (876ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:47:50 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-b3e86ef7-e4e0-46b4-b766-4cb5c2e94f7d tempest-CreateVolumesFromSnapshotTest-776027083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:47:50 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-e73d1820-b18f-4291-82be-657d0d6866d7 tempest-CreateVolumesFromSnapshotTest-776027083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.041s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:47:50 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-e73d1820-b18f-4291-82be-657d0d6866d7 tempest-CreateVolumesFromSnapshotTest-776027083 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:47:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1570089848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f86b3a22-c544-43d8-b2ed-7986ab99bb40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f84c625149f40e69ae2e74bcb651110',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:47:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:47:47Z,use_quota=True,user_id='6679ba6936834603aacd52b56f4d0101',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:47:50 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-e73d1820-b18f-4291-82be-657d0d6866d7 tempest-CreateVolumesFromSnapshotTest-776027083 None] Creating volume f86b3a22-c544-43d8-b2ed-7986ab99bb40 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:47:50 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-e73d1820-b18f-4291-82be-657d0d6866d7 tempest-CreateVolumesFromSnapshotTest-776027083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:47:50 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-e73d1820-b18f-4291-82be-657d0d6866d7 tempest-CreateVolumesFromSnapshotTest-776027083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:47:50 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-e73d1820-b18f-4291-82be-657d0d6866d7 tempest-CreateVolumesFromSnapshotTest-776027083 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:47:50 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-e73d1820-b18f-4291-82be-657d0d6866d7 tempest-CreateVolumesFromSnapshotTest-776027083 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:47:50 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-e73d1820-b18f-4291-82be-657d0d6866d7 tempest-CreateVolumesFromSnapshotTest-776027083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:47:50 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-e73d1820-b18f-4291-82be-657d0d6866d7 tempest-CreateVolumesFromSnapshotTest-776027083 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:47:50 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-e73d1820-b18f-4291-82be-657d0d6866d7 tempest-CreateVolumesFromSnapshotTest-776027083 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:47:50 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e73d1820-b18f-4291-82be-657d0d6866d7 tempest-CreateVolumesFromSnapshotTest-776027083 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-f86b3a22-c544-43d8-b2ed-7986ab99bb40 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:51 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=162, name=volume-f86b3a22-c544-43d8-b2ed-7986ab99bb40, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:47:51 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-b3e86ef7-e4e0-46b4-b766-4cb5c2e94f7d tempest-CreateVolumesFromSnapshotTest-776027083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cb5dbf0-5985-4cfc-b733-e8c782f1efbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-971e7855-4f3f-4f80-bc88-483a6e078636', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:51 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-b3e86ef7-e4e0-46b4-b766-4cb5c2e94f7d tempest-CreateVolumesFromSnapshotTest-776027083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d134bd1b-7cbd-4692-8f1d-0074826bea61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:51 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-b3e86ef7-e4e0-46b4-b766-4cb5c2e94f7d tempest-CreateVolumesFromSnapshotTest-776027083 None] Volume volume-971e7855-4f3f-4f80-bc88-483a6e078636 (971e7855-4f3f-4f80-bc88-483a6e078636): created successfully Sep 10 21:47:51 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-b3e86ef7-e4e0-46b4-b766-4cb5c2e94f7d tempest-CreateVolumesFromSnapshotTest-776027083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d134bd1b-7cbd-4692-8f1d-0074826bea61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:51 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-b3e86ef7-e4e0-46b4-b766-4cb5c2e94f7d tempest-CreateVolumesFromSnapshotTest-776027083 None] Flow 'volume_create_manager' (53dc93e9-bdbc-44b3-aec1-3f7be3942163) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:47:51 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e73d1820-b18f-4291-82be-657d0d6866d7 tempest-CreateVolumesFromSnapshotTest-776027083 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-f86b3a22-c544-43d8-b2ed-7986ab99bb40 1073741824" returned: 0 in 0.651s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:51 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e73d1820-b18f-4291-82be-657d0d6866d7 tempest-CreateVolumesFromSnapshotTest-776027083 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-f86b3a22-c544-43d8-b2ed-7986ab99bb40 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:51 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-b3e86ef7-e4e0-46b4-b766-4cb5c2e94f7d tempest-CreateVolumesFromSnapshotTest-776027083 None] Created volume successfully. Sep 10 21:47:51 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-e73d1820-b18f-4291-82be-657d0d6866d7 tempest-CreateVolumesFromSnapshotTest-776027083 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-f86b3a22-c544-43d8-b2ed-7986ab99bb40" returned: 0 in 0.341s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:51 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-e73d1820-b18f-4291-82be-657d0d6866d7 tempest-CreateVolumesFromSnapshotTest-776027083 None] <== create_volume: return (1024ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:47:51 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-e73d1820-b18f-4291-82be-657d0d6866d7 tempest-CreateVolumesFromSnapshotTest-776027083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:47:51 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-2239a999-5799-4864-bcc9-c71b01efbcda tempest-CreateVolumesFromSnapshotTest-776027083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.076s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:47:51 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-2239a999-5799-4864-bcc9-c71b01efbcda tempest-CreateVolumesFromSnapshotTest-776027083 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:47:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1551152305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99d44596-9ecb-4ff3-b8f1-2665c0914dd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f84c625149f40e69ae2e74bcb651110',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:47:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:47:48Z,use_quota=True,user_id='6679ba6936834603aacd52b56f4d0101',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:47:51 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-2239a999-5799-4864-bcc9-c71b01efbcda tempest-CreateVolumesFromSnapshotTest-776027083 None] Creating volume 99d44596-9ecb-4ff3-b8f1-2665c0914dd8 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:47:51 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-2239a999-5799-4864-bcc9-c71b01efbcda tempest-CreateVolumesFromSnapshotTest-776027083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:47:51 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-2239a999-5799-4864-bcc9-c71b01efbcda tempest-CreateVolumesFromSnapshotTest-776027083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:47:51 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-2239a999-5799-4864-bcc9-c71b01efbcda tempest-CreateVolumesFromSnapshotTest-776027083 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:47:51 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-2239a999-5799-4864-bcc9-c71b01efbcda tempest-CreateVolumesFromSnapshotTest-776027083 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:47:51 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-2239a999-5799-4864-bcc9-c71b01efbcda tempest-CreateVolumesFromSnapshotTest-776027083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:47:51 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-2239a999-5799-4864-bcc9-c71b01efbcda tempest-CreateVolumesFromSnapshotTest-776027083 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:47:51 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-2239a999-5799-4864-bcc9-c71b01efbcda tempest-CreateVolumesFromSnapshotTest-776027083 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:47:51 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-2239a999-5799-4864-bcc9-c71b01efbcda tempest-CreateVolumesFromSnapshotTest-776027083 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-99d44596-9ecb-4ff3-b8f1-2665c0914dd8 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:52 devstack quobyte-client[82807]: System call of process 101522 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:47:52 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=163, name=volume-99d44596-9ecb-4ff3-b8f1-2665c0914dd8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:47:52 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-e73d1820-b18f-4291-82be-657d0d6866d7 tempest-CreateVolumesFromSnapshotTest-776027083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c41a991-8747-4bdc-a595-e4f545735f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f86b3a22-c544-43d8-b2ed-7986ab99bb40', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:52 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-e73d1820-b18f-4291-82be-657d0d6866d7 tempest-CreateVolumesFromSnapshotTest-776027083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa2055a4-ea8c-4df3-9cbc-118341252462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:52 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-2239a999-5799-4864-bcc9-c71b01efbcda tempest-CreateVolumesFromSnapshotTest-776027083 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-99d44596-9ecb-4ff3-b8f1-2665c0914dd8 1073741824" returned: 0 in 0.638s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:52 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-2239a999-5799-4864-bcc9-c71b01efbcda tempest-CreateVolumesFromSnapshotTest-776027083 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-99d44596-9ecb-4ff3-b8f1-2665c0914dd8 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:52 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-e73d1820-b18f-4291-82be-657d0d6866d7 tempest-CreateVolumesFromSnapshotTest-776027083 None] Volume volume-f86b3a22-c544-43d8-b2ed-7986ab99bb40 (f86b3a22-c544-43d8-b2ed-7986ab99bb40): created successfully Sep 10 21:47:52 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-e73d1820-b18f-4291-82be-657d0d6866d7 tempest-CreateVolumesFromSnapshotTest-776027083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa2055a4-ea8c-4df3-9cbc-118341252462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:52 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-e73d1820-b18f-4291-82be-657d0d6866d7 tempest-CreateVolumesFromSnapshotTest-776027083 None] Flow 'volume_create_manager' (59247cbd-da64-4a9e-9168-0f0aa4c2bc88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:47:52 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-2239a999-5799-4864-bcc9-c71b01efbcda tempest-CreateVolumesFromSnapshotTest-776027083 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-99d44596-9ecb-4ff3-b8f1-2665c0914dd8" returned: 0 in 0.419s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:52 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-2239a999-5799-4864-bcc9-c71b01efbcda tempest-CreateVolumesFromSnapshotTest-776027083 None] <== create_volume: return (1090ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:47:52 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-2239a999-5799-4864-bcc9-c71b01efbcda tempest-CreateVolumesFromSnapshotTest-776027083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:47:52 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-e73d1820-b18f-4291-82be-657d0d6866d7 tempest-CreateVolumesFromSnapshotTest-776027083 None] Created volume successfully. Sep 10 21:47:53 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-2239a999-5799-4864-bcc9-c71b01efbcda tempest-CreateVolumesFromSnapshotTest-776027083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d0d2e78-2406-4c8c-a3e5-9e286e873662) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99d44596-9ecb-4ff3-b8f1-2665c0914dd8', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:53 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-2239a999-5799-4864-bcc9-c71b01efbcda tempest-CreateVolumesFromSnapshotTest-776027083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2824927c-d202-4831-ba6e-46dbf465421d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:47:53 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-2239a999-5799-4864-bcc9-c71b01efbcda tempest-CreateVolumesFromSnapshotTest-776027083 None] Volume volume-99d44596-9ecb-4ff3-b8f1-2665c0914dd8 (99d44596-9ecb-4ff3-b8f1-2665c0914dd8): created successfully Sep 10 21:47:53 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-2239a999-5799-4864-bcc9-c71b01efbcda tempest-CreateVolumesFromSnapshotTest-776027083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2824927c-d202-4831-ba6e-46dbf465421d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:47:53 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-2239a999-5799-4864-bcc9-c71b01efbcda tempest-CreateVolumesFromSnapshotTest-776027083 None] Flow 'volume_create_manager' (5fb82674-95f8-4a75-affc-80c25c40406a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:47:53 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-2239a999-5799-4864-bcc9-c71b01efbcda tempest-CreateVolumesFromSnapshotTest-776027083 None] Created volume successfully. Sep 10 21:47:53 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-2f5661c0-37d5-467e-8472-cfd3cf02e4f8 tempest-CreateVolumesFromSnapshotTest-776027083 None] Acquiring lock "cinder-99d44596-9ecb-4ff3-b8f1-2665c0914dd8-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:47:53 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-2f5661c0-37d5-467e-8472-cfd3cf02e4f8 tempest-CreateVolumesFromSnapshotTest-776027083 None] Lock "cinder-99d44596-9ecb-4ff3-b8f1-2665c0914dd8-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:47:53 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-2f5661c0-37d5-467e-8472-cfd3cf02e4f8 tempest-CreateVolumesFromSnapshotTest-776027083 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:47:53 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-2f5661c0-37d5-467e-8472-cfd3cf02e4f8 tempest-CreateVolumesFromSnapshotTest-776027083 None] Acquiring lock "cinder-quobyte-99d44596-9ecb-4ff3-b8f1-2665c0914dd8" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:47:53 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-2f5661c0-37d5-467e-8472-cfd3cf02e4f8 tempest-CreateVolumesFromSnapshotTest-776027083 None] Lock "cinder-quobyte-99d44596-9ecb-4ff3-b8f1-2665c0914dd8" acquired by "delete_volume" :: waited 0.023s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:47:53 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[5389cf68-cceb-4bad-860b-47c8ee5af6c5]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:47:53 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-2f5661c0-37d5-467e-8472-cfd3cf02e4f8 tempest-CreateVolumesFromSnapshotTest-776027083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-99d44596-9ecb-4ff3-b8f1-2665c0914dd8 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:54 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-2f5661c0-37d5-467e-8472-cfd3cf02e4f8 tempest-CreateVolumesFromSnapshotTest-776027083 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-99d44596-9ecb-4ff3-b8f1-2665c0914dd8" returned: 0 in 0.524s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:54 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-2f5661c0-37d5-467e-8472-cfd3cf02e4f8 tempest-CreateVolumesFromSnapshotTest-776027083 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-99d44596-9ecb-4ff3-b8f1-2665c0914dd8 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:54 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-2f5661c0-37d5-467e-8472-cfd3cf02e4f8 tempest-CreateVolumesFromSnapshotTest-776027083 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-99d44596-9ecb-4ff3-b8f1-2665c0914dd8" returned: 0 in 0.150s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:54 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-2f5661c0-37d5-467e-8472-cfd3cf02e4f8 tempest-CreateVolumesFromSnapshotTest-776027083 None] Lock "cinder-quobyte-99d44596-9ecb-4ff3-b8f1-2665c0914dd8" released by "delete_volume" :: held 0.936s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:47:54 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-2f5661c0-37d5-467e-8472-cfd3cf02e4f8 tempest-CreateVolumesFromSnapshotTest-776027083 None] Created reservations ['e4f9ffc6-72b4-447e-a6ad-4c4f85c6f273', 'ec6ee816-be6e-4a7e-892e-4e97d6664481', '67a6cd5a-34ef-4f06-b805-e8f4ef08dffc', 'a8b0ea86-cbfe-4cb2-a612-6ab7bcb1d104'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:47:55 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-2f5661c0-37d5-467e-8472-cfd3cf02e4f8 tempest-CreateVolumesFromSnapshotTest-776027083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:47:55 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-2f5661c0-37d5-467e-8472-cfd3cf02e4f8 tempest-CreateVolumesFromSnapshotTest-776027083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:47:55 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-2f5661c0-37d5-467e-8472-cfd3cf02e4f8 tempest-CreateVolumesFromSnapshotTest-776027083 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:47:55 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-2f5661c0-37d5-467e-8472-cfd3cf02e4f8 tempest-CreateVolumesFromSnapshotTest-776027083 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:47:55 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-2f5661c0-37d5-467e-8472-cfd3cf02e4f8 tempest-CreateVolumesFromSnapshotTest-776027083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:47:55 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-2f5661c0-37d5-467e-8472-cfd3cf02e4f8 tempest-CreateVolumesFromSnapshotTest-776027083 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:55 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-2f5661c0-37d5-467e-8472-cfd3cf02e4f8 tempest-CreateVolumesFromSnapshotTest-776027083 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.118s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:55 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-2f5661c0-37d5-467e-8472-cfd3cf02e4f8 tempest-CreateVolumesFromSnapshotTest-776027083 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:47:55 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-2f5661c0-37d5-467e-8472-cfd3cf02e4f8 tempest-CreateVolumesFromSnapshotTest-776027083 None] Deleted volume successfully. Sep 10 21:47:55 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-2f5661c0-37d5-467e-8472-cfd3cf02e4f8 tempest-CreateVolumesFromSnapshotTest-776027083 None] Lock "cinder-99d44596-9ecb-4ff3-b8f1-2665c0914dd8-delete_volume" released by "delete_volume" :: held 2.128s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:47:55 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-9bf68da5-4e34-42da-9bb5-cd496394e61f tempest-CreateVolumesFromSnapshotTest-776027083 None] Acquiring lock "cinder-f86b3a22-c544-43d8-b2ed-7986ab99bb40-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:47:55 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-9bf68da5-4e34-42da-9bb5-cd496394e61f tempest-CreateVolumesFromSnapshotTest-776027083 None] Lock "cinder-f86b3a22-c544-43d8-b2ed-7986ab99bb40-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:47:55 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=73,cinder:UPDATE=108,cinder:DELETE=10,cinder:INSERT=21 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:47:56 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=73,cinder:UPDATE=112,cinder:DELETE=15,cinder:INSERT=28 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:47:56 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-9bf68da5-4e34-42da-9bb5-cd496394e61f tempest-CreateVolumesFromSnapshotTest-776027083 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:47:56 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-9bf68da5-4e34-42da-9bb5-cd496394e61f tempest-CreateVolumesFromSnapshotTest-776027083 None] Acquiring lock "cinder-quobyte-f86b3a22-c544-43d8-b2ed-7986ab99bb40" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:47:56 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-9bf68da5-4e34-42da-9bb5-cd496394e61f tempest-CreateVolumesFromSnapshotTest-776027083 None] Lock "cinder-quobyte-f86b3a22-c544-43d8-b2ed-7986ab99bb40" acquired by "delete_volume" :: waited 0.023s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:47:56 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5a8775-4929-4d2b-8614-2e4b8981880e]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:47:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9bf68da5-4e34-42da-9bb5-cd496394e61f tempest-CreateVolumesFromSnapshotTest-776027083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-f86b3a22-c544-43d8-b2ed-7986ab99bb40 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9bf68da5-4e34-42da-9bb5-cd496394e61f tempest-CreateVolumesFromSnapshotTest-776027083 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-f86b3a22-c544-43d8-b2ed-7986ab99bb40" returned: 0 in 0.564s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9bf68da5-4e34-42da-9bb5-cd496394e61f tempest-CreateVolumesFromSnapshotTest-776027083 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-f86b3a22-c544-43d8-b2ed-7986ab99bb40 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:56 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9bf68da5-4e34-42da-9bb5-cd496394e61f tempest-CreateVolumesFromSnapshotTest-776027083 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-f86b3a22-c544-43d8-b2ed-7986ab99bb40" returned: 0 in 0.168s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:57 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-9bf68da5-4e34-42da-9bb5-cd496394e61f tempest-CreateVolumesFromSnapshotTest-776027083 None] Lock "cinder-quobyte-f86b3a22-c544-43d8-b2ed-7986ab99bb40" released by "delete_volume" :: held 0.924s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:47:57 devstack cinder-volume[82780]: DEBUG oslo_service.periodic_task [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82780) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 21:47:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:47:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.018s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:47:57 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:47:57 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:47:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:47:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.337s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:57 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:47:57 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-9bf68da5-4e34-42da-9bb5-cd496394e61f tempest-CreateVolumesFromSnapshotTest-776027083 None] Created reservations ['d605bf48-eb17-4781-8ee7-eaa13d5baa34', 'dd66dbe5-a78e-4a11-85d9-56b5035173cc', '5eb4914e-185f-490f-976a-ea7742f8e4b9', '32a8e05e-a5af-4a27-8d7b-8da201a66066'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:47:58 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-9bf68da5-4e34-42da-9bb5-cd496394e61f tempest-CreateVolumesFromSnapshotTest-776027083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:47:58 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-9bf68da5-4e34-42da-9bb5-cd496394e61f tempest-CreateVolumesFromSnapshotTest-776027083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:47:58 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-9bf68da5-4e34-42da-9bb5-cd496394e61f tempest-CreateVolumesFromSnapshotTest-776027083 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:47:58 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-9bf68da5-4e34-42da-9bb5-cd496394e61f tempest-CreateVolumesFromSnapshotTest-776027083 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:47:58 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-9bf68da5-4e34-42da-9bb5-cd496394e61f tempest-CreateVolumesFromSnapshotTest-776027083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:47:58 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9bf68da5-4e34-42da-9bb5-cd496394e61f tempest-CreateVolumesFromSnapshotTest-776027083 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:58 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-2ebe2cab-70d2-4fca-8602-ad39b36d3076 tempest-CreateVolumesFromSnapshotTest-776027083 None] Acquiring lock "cinder-971e7855-4f3f-4f80-bc88-483a6e078636-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:47:58 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-9bf68da5-4e34-42da-9bb5-cd496394e61f tempest-CreateVolumesFromSnapshotTest-776027083 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.388s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:58 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-9bf68da5-4e34-42da-9bb5-cd496394e61f tempest-CreateVolumesFromSnapshotTest-776027083 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:47:58 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-9bf68da5-4e34-42da-9bb5-cd496394e61f tempest-CreateVolumesFromSnapshotTest-776027083 None] Deleted volume successfully. Sep 10 21:47:58 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-2ebe2cab-70d2-4fca-8602-ad39b36d3076 tempest-CreateVolumesFromSnapshotTest-776027083 None] Lock "cinder-971e7855-4f3f-4f80-bc88-483a6e078636-delete_volume" acquired by "delete_volume" :: waited 0.264s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:47:58 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-9bf68da5-4e34-42da-9bb5-cd496394e61f tempest-CreateVolumesFromSnapshotTest-776027083 None] Lock "cinder-f86b3a22-c544-43d8-b2ed-7986ab99bb40-delete_volume" released by "delete_volume" :: held 2.882s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:47:58 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-2ebe2cab-70d2-4fca-8602-ad39b36d3076 tempest-CreateVolumesFromSnapshotTest-776027083 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:47:58 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-2ebe2cab-70d2-4fca-8602-ad39b36d3076 tempest-CreateVolumesFromSnapshotTest-776027083 None] Acquiring lock "cinder-quobyte-971e7855-4f3f-4f80-bc88-483a6e078636" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:47:58 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-2ebe2cab-70d2-4fca-8602-ad39b36d3076 tempest-CreateVolumesFromSnapshotTest-776027083 None] Lock "cinder-quobyte-971e7855-4f3f-4f80-bc88-483a6e078636" acquired by "delete_volume" :: waited 0.022s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:47:58 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0426c87-e226-4d49-94b1-9b9a82c7b713]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:47:58 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-2ebe2cab-70d2-4fca-8602-ad39b36d3076 tempest-CreateVolumesFromSnapshotTest-776027083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-971e7855-4f3f-4f80-bc88-483a6e078636 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:59 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-2ebe2cab-70d2-4fca-8602-ad39b36d3076 tempest-CreateVolumesFromSnapshotTest-776027083 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-971e7855-4f3f-4f80-bc88-483a6e078636" returned: 0 in 0.513s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:59 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-2ebe2cab-70d2-4fca-8602-ad39b36d3076 tempest-CreateVolumesFromSnapshotTest-776027083 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-971e7855-4f3f-4f80-bc88-483a6e078636 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:47:59 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-2ebe2cab-70d2-4fca-8602-ad39b36d3076 tempest-CreateVolumesFromSnapshotTest-776027083 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-971e7855-4f3f-4f80-bc88-483a6e078636" returned: 0 in 0.108s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:47:59 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-2ebe2cab-70d2-4fca-8602-ad39b36d3076 tempest-CreateVolumesFromSnapshotTest-776027083 None] Lock "cinder-quobyte-971e7855-4f3f-4f80-bc88-483a6e078636" released by "delete_volume" :: held 0.865s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:48:00 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-2ebe2cab-70d2-4fca-8602-ad39b36d3076 tempest-CreateVolumesFromSnapshotTest-776027083 None] Created reservations ['f9e13fcc-77e5-4712-be4d-553a841c91e6', '34c70e8b-66c9-4c74-874c-40b00c216be1', 'bb1188e5-5661-4561-8ddb-c1783444f7ba', '11593aa3-d299-4963-b242-510a7ee4361f'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:48:00 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-2ebe2cab-70d2-4fca-8602-ad39b36d3076 tempest-CreateVolumesFromSnapshotTest-776027083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:48:00 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-2ebe2cab-70d2-4fca-8602-ad39b36d3076 tempest-CreateVolumesFromSnapshotTest-776027083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:48:00 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-2ebe2cab-70d2-4fca-8602-ad39b36d3076 tempest-CreateVolumesFromSnapshotTest-776027083 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:48:00 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-2ebe2cab-70d2-4fca-8602-ad39b36d3076 tempest-CreateVolumesFromSnapshotTest-776027083 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:48:00 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-2ebe2cab-70d2-4fca-8602-ad39b36d3076 tempest-CreateVolumesFromSnapshotTest-776027083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:48:00 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-2ebe2cab-70d2-4fca-8602-ad39b36d3076 tempest-CreateVolumesFromSnapshotTest-776027083 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:48:00 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-2ebe2cab-70d2-4fca-8602-ad39b36d3076 tempest-CreateVolumesFromSnapshotTest-776027083 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.114s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:48:00 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-2ebe2cab-70d2-4fca-8602-ad39b36d3076 tempest-CreateVolumesFromSnapshotTest-776027083 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:48:00 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-2ebe2cab-70d2-4fca-8602-ad39b36d3076 tempest-CreateVolumesFromSnapshotTest-776027083 None] Deleted volume successfully. Sep 10 21:48:00 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-2ebe2cab-70d2-4fca-8602-ad39b36d3076 tempest-CreateVolumesFromSnapshotTest-776027083 None] Lock "cinder-971e7855-4f3f-4f80-bc88-483a6e078636-delete_volume" released by "delete_volume" :: held 2.135s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:48:00 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-00b869b7-4f83-4b17-8f05-fc6b91537d99 tempest-CreateVolumesFromSnapshotTest-776027083 None] Acquiring lock "cinder-71d6c77d-686c-4d6f-b554-8be257472477-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:48:00 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-00b869b7-4f83-4b17-8f05-fc6b91537d99 tempest-CreateVolumesFromSnapshotTest-776027083 None] Lock "cinder-71d6c77d-686c-4d6f-b554-8be257472477-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:48:01 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-00b869b7-4f83-4b17-8f05-fc6b91537d99 tempest-CreateVolumesFromSnapshotTest-776027083 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:48:01 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-00b869b7-4f83-4b17-8f05-fc6b91537d99 tempest-CreateVolumesFromSnapshotTest-776027083 None] Acquiring lock "cinder-quobyte-71d6c77d-686c-4d6f-b554-8be257472477" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:48:01 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-00b869b7-4f83-4b17-8f05-fc6b91537d99 tempest-CreateVolumesFromSnapshotTest-776027083 None] Lock "cinder-quobyte-71d6c77d-686c-4d6f-b554-8be257472477" acquired by "delete_volume" :: waited 0.018s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:48:01 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[023e274f-4c7e-43de-a365-265b70133707]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:48:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-00b869b7-4f83-4b17-8f05-fc6b91537d99 tempest-CreateVolumesFromSnapshotTest-776027083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-71d6c77d-686c-4d6f-b554-8be257472477 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:48:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-00b869b7-4f83-4b17-8f05-fc6b91537d99 tempest-CreateVolumesFromSnapshotTest-776027083 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-71d6c77d-686c-4d6f-b554-8be257472477" returned: 0 in 0.648s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:48:01 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-00b869b7-4f83-4b17-8f05-fc6b91537d99 tempest-CreateVolumesFromSnapshotTest-776027083 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-71d6c77d-686c-4d6f-b554-8be257472477 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:48:02 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-00b869b7-4f83-4b17-8f05-fc6b91537d99 tempest-CreateVolumesFromSnapshotTest-776027083 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-71d6c77d-686c-4d6f-b554-8be257472477" returned: 0 in 0.154s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:48:02 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-00b869b7-4f83-4b17-8f05-fc6b91537d99 tempest-CreateVolumesFromSnapshotTest-776027083 None] Lock "cinder-quobyte-71d6c77d-686c-4d6f-b554-8be257472477" released by "delete_volume" :: held 1.038s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:48:02 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-00b869b7-4f83-4b17-8f05-fc6b91537d99 tempest-CreateVolumesFromSnapshotTest-776027083 None] Created reservations ['fcc5c2d1-76b8-4db1-9f17-164ea4ca0983', '94d542e6-b600-47ce-9d85-01a38bd9efa7', 'cab0c284-adf4-4eeb-93d5-2986bb655eca', '02c62c01-cb74-47e8-8dc1-9d258baa0883'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:48:02 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-00b869b7-4f83-4b17-8f05-fc6b91537d99 tempest-CreateVolumesFromSnapshotTest-776027083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:48:02 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-00b869b7-4f83-4b17-8f05-fc6b91537d99 tempest-CreateVolumesFromSnapshotTest-776027083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:48:02 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-00b869b7-4f83-4b17-8f05-fc6b91537d99 tempest-CreateVolumesFromSnapshotTest-776027083 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:48:02 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-00b869b7-4f83-4b17-8f05-fc6b91537d99 tempest-CreateVolumesFromSnapshotTest-776027083 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:48:02 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-00b869b7-4f83-4b17-8f05-fc6b91537d99 tempest-CreateVolumesFromSnapshotTest-776027083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:48:02 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-00b869b7-4f83-4b17-8f05-fc6b91537d99 tempest-CreateVolumesFromSnapshotTest-776027083 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:48:02 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-00b869b7-4f83-4b17-8f05-fc6b91537d99 tempest-CreateVolumesFromSnapshotTest-776027083 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.157s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:48:02 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-00b869b7-4f83-4b17-8f05-fc6b91537d99 tempest-CreateVolumesFromSnapshotTest-776027083 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:48:03 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-00b869b7-4f83-4b17-8f05-fc6b91537d99 tempest-CreateVolumesFromSnapshotTest-776027083 None] Deleted volume successfully. Sep 10 21:48:03 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-d4580dea-3c27-480f-942b-7f515217694f tempest-CreateVolumesFromSnapshotTest-776027083 None] Acquiring lock "cinder-2f32ed04-f253-4690-b59f-24ba9aa80202-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:48:03 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-00b869b7-4f83-4b17-8f05-fc6b91537d99 tempest-CreateVolumesFromSnapshotTest-776027083 None] Lock "cinder-71d6c77d-686c-4d6f-b554-8be257472477-delete_volume" released by "delete_volume" :: held 2.599s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:48:03 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-d4580dea-3c27-480f-942b-7f515217694f tempest-CreateVolumesFromSnapshotTest-776027083 None] Lock "cinder-2f32ed04-f253-4690-b59f-24ba9aa80202-delete_volume" acquired by "delete_volume" :: waited 0.114s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:48:03 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-d4580dea-3c27-480f-942b-7f515217694f tempest-CreateVolumesFromSnapshotTest-776027083 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:48:03 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-d4580dea-3c27-480f-942b-7f515217694f tempest-CreateVolumesFromSnapshotTest-776027083 None] Acquiring lock "cinder-quobyte-2f32ed04-f253-4690-b59f-24ba9aa80202" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:48:03 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-d4580dea-3c27-480f-942b-7f515217694f tempest-CreateVolumesFromSnapshotTest-776027083 None] Lock "cinder-quobyte-2f32ed04-f253-4690-b59f-24ba9aa80202" acquired by "delete_volume" :: waited 0.017s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:48:03 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[667162f2-006c-4cdd-bacc-bc40945a2358]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:48:03 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-d4580dea-3c27-480f-942b-7f515217694f tempest-CreateVolumesFromSnapshotTest-776027083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-2f32ed04-f253-4690-b59f-24ba9aa80202 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:48:04 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-d4580dea-3c27-480f-942b-7f515217694f tempest-CreateVolumesFromSnapshotTest-776027083 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-2f32ed04-f253-4690-b59f-24ba9aa80202" returned: 0 in 0.612s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:48:04 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-d4580dea-3c27-480f-942b-7f515217694f tempest-CreateVolumesFromSnapshotTest-776027083 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-2f32ed04-f253-4690-b59f-24ba9aa80202 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:48:04 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-d4580dea-3c27-480f-942b-7f515217694f tempest-CreateVolumesFromSnapshotTest-776027083 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-2f32ed04-f253-4690-b59f-24ba9aa80202" returned: 0 in 0.133s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:48:04 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-d4580dea-3c27-480f-942b-7f515217694f tempest-CreateVolumesFromSnapshotTest-776027083 None] Lock "cinder-quobyte-2f32ed04-f253-4690-b59f-24ba9aa80202" released by "delete_volume" :: held 0.961s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:48:04 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-d4580dea-3c27-480f-942b-7f515217694f tempest-CreateVolumesFromSnapshotTest-776027083 None] Created reservations ['164d5c28-f1f4-4878-8a58-e1e141e57e3f', 'd740d083-4534-447d-8147-0bbd7d1232fe', 'cac7147d-0e8f-4ebf-a629-6aaec7dd7550', '7852391d-7313-4c93-a93b-fcc7214cc8c4'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:48:05 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-d4580dea-3c27-480f-942b-7f515217694f tempest-CreateVolumesFromSnapshotTest-776027083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:48:05 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-d4580dea-3c27-480f-942b-7f515217694f tempest-CreateVolumesFromSnapshotTest-776027083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.014s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:48:05 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-d4580dea-3c27-480f-942b-7f515217694f tempest-CreateVolumesFromSnapshotTest-776027083 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:48:05 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-d4580dea-3c27-480f-942b-7f515217694f tempest-CreateVolumesFromSnapshotTest-776027083 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:48:05 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-d4580dea-3c27-480f-942b-7f515217694f tempest-CreateVolumesFromSnapshotTest-776027083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:48:05 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-d4580dea-3c27-480f-942b-7f515217694f tempest-CreateVolumesFromSnapshotTest-776027083 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:48:05 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-d4580dea-3c27-480f-942b-7f515217694f tempest-CreateVolumesFromSnapshotTest-776027083 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.132s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:48:05 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-d4580dea-3c27-480f-942b-7f515217694f tempest-CreateVolumesFromSnapshotTest-776027083 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:48:05 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-d4580dea-3c27-480f-942b-7f515217694f tempest-CreateVolumesFromSnapshotTest-776027083 None] Deleted volume successfully. Sep 10 21:48:05 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-d4580dea-3c27-480f-942b-7f515217694f tempest-CreateVolumesFromSnapshotTest-776027083 None] Lock "cinder-2f32ed04-f253-4690-b59f-24ba9aa80202-delete_volume" released by "delete_volume" :: held 2.284s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:48:05 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-a5740d23-b83c-4044-811b-8ab72b6cab73 tempest-CreateVolumesFromSnapshotTest-776027083 None] Acquiring lock "cinder-17af7c4f-306d-405f-a49f-e8879694ee20-delete_snapshot" by "delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:48:05 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-a5740d23-b83c-4044-811b-8ab72b6cab73 tempest-CreateVolumesFromSnapshotTest-776027083 None] Lock "cinder-17af7c4f-306d-405f-a49f-e8879694ee20-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:48:05 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-a5740d23-b83c-4044-811b-8ab72b6cab73 tempest-CreateVolumesFromSnapshotTest-776027083 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:48:05 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-a5740d23-b83c-4044-811b-8ab72b6cab73 tempest-CreateVolumesFromSnapshotTest-776027083 None] Acquiring lock "cinder-quobyte-6f64d823-9c4d-491f-9632-ed781716fb88" by "delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:48:05 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-a5740d23-b83c-4044-811b-8ab72b6cab73 tempest-CreateVolumesFromSnapshotTest-776027083 None] Lock "cinder-quobyte-6f64d823-9c4d-491f-9632-ed781716fb88" acquired by "delete_snapshot" :: waited 0.027s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:48:05 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-a5740d23-b83c-4044-811b-8ab72b6cab73 tempest-CreateVolumesFromSnapshotTest-776027083 None] Acquiring lock "cinder-quobyte-17af7c4f-306d-405f-a49f-e8879694ee20" by "_delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:48:05 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-a5740d23-b83c-4044-811b-8ab72b6cab73 tempest-CreateVolumesFromSnapshotTest-776027083 None] Lock "cinder-quobyte-17af7c4f-306d-405f-a49f-e8879694ee20" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:48:05 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-a5740d23-b83c-4044-811b-8ab72b6cab73 tempest-CreateVolumesFromSnapshotTest-776027083 None] Deleting offline snapshot 17af7c4f-306d-405f-a49f-e8879694ee20 of volume 6f64d823-9c4d-491f-9632-ed781716fb88 {{(pid=82780) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 21:48:05 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-a5740d23-b83c-4044-811b-8ab72b6cab73 tempest-CreateVolumesFromSnapshotTest-776027083 None] snapshot_file for this snap is: volume-6f64d823-9c4d-491f-9632-ed781716fb88.17af7c4f-306d-405f-a49f-e8879694ee20 {{(pid=82780) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 21:48:06 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[3defae01-93bd-4bb4-8636-4b5a47ec75f0]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:48:06 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a5740d23-b83c-4044-811b-8ab72b6cab73 tempest-CreateVolumesFromSnapshotTest-776027083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-6f64d823-9c4d-491f-9632-ed781716fb88.17af7c4f-306d-405f-a49f-e8879694ee20 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:48:06 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a5740d23-b83c-4044-811b-8ab72b6cab73 tempest-CreateVolumesFromSnapshotTest-776027083 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-6f64d823-9c4d-491f-9632-ed781716fb88.17af7c4f-306d-405f-a49f-e8879694ee20" returned: 0 in 0.469s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:48:06 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-a5740d23-b83c-4044-811b-8ab72b6cab73 tempest-CreateVolumesFromSnapshotTest-776027083 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f64d823-9c4d-491f-9632-ed781716fb88(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82780) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 21:48:06 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d792889-bf23-4afb-b6ff-d0cc7c6a08aa]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:48:06 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a5740d23-b83c-4044-811b-8ab72b6cab73 tempest-CreateVolumesFromSnapshotTest-776027083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-6f64d823-9c4d-491f-9632-ed781716fb88 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:48:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a5740d23-b83c-4044-811b-8ab72b6cab73 tempest-CreateVolumesFromSnapshotTest-776027083 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-6f64d823-9c4d-491f-9632-ed781716fb88" returned: 0 in 0.792s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:48:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a5740d23-b83c-4044-811b-8ab72b6cab73 tempest-CreateVolumesFromSnapshotTest-776027083 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-6f64d823-9c4d-491f-9632-ed781716fb88.17af7c4f-306d-405f-a49f-e8879694ee20 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:48:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a5740d23-b83c-4044-811b-8ab72b6cab73 tempest-CreateVolumesFromSnapshotTest-776027083 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-6f64d823-9c4d-491f-9632-ed781716fb88.17af7c4f-306d-405f-a49f-e8879694ee20" returned: 0 in 0.302s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:48:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a5740d23-b83c-4044-811b-8ab72b6cab73 tempest-CreateVolumesFromSnapshotTest-776027083 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-6f64d823-9c4d-491f-9632-ed781716fb88.17af7c4f-306d-405f-a49f-e8879694ee20 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:48:07 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a5740d23-b83c-4044-811b-8ab72b6cab73 tempest-CreateVolumesFromSnapshotTest-776027083 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-6f64d823-9c4d-491f-9632-ed781716fb88.17af7c4f-306d-405f-a49f-e8879694ee20" returned: 0 in 0.142s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:48:08 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-a5740d23-b83c-4044-811b-8ab72b6cab73 tempest-CreateVolumesFromSnapshotTest-776027083 None] Lock "cinder-quobyte-17af7c4f-306d-405f-a49f-e8879694ee20" released by "_delete_snapshot" :: held 2.144s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:48:08 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-a5740d23-b83c-4044-811b-8ab72b6cab73 tempest-CreateVolumesFromSnapshotTest-776027083 None] Lock "cinder-quobyte-6f64d823-9c4d-491f-9632-ed781716fb88" released by "delete_snapshot" :: held 2.183s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:48:08 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-a5740d23-b83c-4044-811b-8ab72b6cab73 tempest-CreateVolumesFromSnapshotTest-776027083 None] Created reservations ['d310fe81-3409-4820-a953-bf9be35ac456', '4d4113dd-80b7-4096-86b0-825f234e76d4', '9f51a24b-c937-4007-b42c-3d8f22323590', '3c85d3d5-8062-43aa-8e42-383786bfd89b'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:48:08 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-a5740d23-b83c-4044-811b-8ab72b6cab73 tempest-CreateVolumesFromSnapshotTest-776027083 None] Delete snapshot completed successfully. Sep 10 21:48:08 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-a5740d23-b83c-4044-811b-8ab72b6cab73 tempest-CreateVolumesFromSnapshotTest-776027083 None] Lock "cinder-17af7c4f-306d-405f-a49f-e8879694ee20-delete_snapshot" released by "delete_snapshot" :: held 2.994s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:48:09 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-b8bb6f31-e104-45bd-a9e0-e6b89774b0d3 tempest-CreateVolumesFromSnapshotTest-776027083 None] Acquiring lock "cinder-6f64d823-9c4d-491f-9632-ed781716fb88-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:48:09 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-b8bb6f31-e104-45bd-a9e0-e6b89774b0d3 tempest-CreateVolumesFromSnapshotTest-776027083 None] Lock "cinder-6f64d823-9c4d-491f-9632-ed781716fb88-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:48:09 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-b8bb6f31-e104-45bd-a9e0-e6b89774b0d3 tempest-CreateVolumesFromSnapshotTest-776027083 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:48:09 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-b8bb6f31-e104-45bd-a9e0-e6b89774b0d3 tempest-CreateVolumesFromSnapshotTest-776027083 None] Acquiring lock "cinder-quobyte-6f64d823-9c4d-491f-9632-ed781716fb88" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:48:09 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-b8bb6f31-e104-45bd-a9e0-e6b89774b0d3 tempest-CreateVolumesFromSnapshotTest-776027083 None] Lock "cinder-quobyte-6f64d823-9c4d-491f-9632-ed781716fb88" acquired by "delete_volume" :: waited 0.021s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:48:09 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf98a7e-a15b-4844-87ff-ee5709f28825]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:48:09 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b8bb6f31-e104-45bd-a9e0-e6b89774b0d3 tempest-CreateVolumesFromSnapshotTest-776027083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-6f64d823-9c4d-491f-9632-ed781716fb88 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:48:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b8bb6f31-e104-45bd-a9e0-e6b89774b0d3 tempest-CreateVolumesFromSnapshotTest-776027083 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-6f64d823-9c4d-491f-9632-ed781716fb88" returned: 0 in 0.549s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:48:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b8bb6f31-e104-45bd-a9e0-e6b89774b0d3 tempest-CreateVolumesFromSnapshotTest-776027083 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-6f64d823-9c4d-491f-9632-ed781716fb88 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:48:10 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b8bb6f31-e104-45bd-a9e0-e6b89774b0d3 tempest-CreateVolumesFromSnapshotTest-776027083 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-6f64d823-9c4d-491f-9632-ed781716fb88" returned: 0 in 0.173s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:48:10 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-b8bb6f31-e104-45bd-a9e0-e6b89774b0d3 tempest-CreateVolumesFromSnapshotTest-776027083 None] Lock "cinder-quobyte-6f64d823-9c4d-491f-9632-ed781716fb88" released by "delete_volume" :: held 1.100s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:48:11 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-b8bb6f31-e104-45bd-a9e0-e6b89774b0d3 tempest-CreateVolumesFromSnapshotTest-776027083 None] Created reservations ['9b802baf-062c-46f9-ad6f-02f73e061fb0', '24f8765b-4a9d-4a77-be50-9507cf8925ab', 'f7732fc0-8387-4234-a27f-48647de1c493', '640c8cde-ac7e-49a2-806b-36ab2919ce07'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:48:11 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-b8bb6f31-e104-45bd-a9e0-e6b89774b0d3 tempest-CreateVolumesFromSnapshotTest-776027083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:48:11 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-b8bb6f31-e104-45bd-a9e0-e6b89774b0d3 tempest-CreateVolumesFromSnapshotTest-776027083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:48:11 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-b8bb6f31-e104-45bd-a9e0-e6b89774b0d3 tempest-CreateVolumesFromSnapshotTest-776027083 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:48:11 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-b8bb6f31-e104-45bd-a9e0-e6b89774b0d3 tempest-CreateVolumesFromSnapshotTest-776027083 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:48:11 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-b8bb6f31-e104-45bd-a9e0-e6b89774b0d3 tempest-CreateVolumesFromSnapshotTest-776027083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:48:11 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b8bb6f31-e104-45bd-a9e0-e6b89774b0d3 tempest-CreateVolumesFromSnapshotTest-776027083 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:48:11 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b8bb6f31-e104-45bd-a9e0-e6b89774b0d3 tempest-CreateVolumesFromSnapshotTest-776027083 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.284s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:48:11 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-b8bb6f31-e104-45bd-a9e0-e6b89774b0d3 tempest-CreateVolumesFromSnapshotTest-776027083 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:48:11 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-b8bb6f31-e104-45bd-a9e0-e6b89774b0d3 tempest-CreateVolumesFromSnapshotTest-776027083 None] Deleted volume successfully. Sep 10 21:48:12 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-b8bb6f31-e104-45bd-a9e0-e6b89774b0d3 tempest-CreateVolumesFromSnapshotTest-776027083 None] Lock "cinder-6f64d823-9c4d-491f-9632-ed781716fb88-delete_volume" released by "delete_volume" :: held 3.193s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:48:13 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-58c71489-aa3b-4cc3-a1bf-a827640bd8da tempest-SnapshotDependencyTests-422122416 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:48:13 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-58c71489-aa3b-4cc3-a1bf-a827640bd8da tempest-SnapshotDependencyTests-422122416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:48:14 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-58c71489-aa3b-4cc3-a1bf-a827640bd8da tempest-SnapshotDependencyTests-422122416 None] Flow 'volume_create_manager' (edc2a53f-16cc-4ad0-af2b-f2b6ffc855ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:48:14 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-58c71489-aa3b-4cc3-a1bf-a827640bd8da tempest-SnapshotDependencyTests-422122416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b3e9d37-3c41-4131-8d01-f78ec23c921e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:48:14 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-58c71489-aa3b-4cc3-a1bf-a827640bd8da tempest-SnapshotDependencyTests-422122416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b3e9d37-3c41-4131-8d01-f78ec23c921e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:48:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-232351721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f7662c6-07b8-422c-b9e4-4cf840d7677a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70b51575f068483e88b2da6c780cfdbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:48:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:48:14Z,use_quota=True,user_id='48726af3675d4d31b259b80f3cbf4755',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:48:14 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-58c71489-aa3b-4cc3-a1bf-a827640bd8da tempest-SnapshotDependencyTests-422122416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7997f225-31e1-40f2-af75-a730a2bf3376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:48:14 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-58c71489-aa3b-4cc3-a1bf-a827640bd8da tempest-SnapshotDependencyTests-422122416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7997f225-31e1-40f2-af75-a730a2bf3376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:48:14 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-58c71489-aa3b-4cc3-a1bf-a827640bd8da tempest-SnapshotDependencyTests-422122416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fba1955f-ef6c-47bb-9e53-bc8dd1783fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:48:14 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-58c71489-aa3b-4cc3-a1bf-a827640bd8da tempest-SnapshotDependencyTests-422122416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fba1955f-ef6c-47bb-9e53-bc8dd1783fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f7662c6-07b8-422c-b9e4-4cf840d7677a', 'volume_name': 'volume-1f7662c6-07b8-422c-b9e4-4cf840d7677a', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:48:14 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-58c71489-aa3b-4cc3-a1bf-a827640bd8da tempest-SnapshotDependencyTests-422122416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4f0faee-157f-4652-aff3-6ade16232163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:48:14 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-58c71489-aa3b-4cc3-a1bf-a827640bd8da tempest-SnapshotDependencyTests-422122416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4f0faee-157f-4652-aff3-6ade16232163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:48:14 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-58c71489-aa3b-4cc3-a1bf-a827640bd8da tempest-SnapshotDependencyTests-422122416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50ff0615-a405-4723-b04e-43959b457f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:48:14 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-58c71489-aa3b-4cc3-a1bf-a827640bd8da tempest-SnapshotDependencyTests-422122416 None] Volume 1f7662c6-07b8-422c-b9e4-4cf840d7677a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f7662c6-07b8-422c-b9e4-4cf840d7677a', 'volume_size': 1} Sep 10 21:48:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-58c71489-aa3b-4cc3-a1bf-a827640bd8da tempest-SnapshotDependencyTests-422122416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:48:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-58c71489-aa3b-4cc3-a1bf-a827640bd8da tempest-SnapshotDependencyTests-422122416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:48:14 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-58c71489-aa3b-4cc3-a1bf-a827640bd8da tempest-SnapshotDependencyTests-422122416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:48:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-232351721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f7662c6-07b8-422c-b9e4-4cf840d7677a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70b51575f068483e88b2da6c780cfdbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:48:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:48:14Z,use_quota=True,user_id='48726af3675d4d31b259b80f3cbf4755',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:48:14 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-58c71489-aa3b-4cc3-a1bf-a827640bd8da tempest-SnapshotDependencyTests-422122416 None] Creating volume 1f7662c6-07b8-422c-b9e4-4cf840d7677a {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:48:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-58c71489-aa3b-4cc3-a1bf-a827640bd8da tempest-SnapshotDependencyTests-422122416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:48:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-58c71489-aa3b-4cc3-a1bf-a827640bd8da tempest-SnapshotDependencyTests-422122416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:48:14 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-58c71489-aa3b-4cc3-a1bf-a827640bd8da tempest-SnapshotDependencyTests-422122416 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:48:14 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-58c71489-aa3b-4cc3-a1bf-a827640bd8da tempest-SnapshotDependencyTests-422122416 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:48:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-58c71489-aa3b-4cc3-a1bf-a827640bd8da tempest-SnapshotDependencyTests-422122416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:48:14 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-58c71489-aa3b-4cc3-a1bf-a827640bd8da tempest-SnapshotDependencyTests-422122416 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:48:14 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-58c71489-aa3b-4cc3-a1bf-a827640bd8da tempest-SnapshotDependencyTests-422122416 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:48:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-58c71489-aa3b-4cc3-a1bf-a827640bd8da tempest-SnapshotDependencyTests-422122416 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1f7662c6-07b8-422c-b9e4-4cf840d7677a 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:48:14 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=164, name=volume-1f7662c6-07b8-422c-b9e4-4cf840d7677a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:48:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-58c71489-aa3b-4cc3-a1bf-a827640bd8da tempest-SnapshotDependencyTests-422122416 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1f7662c6-07b8-422c-b9e4-4cf840d7677a 1073741824" returned: 0 in 0.453s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:48:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-58c71489-aa3b-4cc3-a1bf-a827640bd8da tempest-SnapshotDependencyTests-422122416 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1f7662c6-07b8-422c-b9e4-4cf840d7677a {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:48:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-58c71489-aa3b-4cc3-a1bf-a827640bd8da tempest-SnapshotDependencyTests-422122416 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1f7662c6-07b8-422c-b9e4-4cf840d7677a" returned: 0 in 0.156s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:48:14 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-58c71489-aa3b-4cc3-a1bf-a827640bd8da tempest-SnapshotDependencyTests-422122416 None] <== create_volume: return (685ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:48:14 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-58c71489-aa3b-4cc3-a1bf-a827640bd8da tempest-SnapshotDependencyTests-422122416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:48:15 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-58c71489-aa3b-4cc3-a1bf-a827640bd8da tempest-SnapshotDependencyTests-422122416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50ff0615-a405-4723-b04e-43959b457f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f7662c6-07b8-422c-b9e4-4cf840d7677a', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:48:15 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-58c71489-aa3b-4cc3-a1bf-a827640bd8da tempest-SnapshotDependencyTests-422122416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44580cbe-ec2e-4123-b177-3cf4d895054f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:48:15 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-58c71489-aa3b-4cc3-a1bf-a827640bd8da tempest-SnapshotDependencyTests-422122416 None] Volume volume-1f7662c6-07b8-422c-b9e4-4cf840d7677a (1f7662c6-07b8-422c-b9e4-4cf840d7677a): created successfully Sep 10 21:48:15 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-58c71489-aa3b-4cc3-a1bf-a827640bd8da tempest-SnapshotDependencyTests-422122416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44580cbe-ec2e-4123-b177-3cf4d895054f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:48:15 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-58c71489-aa3b-4cc3-a1bf-a827640bd8da tempest-SnapshotDependencyTests-422122416 None] Flow 'volume_create_manager' (edc2a53f-16cc-4ad0-af2b-f2b6ffc855ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:48:15 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-58c71489-aa3b-4cc3-a1bf-a827640bd8da tempest-SnapshotDependencyTests-422122416 None] Created volume successfully. Sep 10 21:48:16 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-a4329afd-05a6-43f4-be30-01f7175dad8b tempest-SnapshotDependencyTests-422122416 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:48:16 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a4329afd-05a6-43f4-be30-01f7175dad8b tempest-SnapshotDependencyTests-422122416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:48:16 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a4329afd-05a6-43f4-be30-01f7175dad8b tempest-SnapshotDependencyTests-422122416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:48:16 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-a4329afd-05a6-43f4-be30-01f7175dad8b tempest-SnapshotDependencyTests-422122416 None] Creating offline snapshot 4c21839b-5041-4390-bf0b-d88533238da3 of volume 1f7662c6-07b8-422c-b9e4-4cf840d7677a {{(pid=82780) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 21:48:16 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[5896c776-7007-4c06-984e-ce407ac67c24]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:48:16 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a4329afd-05a6-43f4-be30-01f7175dad8b tempest-SnapshotDependencyTests-422122416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1f7662c6-07b8-422c-b9e4-4cf840d7677a {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:48:17 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-53ff2837-8414-4b77-b857-cffb081752fc tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:48:17 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-53ff2837-8414-4b77-b857-cffb081752fc tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:48:17 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-53ff2837-8414-4b77-b857-cffb081752fc tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Flow 'volume_create_manager' (8db12511-66ff-4e35-a67c-edd09c242174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:48:17 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-53ff2837-8414-4b77-b857-cffb081752fc tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e865da89-518f-4c08-b822-da7eab1c1d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:48:17 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-53ff2837-8414-4b77-b857-cffb081752fc tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e865da89-518f-4c08-b822-da7eab1c1d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:48:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1035667321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc022d0a-2969-4445-b3c0-8e6a3c956966,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b9424817a70453a8764cd9d1dc00016',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:48:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:48:17Z,use_quota=True,user_id='c8c0e59af3af4118922545ee34018f51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:48:17 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-53ff2837-8414-4b77-b857-cffb081752fc tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5de1fe9c-ce55-4060-a935-36aa2bcf575c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:48:17 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-53ff2837-8414-4b77-b857-cffb081752fc tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5de1fe9c-ce55-4060-a935-36aa2bcf575c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:48:17 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-53ff2837-8414-4b77-b857-cffb081752fc tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45ab7e23-94d8-47f7-b374-4967b1a8103b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:48:17 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-53ff2837-8414-4b77-b857-cffb081752fc tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45ab7e23-94d8-47f7-b374-4967b1a8103b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc022d0a-2969-4445-b3c0-8e6a3c956966', 'volume_name': 'volume-cc022d0a-2969-4445-b3c0-8e6a3c956966', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:48:17 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-53ff2837-8414-4b77-b857-cffb081752fc tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70029ccb-df2f-49f2-b2d0-5c93506b0290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:48:17 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-53ff2837-8414-4b77-b857-cffb081752fc tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70029ccb-df2f-49f2-b2d0-5c93506b0290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:48:17 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-53ff2837-8414-4b77-b857-cffb081752fc tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa7d3e25-c11b-485a-acd9-d18eba4ee16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:48:17 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-53ff2837-8414-4b77-b857-cffb081752fc tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Volume cc022d0a-2969-4445-b3c0-8e6a3c956966: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc022d0a-2969-4445-b3c0-8e6a3c956966', 'volume_size': 1} Sep 10 21:48:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-53ff2837-8414-4b77-b857-cffb081752fc tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:48:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a4329afd-05a6-43f4-be30-01f7175dad8b tempest-SnapshotDependencyTests-422122416 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1f7662c6-07b8-422c-b9e4-4cf840d7677a" returned: 0 in 0.713s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:48:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a4329afd-05a6-43f4-be30-01f7175dad8b tempest-SnapshotDependencyTests-422122416 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1f7662c6-07b8-422c-b9e4-4cf840d7677a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1f7662c6-07b8-422c-b9e4-4cf840d7677a.4c21839b-5041-4390-bf0b-d88533238da3 1G {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:48:17 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=165, name=volume-1f7662c6-07b8-422c-b9e4-4cf840d7677a.4c21839b-5041-4390-bf0b-d88533238da3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:48:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a4329afd-05a6-43f4-be30-01f7175dad8b tempest-SnapshotDependencyTests-422122416 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1f7662c6-07b8-422c-b9e4-4cf840d7677a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1f7662c6-07b8-422c-b9e4-4cf840d7677a.4c21839b-5041-4390-bf0b-d88533238da3 1G" returned: 0 in 0.281s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:48:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a4329afd-05a6-43f4-be30-01f7175dad8b tempest-SnapshotDependencyTests-422122416 None] Running cmd (subprocess): qemu-img rebase -u -b volume-1f7662c6-07b8-422c-b9e4-4cf840d7677a -F qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1f7662c6-07b8-422c-b9e4-4cf840d7677a.4c21839b-5041-4390-bf0b-d88533238da3 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:48:17 devstack quobyte-client[82807]: System call of process 101618 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:48:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a4329afd-05a6-43f4-be30-01f7175dad8b tempest-SnapshotDependencyTests-422122416 None] CMD "qemu-img rebase -u -b volume-1f7662c6-07b8-422c-b9e4-4cf840d7677a -F qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1f7662c6-07b8-422c-b9e4-4cf840d7677a.4c21839b-5041-4390-bf0b-d88533238da3" returned: 0 in 0.227s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:48:17 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-a4329afd-05a6-43f4-be30-01f7175dad8b tempest-SnapshotDependencyTests-422122416 None] File path /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1f7662c6-07b8-422c-b9e4-4cf840d7677a.4c21839b-5041-4390-bf0b-d88533238da3 is being set with permissions: 660 {{(pid=82780) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 21:48:17 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a4329afd-05a6-43f4-be30-01f7175dad8b tempest-SnapshotDependencyTests-422122416 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1f7662c6-07b8-422c-b9e4-4cf840d7677a.4c21839b-5041-4390-bf0b-d88533238da3 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:48:18 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a4329afd-05a6-43f4-be30-01f7175dad8b tempest-SnapshotDependencyTests-422122416 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1f7662c6-07b8-422c-b9e4-4cf840d7677a.4c21839b-5041-4390-bf0b-d88533238da3" returned: 0 in 0.102s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:48:18 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-a4329afd-05a6-43f4-be30-01f7175dad8b tempest-SnapshotDependencyTests-422122416 None] Setting permissions: /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1f7662c6-07b8-422c-b9e4-4cf840d7677a -> 1000:1000 {{(pid=82780) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 21:48:18 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a4329afd-05a6-43f4-be30-01f7175dad8b tempest-SnapshotDependencyTests-422122416 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1f7662c6-07b8-422c-b9e4-4cf840d7677a /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1f7662c6-07b8-422c-b9e4-4cf840d7677a.4c21839b-5041-4390-bf0b-d88533238da3 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:48:18 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a4329afd-05a6-43f4-be30-01f7175dad8b tempest-SnapshotDependencyTests-422122416 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1f7662c6-07b8-422c-b9e4-4cf840d7677a /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1f7662c6-07b8-422c-b9e4-4cf840d7677a.4c21839b-5041-4390-bf0b-d88533238da3" returned: 0 in 0.117s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:48:18 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a4329afd-05a6-43f4-be30-01f7175dad8b tempest-SnapshotDependencyTests-422122416 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1f7662c6-07b8-422c-b9e4-4cf840d7677a.info {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:48:18 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a4329afd-05a6-43f4-be30-01f7175dad8b tempest-SnapshotDependencyTests-422122416 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1f7662c6-07b8-422c-b9e4-4cf840d7677a.info" returned: 0 in 0.093s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:48:18 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-a4329afd-05a6-43f4-be30-01f7175dad8b tempest-SnapshotDependencyTests-422122416 None] File path /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1f7662c6-07b8-422c-b9e4-4cf840d7677a.info is being set with permissions: 660 {{(pid=82780) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 21:48:18 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a4329afd-05a6-43f4-be30-01f7175dad8b tempest-SnapshotDependencyTests-422122416 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1f7662c6-07b8-422c-b9e4-4cf840d7677a.info {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:48:18 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a4329afd-05a6-43f4-be30-01f7175dad8b tempest-SnapshotDependencyTests-422122416 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1f7662c6-07b8-422c-b9e4-4cf840d7677a.info" returned: 0 in 0.112s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:48:18 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a4329afd-05a6-43f4-be30-01f7175dad8b tempest-SnapshotDependencyTests-422122416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.004s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:48:18 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-53ff2837-8414-4b77-b857-cffb081752fc tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.387s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:48:18 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-53ff2837-8414-4b77-b857-cffb081752fc tempest-CreateVolumesFromSourceVolumeTest-543123483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:48:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1035667321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc022d0a-2969-4445-b3c0-8e6a3c956966,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b9424817a70453a8764cd9d1dc00016',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:48:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:48:17Z,use_quota=True,user_id='c8c0e59af3af4118922545ee34018f51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:48:18 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-53ff2837-8414-4b77-b857-cffb081752fc tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Creating volume cc022d0a-2969-4445-b3c0-8e6a3c956966 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:48:18 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-53ff2837-8414-4b77-b857-cffb081752fc tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:48:18 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-53ff2837-8414-4b77-b857-cffb081752fc tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:48:18 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-53ff2837-8414-4b77-b857-cffb081752fc tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:48:18 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-53ff2837-8414-4b77-b857-cffb081752fc tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:48:18 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-53ff2837-8414-4b77-b857-cffb081752fc tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:48:18 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-53ff2837-8414-4b77-b857-cffb081752fc tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:48:18 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-53ff2837-8414-4b77-b857-cffb081752fc tempest-CreateVolumesFromSourceVolumeTest-543123483 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:48:18 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-53ff2837-8414-4b77-b857-cffb081752fc tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-cc022d0a-2969-4445-b3c0-8e6a3c956966 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:48:18 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=167, name=volume-cc022d0a-2969-4445-b3c0-8e6a3c956966, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:48:19 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-a4329afd-05a6-43f4-be30-01f7175dad8b tempest-SnapshotDependencyTests-422122416 None] Create snapshot completed successfully Sep 10 21:48:19 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-53ff2837-8414-4b77-b857-cffb081752fc tempest-CreateVolumesFromSourceVolumeTest-543123483 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-cc022d0a-2969-4445-b3c0-8e6a3c956966 1073741824" returned: 0 in 0.495s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:48:19 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-53ff2837-8414-4b77-b857-cffb081752fc tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-cc022d0a-2969-4445-b3c0-8e6a3c956966 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:48:19 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-53ff2837-8414-4b77-b857-cffb081752fc tempest-CreateVolumesFromSourceVolumeTest-543123483 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-cc022d0a-2969-4445-b3c0-8e6a3c956966" returned: 0 in 0.094s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:48:19 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-53ff2837-8414-4b77-b857-cffb081752fc tempest-CreateVolumesFromSourceVolumeTest-543123483 None] <== create_volume: return (647ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:48:19 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-53ff2837-8414-4b77-b857-cffb081752fc tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.674s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:48:19 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-53ff2837-8414-4b77-b857-cffb081752fc tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa7d3e25-c11b-485a-acd9-d18eba4ee16b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc022d0a-2969-4445-b3c0-8e6a3c956966', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:48:19 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-53ff2837-8414-4b77-b857-cffb081752fc tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (312372d9-5907-4c0f-9b25-e46e2a960b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:48:19 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-53ff2837-8414-4b77-b857-cffb081752fc tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Volume volume-cc022d0a-2969-4445-b3c0-8e6a3c956966 (cc022d0a-2969-4445-b3c0-8e6a3c956966): created successfully Sep 10 21:48:19 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-53ff2837-8414-4b77-b857-cffb081752fc tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (312372d9-5907-4c0f-9b25-e46e2a960b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:48:19 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-53ff2837-8414-4b77-b857-cffb081752fc tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Flow 'volume_create_manager' (8db12511-66ff-4e35-a67c-edd09c242174) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:48:19 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-53ff2837-8414-4b77-b857-cffb081752fc tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Created volume successfully. Sep 10 21:48:20 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-ce54faec-da6b-4a1c-9bfa-408c9d8f8f49 tempest-SnapshotDependencyTests-422122416 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:48:20 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce54faec-da6b-4a1c-9bfa-408c9d8f8f49 tempest-SnapshotDependencyTests-422122416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:48:20 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-1f6697a4-312d-4a32-8320-d5c89c53674f tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:48:20 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f6697a4-312d-4a32-8320-d5c89c53674f tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:48:20 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1f6697a4-312d-4a32-8320-d5c89c53674f tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Flow 'volume_create_manager' (c018e15d-2b1d-4b46-a5bc-57eed88cfa79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:48:20 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1f6697a4-312d-4a32-8320-d5c89c53674f tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db4731f8-0892-4def-a173-78f70c3eed4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:48:20 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ce54faec-da6b-4a1c-9bfa-408c9d8f8f49 tempest-SnapshotDependencyTests-422122416 None] Flow 'volume_create_manager' (d015e9b1-a0a9-4090-a33e-0e3f7aa579f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:48:20 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ce54faec-da6b-4a1c-9bfa-408c9d8f8f49 tempest-SnapshotDependencyTests-422122416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04264d5e-855b-4170-ae39-b587b786a96a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:48:20 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1f6697a4-312d-4a32-8320-d5c89c53674f tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db4731f8-0892-4def-a173-78f70c3eed4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1081350574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8c92dda-bae8-4a0a-9d28-adae19cccaa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b9424817a70453a8764cd9d1dc00016',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:48:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:48:20Z,use_quota=True,user_id='c8c0e59af3af4118922545ee34018f51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:48:20 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1f6697a4-312d-4a32-8320-d5c89c53674f tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3893e94-ff13-4919-b009-f4f4f71bcac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:48:20 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1f6697a4-312d-4a32-8320-d5c89c53674f tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3893e94-ff13-4919-b009-f4f4f71bcac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:48:20 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1f6697a4-312d-4a32-8320-d5c89c53674f tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b3c857a-889a-4044-b7fe-729ee3aafe0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:48:20 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1f6697a4-312d-4a32-8320-d5c89c53674f tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b3c857a-889a-4044-b7fe-729ee3aafe0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8c92dda-bae8-4a0a-9d28-adae19cccaa4', 'volume_name': 'volume-c8c92dda-bae8-4a0a-9d28-adae19cccaa4', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:48:20 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1f6697a4-312d-4a32-8320-d5c89c53674f tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0af93cd-791e-4f24-aec8-25b54886f489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:48:20 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1f6697a4-312d-4a32-8320-d5c89c53674f tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0af93cd-791e-4f24-aec8-25b54886f489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:48:20 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1f6697a4-312d-4a32-8320-d5c89c53674f tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (697eddb8-b1c1-49ff-8201-2fc442996e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:48:20 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-1f6697a4-312d-4a32-8320-d5c89c53674f tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Volume c8c92dda-bae8-4a0a-9d28-adae19cccaa4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8c92dda-bae8-4a0a-9d28-adae19cccaa4', 'volume_size': 1} Sep 10 21:48:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-1f6697a4-312d-4a32-8320-d5c89c53674f tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:48:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-1f6697a4-312d-4a32-8320-d5c89c53674f tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:48:20 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-1f6697a4-312d-4a32-8320-d5c89c53674f tempest-CreateVolumesFromSourceVolumeTest-543123483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1081350574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8c92dda-bae8-4a0a-9d28-adae19cccaa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b9424817a70453a8764cd9d1dc00016',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:48:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:48:20Z,use_quota=True,user_id='c8c0e59af3af4118922545ee34018f51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:48:20 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-1f6697a4-312d-4a32-8320-d5c89c53674f tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Creating volume c8c92dda-bae8-4a0a-9d28-adae19cccaa4 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:48:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-1f6697a4-312d-4a32-8320-d5c89c53674f tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:48:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-1f6697a4-312d-4a32-8320-d5c89c53674f tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:48:20 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-1f6697a4-312d-4a32-8320-d5c89c53674f tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:48:20 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-1f6697a4-312d-4a32-8320-d5c89c53674f tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:48:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-1f6697a4-312d-4a32-8320-d5c89c53674f tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:48:20 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-1f6697a4-312d-4a32-8320-d5c89c53674f tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:48:20 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-1f6697a4-312d-4a32-8320-d5c89c53674f tempest-CreateVolumesFromSourceVolumeTest-543123483 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:48:20 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1f6697a4-312d-4a32-8320-d5c89c53674f tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-c8c92dda-bae8-4a0a-9d28-adae19cccaa4 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:48:21 devstack quobyte-client[82807]: System call of process 101630 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:48:21 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=168, name=volume-c8c92dda-bae8-4a0a-9d28-adae19cccaa4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:48:21 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ce54faec-da6b-4a1c-9bfa-408c9d8f8f49 tempest-SnapshotDependencyTests-422122416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04264d5e-855b-4170-ae39-b587b786a96a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e745d1c5-222b-4ff3-8e13-411a1d967133,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70b51575f068483e88b2da6c780cfdbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:48:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4c21839b-5041-4390-bf0b-d88533238da3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:48:20Z,use_quota=True,user_id='48726af3675d4d31b259b80f3cbf4755',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:48:21 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ce54faec-da6b-4a1c-9bfa-408c9d8f8f49 tempest-SnapshotDependencyTests-422122416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (142cd865-be60-4000-84ee-9a4c51d29d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:48:21 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ce54faec-da6b-4a1c-9bfa-408c9d8f8f49 tempest-SnapshotDependencyTests-422122416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (142cd865-be60-4000-84ee-9a4c51d29d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:48:21 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ce54faec-da6b-4a1c-9bfa-408c9d8f8f49 tempest-SnapshotDependencyTests-422122416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c500932-9a23-4e1b-bbff-a3c3e2e7178a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:48:21 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ce54faec-da6b-4a1c-9bfa-408c9d8f8f49 tempest-SnapshotDependencyTests-422122416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c500932-9a23-4e1b-bbff-a3c3e2e7178a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e745d1c5-222b-4ff3-8e13-411a1d967133', 'volume_name': 'volume-e745d1c5-222b-4ff3-8e13-411a1d967133', 'volume_size': 1, 'snapshot_id': '4c21839b-5041-4390-bf0b-d88533238da3'}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:48:21 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ce54faec-da6b-4a1c-9bfa-408c9d8f8f49 tempest-SnapshotDependencyTests-422122416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7b5b888-c0ae-48e7-be3e-11ca1ea92e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:48:21 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ce54faec-da6b-4a1c-9bfa-408c9d8f8f49 tempest-SnapshotDependencyTests-422122416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7b5b888-c0ae-48e7-be3e-11ca1ea92e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:48:21 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ce54faec-da6b-4a1c-9bfa-408c9d8f8f49 tempest-SnapshotDependencyTests-422122416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95cedffa-d8c1-4273-aa8e-dd3229d8bf2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:48:21 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-ce54faec-da6b-4a1c-9bfa-408c9d8f8f49 tempest-SnapshotDependencyTests-422122416 None] Volume e745d1c5-222b-4ff3-8e13-411a1d967133: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e745d1c5-222b-4ff3-8e13-411a1d967133', 'volume_size': 1, 'snapshot_id': '4c21839b-5041-4390-bf0b-d88533238da3'} Sep 10 21:48:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1f6697a4-312d-4a32-8320-d5c89c53674f tempest-CreateVolumesFromSourceVolumeTest-543123483 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-c8c92dda-bae8-4a0a-9d28-adae19cccaa4 1073741824" returned: 0 in 0.821s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:48:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1f6697a4-312d-4a32-8320-d5c89c53674f tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-c8c92dda-bae8-4a0a-9d28-adae19cccaa4 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:48:21 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-ce54faec-da6b-4a1c-9bfa-408c9d8f8f49 tempest-SnapshotDependencyTests-422122416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:48:21 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-219ed24b-1180-4db3-a2e6-a2075d569836 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:48:21 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-219ed24b-1180-4db3-a2e6-a2075d569836 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:48:22 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-219ed24b-1180-4db3-a2e6-a2075d569836 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Flow 'volume_create_manager' (322238bf-928f-4833-b4c8-aeef78281879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:48:22 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-219ed24b-1180-4db3-a2e6-a2075d569836 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04874bcb-5309-4255-a404-b3912c419722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:48:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-1f6697a4-312d-4a32-8320-d5c89c53674f tempest-CreateVolumesFromSourceVolumeTest-543123483 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-c8c92dda-bae8-4a0a-9d28-adae19cccaa4" returned: 0 in 0.613s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:48:22 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-1f6697a4-312d-4a32-8320-d5c89c53674f tempest-CreateVolumesFromSourceVolumeTest-543123483 None] <== create_volume: return (1457ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:48:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-1f6697a4-312d-4a32-8320-d5c89c53674f tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.464s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:48:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-ce54faec-da6b-4a1c-9bfa-408c9d8f8f49 tempest-SnapshotDependencyTests-422122416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.472s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:48:22 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-ce54faec-da6b-4a1c-9bfa-408c9d8f8f49 tempest-SnapshotDependencyTests-422122416 None] Acquiring lock "cinder-quobyte-4c21839b-5041-4390-bf0b-d88533238da3-e745d1c5-222b-4ff3-8e13-411a1d967133" by "_create_volume_from_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:48:22 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-219ed24b-1180-4db3-a2e6-a2075d569836 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04874bcb-5309-4255-a404-b3912c419722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:48:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1630291354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0551d5bf-31b5-4f4e-b6bf-9733453e8804,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b9424817a70453a8764cd9d1dc00016',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:48:21Z,use_quota=True,user_id='c8c0e59af3af4118922545ee34018f51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:48:22 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-219ed24b-1180-4db3-a2e6-a2075d569836 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd48ead4-f04d-4761-861f-eff29f4114d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:48:22 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-219ed24b-1180-4db3-a2e6-a2075d569836 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd48ead4-f04d-4761-861f-eff29f4114d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:48:22 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-219ed24b-1180-4db3-a2e6-a2075d569836 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22650b6e-7753-495c-a90f-15e137561449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:48:22 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-219ed24b-1180-4db3-a2e6-a2075d569836 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22650b6e-7753-495c-a90f-15e137561449) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0551d5bf-31b5-4f4e-b6bf-9733453e8804', 'volume_name': 'volume-0551d5bf-31b5-4f4e-b6bf-9733453e8804', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:48:22 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-219ed24b-1180-4db3-a2e6-a2075d569836 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (575bdfc7-9de6-4303-9e30-351f599550f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:48:22 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-219ed24b-1180-4db3-a2e6-a2075d569836 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (575bdfc7-9de6-4303-9e30-351f599550f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:48:22 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-219ed24b-1180-4db3-a2e6-a2075d569836 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5fde75a-e468-4aec-9bec-bffa8421b8b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:48:22 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-219ed24b-1180-4db3-a2e6-a2075d569836 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Volume 0551d5bf-31b5-4f4e-b6bf-9733453e8804: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0551d5bf-31b5-4f4e-b6bf-9733453e8804', 'volume_size': 1} Sep 10 21:48:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-219ed24b-1180-4db3-a2e6-a2075d569836 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:48:22 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1f6697a4-312d-4a32-8320-d5c89c53674f tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (697eddb8-b1c1-49ff-8201-2fc442996e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8c92dda-bae8-4a0a-9d28-adae19cccaa4', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:48:22 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1f6697a4-312d-4a32-8320-d5c89c53674f tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81096f0f-a5ec-4106-b8fd-8a62bcfaef34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:48:22 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-d1b77b53-f40f-4a5c-87c0-dd59a8deaaae tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:48:22 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1b77b53-f40f-4a5c-87c0-dd59a8deaaae tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:48:22 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-d1b77b53-f40f-4a5c-87c0-dd59a8deaaae tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Flow 'volume_create_manager' (01a417c4-6dec-47e2-bd0e-2d591088eae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:48:22 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-d1b77b53-f40f-4a5c-87c0-dd59a8deaaae tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d827686-7e69-4720-8ac8-ea37e0457cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:48:22 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-1f6697a4-312d-4a32-8320-d5c89c53674f tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Volume volume-c8c92dda-bae8-4a0a-9d28-adae19cccaa4 (c8c92dda-bae8-4a0a-9d28-adae19cccaa4): created successfully Sep 10 21:48:22 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1f6697a4-312d-4a32-8320-d5c89c53674f tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81096f0f-a5ec-4106-b8fd-8a62bcfaef34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:48:22 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-1f6697a4-312d-4a32-8320-d5c89c53674f tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Flow 'volume_create_manager' (c018e15d-2b1d-4b46-a5bc-57eed88cfa79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:48:22 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-ce54faec-da6b-4a1c-9bfa-408c9d8f8f49 tempest-SnapshotDependencyTests-422122416 None] Lock "cinder-quobyte-4c21839b-5041-4390-bf0b-d88533238da3-e745d1c5-222b-4ff3-8e13-411a1d967133" acquired by "_create_volume_from_snapshot" :: waited 0.208s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:48:22 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-ce54faec-da6b-4a1c-9bfa-408c9d8f8f49 tempest-SnapshotDependencyTests-422122416 None] Creating volume e745d1c5-222b-4ff3-8e13-411a1d967133 from snapshot 4c21839b-5041-4390-bf0b-d88533238da3 {{(pid=82780) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 10 21:48:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-ce54faec-da6b-4a1c-9bfa-408c9d8f8f49 tempest-SnapshotDependencyTests-422122416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:48:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-ce54faec-da6b-4a1c-9bfa-408c9d8f8f49 tempest-SnapshotDependencyTests-422122416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:48:22 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-ce54faec-da6b-4a1c-9bfa-408c9d8f8f49 tempest-SnapshotDependencyTests-422122416 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:48:22 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-ce54faec-da6b-4a1c-9bfa-408c9d8f8f49 tempest-SnapshotDependencyTests-422122416 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:48:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-ce54faec-da6b-4a1c-9bfa-408c9d8f8f49 tempest-SnapshotDependencyTests-422122416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:48:22 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-ce54faec-da6b-4a1c-9bfa-408c9d8f8f49 tempest-SnapshotDependencyTests-422122416 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:48:22 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-ce54faec-da6b-4a1c-9bfa-408c9d8f8f49 tempest-SnapshotDependencyTests-422122416 None] Acquiring lock "cinder-quobyte-e745d1c5-222b-4ff3-8e13-411a1d967133" by "_copy_volume_from_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:48:22 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-d1b77b53-f40f-4a5c-87c0-dd59a8deaaae tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d827686-7e69-4720-8ac8-ea37e0457cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:48:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1551266773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fac35bed-883e-4957-912d-663b9dd2673e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b9424817a70453a8764cd9d1dc00016',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:48:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:48:22Z,use_quota=True,user_id='c8c0e59af3af4118922545ee34018f51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:48:22 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-d1b77b53-f40f-4a5c-87c0-dd59a8deaaae tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fdc0ce1-8877-4529-9b74-4c0d3b8961ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:48:22 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-d1b77b53-f40f-4a5c-87c0-dd59a8deaaae tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fdc0ce1-8877-4529-9b74-4c0d3b8961ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:48:22 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-d1b77b53-f40f-4a5c-87c0-dd59a8deaaae tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b4aeae4-7195-4ee0-a0ae-4f9237d400db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:48:22 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-d1b77b53-f40f-4a5c-87c0-dd59a8deaaae tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b4aeae4-7195-4ee0-a0ae-4f9237d400db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fac35bed-883e-4957-912d-663b9dd2673e', 'volume_name': 'volume-fac35bed-883e-4957-912d-663b9dd2673e', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:48:22 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-d1b77b53-f40f-4a5c-87c0-dd59a8deaaae tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42a695f7-68f7-463a-bb28-23e3d5cab548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:48:22 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-d1b77b53-f40f-4a5c-87c0-dd59a8deaaae tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42a695f7-68f7-463a-bb28-23e3d5cab548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:48:22 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-d1b77b53-f40f-4a5c-87c0-dd59a8deaaae tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e994f7f-64c1-4305-b318-9fa71843971d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:48:22 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-d1b77b53-f40f-4a5c-87c0-dd59a8deaaae tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Volume fac35bed-883e-4957-912d-663b9dd2673e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fac35bed-883e-4957-912d-663b9dd2673e', 'volume_size': 1} Sep 10 21:48:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-d1b77b53-f40f-4a5c-87c0-dd59a8deaaae tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:48:22 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-ce54faec-da6b-4a1c-9bfa-408c9d8f8f49 tempest-SnapshotDependencyTests-422122416 None] Lock "cinder-quobyte-e745d1c5-222b-4ff3-8e13-411a1d967133" acquired by "_copy_volume_from_snapshot" :: waited 0.079s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:48:22 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-ce54faec-da6b-4a1c-9bfa-408c9d8f8f49 tempest-SnapshotDependencyTests-422122416 None] snapshot: 4c21839b-5041-4390-bf0b-d88533238da3, volume: e745d1c5-222b-4ff3-8e13-411a1d967133, {{(pid=82780) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}} Sep 10 21:48:22 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-1f6697a4-312d-4a32-8320-d5c89c53674f tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Created volume successfully. Sep 10 21:48:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-ce54faec-da6b-4a1c-9bfa-408c9d8f8f49 tempest-SnapshotDependencyTests-422122416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:48:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-ce54faec-da6b-4a1c-9bfa-408c9d8f8f49 tempest-SnapshotDependencyTests-422122416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:48:22 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-ce54faec-da6b-4a1c-9bfa-408c9d8f8f49 tempest-SnapshotDependencyTests-422122416 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:48:22 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-ce54faec-da6b-4a1c-9bfa-408c9d8f8f49 tempest-SnapshotDependencyTests-422122416 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:48:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-ce54faec-da6b-4a1c-9bfa-408c9d8f8f49 tempest-SnapshotDependencyTests-422122416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:48:22 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1338f28-4c79-45ec-95d4-b7e298ccedcc]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:48:22 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ce54faec-da6b-4a1c-9bfa-408c9d8f8f49 tempest-SnapshotDependencyTests-422122416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1f7662c6-07b8-422c-b9e4-4cf840d7677a.4c21839b-5041-4390-bf0b-d88533238da3 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:48:23 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-c4262171-8144-4208-80a3-98842eb1e915 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:48:23 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4262171-8144-4208-80a3-98842eb1e915 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:48:23 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c4262171-8144-4208-80a3-98842eb1e915 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Flow 'volume_create_manager' (7d260c3b-abe1-43d2-af63-10a616d64dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:48:23 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c4262171-8144-4208-80a3-98842eb1e915 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (591a0a0b-9cf6-4f2d-8cae-98c88f7af275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:48:23 devstack quobyte-client[82807]: System call of process 101635 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:48:23 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c4262171-8144-4208-80a3-98842eb1e915 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (591a0a0b-9cf6-4f2d-8cae-98c88f7af275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:48:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1427819921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b0c040e-cf14-4301-9b78-8ff20ce65efb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b9424817a70453a8764cd9d1dc00016',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:48:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:48:23Z,use_quota=True,user_id='c8c0e59af3af4118922545ee34018f51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:48:23 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c4262171-8144-4208-80a3-98842eb1e915 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0230d9e-b4cc-4d6f-8069-81b9cf46c4fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:48:23 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c4262171-8144-4208-80a3-98842eb1e915 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0230d9e-b4cc-4d6f-8069-81b9cf46c4fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:48:23 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c4262171-8144-4208-80a3-98842eb1e915 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0ed2d34-95d0-48ed-a6ef-6a11d3464048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:48:23 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c4262171-8144-4208-80a3-98842eb1e915 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0ed2d34-95d0-48ed-a6ef-6a11d3464048) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b0c040e-cf14-4301-9b78-8ff20ce65efb', 'volume_name': 'volume-7b0c040e-cf14-4301-9b78-8ff20ce65efb', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:48:23 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c4262171-8144-4208-80a3-98842eb1e915 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f8ad0c1-98c9-4547-8d4d-05af1f33400d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:48:23 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c4262171-8144-4208-80a3-98842eb1e915 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f8ad0c1-98c9-4547-8d4d-05af1f33400d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:48:23 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c4262171-8144-4208-80a3-98842eb1e915 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e932cd3e-28bb-420f-b68d-53e7b410e75e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:48:23 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-c4262171-8144-4208-80a3-98842eb1e915 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Volume 7b0c040e-cf14-4301-9b78-8ff20ce65efb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b0c040e-cf14-4301-9b78-8ff20ce65efb', 'volume_size': 1} Sep 10 21:48:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-c4262171-8144-4208-80a3-98842eb1e915 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:48:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ce54faec-da6b-4a1c-9bfa-408c9d8f8f49 tempest-SnapshotDependencyTests-422122416 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1f7662c6-07b8-422c-b9e4-4cf840d7677a.4c21839b-5041-4390-bf0b-d88533238da3" returned: 0 in 0.735s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:48:23 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-ce54faec-da6b-4a1c-9bfa-408c9d8f8f49 tempest-SnapshotDependencyTests-422122416 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f7662c6-07b8-422c-b9e4-4cf840d7677a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82780) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 21:48:23 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-ce54faec-da6b-4a1c-9bfa-408c9d8f8f49 tempest-SnapshotDependencyTests-422122416 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1f7662c6-07b8-422c-b9e4-4cf840d7677a {{(pid=82780) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}} Sep 10 21:48:23 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-ce54faec-da6b-4a1c-9bfa-408c9d8f8f49 tempest-SnapshotDependencyTests-422122416 None] Creating direct copy from snapshot {{(pid=82780) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Sep 10 21:48:23 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[f385015a-6b4c-4727-aa22-74a0f4e49192]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:48:23 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ce54faec-da6b-4a1c-9bfa-408c9d8f8f49 tempest-SnapshotDependencyTests-422122416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1f7662c6-07b8-422c-b9e4-4cf840d7677a {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:48:23 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-04bdd2c9-459d-46d4-b529-f1b6e0d31199 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:48:23 devstack cinder-volume[82780]: DEBUG cinder.volume.flows.manager.create_volume [None req-04bdd2c9-459d-46d4-b529-f1b6e0d31199 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 21:48:23 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-04bdd2c9-459d-46d4-b529-f1b6e0d31199 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Flow 'volume_create_manager' (eea31108-973a-4bf4-838f-76ed39bd9c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:48:23 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-04bdd2c9-459d-46d4-b529-f1b6e0d31199 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f0fe80a-9653-480e-ae53-6e4102f4ad4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:48:24 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-04bdd2c9-459d-46d4-b529-f1b6e0d31199 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f0fe80a-9653-480e-ae53-6e4102f4ad4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:48:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2039068283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30d0a164-aaf4-477a-a03d-995a872bde15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b9424817a70453a8764cd9d1dc00016',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:48:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:48:23Z,use_quota=True,user_id='c8c0e59af3af4118922545ee34018f51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:48:24 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-04bdd2c9-459d-46d4-b529-f1b6e0d31199 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0381064-e375-41c1-be53-24f626b86228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:48:24 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-04bdd2c9-459d-46d4-b529-f1b6e0d31199 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0381064-e375-41c1-be53-24f626b86228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:48:24 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-04bdd2c9-459d-46d4-b529-f1b6e0d31199 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba57b707-57f6-406d-bc55-db7eef757248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:48:24 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-04bdd2c9-459d-46d4-b529-f1b6e0d31199 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba57b707-57f6-406d-bc55-db7eef757248) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30d0a164-aaf4-477a-a03d-995a872bde15', 'volume_name': 'volume-30d0a164-aaf4-477a-a03d-995a872bde15', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:48:24 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-04bdd2c9-459d-46d4-b529-f1b6e0d31199 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca44eafa-a9be-48d8-8365-ce3b88cc0454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:48:24 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-04bdd2c9-459d-46d4-b529-f1b6e0d31199 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca44eafa-a9be-48d8-8365-ce3b88cc0454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:48:24 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-04bdd2c9-459d-46d4-b529-f1b6e0d31199 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29d4b205-cdc0-4126-a9a7-5324ecc0e702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:48:24 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-04bdd2c9-459d-46d4-b529-f1b6e0d31199 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Volume 30d0a164-aaf4-477a-a03d-995a872bde15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30d0a164-aaf4-477a-a03d-995a872bde15', 'volume_size': 1} Sep 10 21:48:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-04bdd2c9-459d-46d4-b529-f1b6e0d31199 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:48:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ce54faec-da6b-4a1c-9bfa-408c9d8f8f49 tempest-SnapshotDependencyTests-422122416 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1f7662c6-07b8-422c-b9e4-4cf840d7677a" returned: 0 in 0.699s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:48:24 devstack cinder-volume[82780]: DEBUG cinder.utils [None req-ce54faec-da6b-4a1c-9bfa-408c9d8f8f49 tempest-SnapshotDependencyTests-422122416 None] Path /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-e745d1c5-222b-4ff3-8e13-411a1d967133 not found in is_blk_device check {{(pid=82780) is_blk_device /opt/stack/cinder/cinder/utils.py:591}} Sep 10 21:48:24 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ce54faec-da6b-4a1c-9bfa-408c9d8f8f49 tempest-SnapshotDependencyTests-422122416 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1f7662c6-07b8-422c-b9e4-4cf840d7677a /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-e745d1c5-222b-4ff3-8e13-411a1d967133 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:48:24 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=169, name=volume-e745d1c5-222b-4ff3-8e13-411a1d967133, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:48:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ce54faec-da6b-4a1c-9bfa-408c9d8f8f49 tempest-SnapshotDependencyTests-422122416 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1f7662c6-07b8-422c-b9e4-4cf840d7677a /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-e745d1c5-222b-4ff3-8e13-411a1d967133" returned: 0 in 7.026s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:48:31 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[d949accc-8e23-41a5-8135-bdc534da1c15]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:48:31 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ce54faec-da6b-4a1c-9bfa-408c9d8f8f49 tempest-SnapshotDependencyTests-422122416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1f7662c6-07b8-422c-b9e4-4cf840d7677a {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:48:32 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ce54faec-da6b-4a1c-9bfa-408c9d8f8f49 tempest-SnapshotDependencyTests-422122416 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1f7662c6-07b8-422c-b9e4-4cf840d7677a" returned: 0 in 0.632s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:48:32 devstack cinder-volume[82780]: DEBUG cinder.image.image_utils [None req-ce54faec-da6b-4a1c-9bfa-408c9d8f8f49 tempest-SnapshotDependencyTests-422122416 None] Image conversion details: src /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1f7662c6-07b8-422c-b9e4-4cf840d7677a, size 1024.00 MB, duration 7.06 sec, destination /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-e745d1c5-222b-4ff3-8e13-411a1d967133 {{(pid=82780) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 10 21:48:32 devstack cinder-volume[82780]: INFO cinder.image.image_utils [None req-ce54faec-da6b-4a1c-9bfa-408c9d8f8f49 tempest-SnapshotDependencyTests-422122416 None] Converted 1024.00 MB image at 145.13 MB/s Sep 10 21:48:32 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-ce54faec-da6b-4a1c-9bfa-408c9d8f8f49 tempest-SnapshotDependencyTests-422122416 None] File path /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-e745d1c5-222b-4ff3-8e13-411a1d967133 is being set with permissions: 660 {{(pid=82780) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 21:48:32 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ce54faec-da6b-4a1c-9bfa-408c9d8f8f49 tempest-SnapshotDependencyTests-422122416 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-e745d1c5-222b-4ff3-8e13-411a1d967133 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:48:32 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-ce54faec-da6b-4a1c-9bfa-408c9d8f8f49 tempest-SnapshotDependencyTests-422122416 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-e745d1c5-222b-4ff3-8e13-411a1d967133" returned: 0 in 0.098s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:48:32 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-ce54faec-da6b-4a1c-9bfa-408c9d8f8f49 tempest-SnapshotDependencyTests-422122416 None] Lock "cinder-quobyte-e745d1c5-222b-4ff3-8e13-411a1d967133" released by "_copy_volume_from_snapshot" :: held 9.539s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:48:32 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-ce54faec-da6b-4a1c-9bfa-408c9d8f8f49 tempest-SnapshotDependencyTests-422122416 None] Lock "cinder-quobyte-4c21839b-5041-4390-bf0b-d88533238da3-e745d1c5-222b-4ff3-8e13-411a1d967133" released by "_create_volume_from_snapshot" :: held 9.646s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:48:32 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-ce54faec-da6b-4a1c-9bfa-408c9d8f8f49 tempest-SnapshotDependencyTests-422122416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.864s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:48:32 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-219ed24b-1180-4db3-a2e6-a2075d569836 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.900s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:48:32 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-219ed24b-1180-4db3-a2e6-a2075d569836 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:48:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1630291354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0551d5bf-31b5-4f4e-b6bf-9733453e8804,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b9424817a70453a8764cd9d1dc00016',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:48:21Z,use_quota=True,user_id='c8c0e59af3af4118922545ee34018f51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:48:32 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-219ed24b-1180-4db3-a2e6-a2075d569836 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Creating volume 0551d5bf-31b5-4f4e-b6bf-9733453e8804 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:48:32 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-219ed24b-1180-4db3-a2e6-a2075d569836 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:48:32 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-219ed24b-1180-4db3-a2e6-a2075d569836 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:48:32 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-219ed24b-1180-4db3-a2e6-a2075d569836 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:48:32 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-219ed24b-1180-4db3-a2e6-a2075d569836 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:48:32 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-219ed24b-1180-4db3-a2e6-a2075d569836 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:48:32 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-219ed24b-1180-4db3-a2e6-a2075d569836 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:48:32 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-219ed24b-1180-4db3-a2e6-a2075d569836 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:48:32 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-219ed24b-1180-4db3-a2e6-a2075d569836 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-0551d5bf-31b5-4f4e-b6bf-9733453e8804 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:48:32 devstack quobyte-client[82807]: System call of process 101657 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:48:32 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=170, name=volume-0551d5bf-31b5-4f4e-b6bf-9733453e8804, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:48:32 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-219ed24b-1180-4db3-a2e6-a2075d569836 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-0551d5bf-31b5-4f4e-b6bf-9733453e8804 1073741824" returned: 0 in 0.444s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:48:32 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-219ed24b-1180-4db3-a2e6-a2075d569836 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-0551d5bf-31b5-4f4e-b6bf-9733453e8804 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:48:33 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ce54faec-da6b-4a1c-9bfa-408c9d8f8f49 tempest-SnapshotDependencyTests-422122416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95cedffa-d8c1-4273-aa8e-dd3229d8bf2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e745d1c5-222b-4ff3-8e13-411a1d967133', 'volume_size': 1, 'snapshot_id': '4c21839b-5041-4390-bf0b-d88533238da3'}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:48:33 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ce54faec-da6b-4a1c-9bfa-408c9d8f8f49 tempest-SnapshotDependencyTests-422122416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82823653-2ed8-4ef5-a013-08b7b476aa8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:48:33 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-219ed24b-1180-4db3-a2e6-a2075d569836 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-0551d5bf-31b5-4f4e-b6bf-9733453e8804" returned: 0 in 0.311s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:48:33 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-219ed24b-1180-4db3-a2e6-a2075d569836 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] <== create_volume: return (793ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:48:33 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-219ed24b-1180-4db3-a2e6-a2075d569836 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:48:33 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-d1b77b53-f40f-4a5c-87c0-dd59a8deaaae tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.526s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:48:33 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-d1b77b53-f40f-4a5c-87c0-dd59a8deaaae tempest-CreateVolumesFromSourceVolumeTest-543123483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:48:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1551266773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fac35bed-883e-4957-912d-663b9dd2673e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b9424817a70453a8764cd9d1dc00016',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:48:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:48:22Z,use_quota=True,user_id='c8c0e59af3af4118922545ee34018f51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:48:33 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-d1b77b53-f40f-4a5c-87c0-dd59a8deaaae tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Creating volume fac35bed-883e-4957-912d-663b9dd2673e {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:48:33 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-d1b77b53-f40f-4a5c-87c0-dd59a8deaaae tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:48:33 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-d1b77b53-f40f-4a5c-87c0-dd59a8deaaae tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:48:33 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-d1b77b53-f40f-4a5c-87c0-dd59a8deaaae tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:48:33 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-d1b77b53-f40f-4a5c-87c0-dd59a8deaaae tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:48:33 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-d1b77b53-f40f-4a5c-87c0-dd59a8deaaae tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:48:33 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-d1b77b53-f40f-4a5c-87c0-dd59a8deaaae tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:48:33 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-d1b77b53-f40f-4a5c-87c0-dd59a8deaaae tempest-CreateVolumesFromSourceVolumeTest-543123483 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:48:33 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-d1b77b53-f40f-4a5c-87c0-dd59a8deaaae tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-fac35bed-883e-4957-912d-663b9dd2673e 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:48:33 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-ce54faec-da6b-4a1c-9bfa-408c9d8f8f49 tempest-SnapshotDependencyTests-422122416 None] Volume volume-e745d1c5-222b-4ff3-8e13-411a1d967133 (e745d1c5-222b-4ff3-8e13-411a1d967133): created successfully Sep 10 21:48:33 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=171, name=volume-fac35bed-883e-4957-912d-663b9dd2673e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:48:33 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ce54faec-da6b-4a1c-9bfa-408c9d8f8f49 tempest-SnapshotDependencyTests-422122416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82823653-2ed8-4ef5-a013-08b7b476aa8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:48:33 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-ce54faec-da6b-4a1c-9bfa-408c9d8f8f49 tempest-SnapshotDependencyTests-422122416 None] Flow 'volume_create_manager' (d015e9b1-a0a9-4090-a33e-0e3f7aa579f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:48:33 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-219ed24b-1180-4db3-a2e6-a2075d569836 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5fde75a-e468-4aec-9bec-bffa8421b8b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0551d5bf-31b5-4f4e-b6bf-9733453e8804', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:48:33 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-219ed24b-1180-4db3-a2e6-a2075d569836 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86defcfa-02e0-4bcd-93fc-20104d5b6a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:48:33 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-219ed24b-1180-4db3-a2e6-a2075d569836 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Volume volume-0551d5bf-31b5-4f4e-b6bf-9733453e8804 (0551d5bf-31b5-4f4e-b6bf-9733453e8804): created successfully Sep 10 21:48:33 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-219ed24b-1180-4db3-a2e6-a2075d569836 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86defcfa-02e0-4bcd-93fc-20104d5b6a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:48:33 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-219ed24b-1180-4db3-a2e6-a2075d569836 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Flow 'volume_create_manager' (322238bf-928f-4833-b4c8-aeef78281879) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:48:33 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-d1b77b53-f40f-4a5c-87c0-dd59a8deaaae tempest-CreateVolumesFromSourceVolumeTest-543123483 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-fac35bed-883e-4957-912d-663b9dd2673e 1073741824" returned: 0 in 0.539s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:48:33 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-d1b77b53-f40f-4a5c-87c0-dd59a8deaaae tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-fac35bed-883e-4957-912d-663b9dd2673e {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:48:33 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-ce54faec-da6b-4a1c-9bfa-408c9d8f8f49 tempest-SnapshotDependencyTests-422122416 None] Created volume successfully. Sep 10 21:48:34 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-8cf83a98-dd38-4d77-9fde-51a49edd528f tempest-SnapshotDependencyTests-422122416 None] Acquiring lock "cinder-4c21839b-5041-4390-bf0b-d88533238da3-delete_snapshot" by "delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:48:34 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-219ed24b-1180-4db3-a2e6-a2075d569836 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Created volume successfully. Sep 10 21:48:34 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-d1b77b53-f40f-4a5c-87c0-dd59a8deaaae tempest-CreateVolumesFromSourceVolumeTest-543123483 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-fac35bed-883e-4957-912d-663b9dd2673e" returned: 0 in 0.424s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:48:34 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-d1b77b53-f40f-4a5c-87c0-dd59a8deaaae tempest-CreateVolumesFromSourceVolumeTest-543123483 None] <== create_volume: return (993ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:48:34 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-d1b77b53-f40f-4a5c-87c0-dd59a8deaaae tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:48:34 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-c4262171-8144-4208-80a3-98842eb1e915 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.748s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:48:34 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-c4262171-8144-4208-80a3-98842eb1e915 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:48:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1427819921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b0c040e-cf14-4301-9b78-8ff20ce65efb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b9424817a70453a8764cd9d1dc00016',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:48:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:48:23Z,use_quota=True,user_id='c8c0e59af3af4118922545ee34018f51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:48:34 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-c4262171-8144-4208-80a3-98842eb1e915 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Creating volume 7b0c040e-cf14-4301-9b78-8ff20ce65efb {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:48:34 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-c4262171-8144-4208-80a3-98842eb1e915 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:48:34 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-c4262171-8144-4208-80a3-98842eb1e915 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:48:34 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-c4262171-8144-4208-80a3-98842eb1e915 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:48:34 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-c4262171-8144-4208-80a3-98842eb1e915 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:48:34 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-c4262171-8144-4208-80a3-98842eb1e915 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:48:34 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-c4262171-8144-4208-80a3-98842eb1e915 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:48:34 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-c4262171-8144-4208-80a3-98842eb1e915 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:48:34 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c4262171-8144-4208-80a3-98842eb1e915 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-7b0c040e-cf14-4301-9b78-8ff20ce65efb 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:48:34 devstack quobyte-client[82807]: System call of process 101665 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:48:34 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=172, name=volume-7b0c040e-cf14-4301-9b78-8ff20ce65efb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:48:34 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-d1b77b53-f40f-4a5c-87c0-dd59a8deaaae tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e994f7f-64c1-4305-b318-9fa71843971d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fac35bed-883e-4957-912d-663b9dd2673e', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:48:34 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-d1b77b53-f40f-4a5c-87c0-dd59a8deaaae tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6d58be0-b23e-4609-916c-cf18565e07b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:48:34 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-8cf83a98-dd38-4d77-9fde-51a49edd528f tempest-SnapshotDependencyTests-422122416 None] Lock "cinder-4c21839b-5041-4390-bf0b-d88533238da3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.547s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:48:34 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-8cf83a98-dd38-4d77-9fde-51a49edd528f tempest-SnapshotDependencyTests-422122416 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:48:34 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-8cf83a98-dd38-4d77-9fde-51a49edd528f tempest-SnapshotDependencyTests-422122416 None] Acquiring lock "cinder-quobyte-1f7662c6-07b8-422c-b9e4-4cf840d7677a" by "delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:48:34 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-8cf83a98-dd38-4d77-9fde-51a49edd528f tempest-SnapshotDependencyTests-422122416 None] Lock "cinder-quobyte-1f7662c6-07b8-422c-b9e4-4cf840d7677a" acquired by "delete_snapshot" :: waited 0.034s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:48:34 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-8cf83a98-dd38-4d77-9fde-51a49edd528f tempest-SnapshotDependencyTests-422122416 None] Acquiring lock "cinder-quobyte-4c21839b-5041-4390-bf0b-d88533238da3" by "_delete_snapshot" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:48:34 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c4262171-8144-4208-80a3-98842eb1e915 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-7b0c040e-cf14-4301-9b78-8ff20ce65efb 1073741824" returned: 0 in 0.490s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:48:34 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c4262171-8144-4208-80a3-98842eb1e915 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-7b0c040e-cf14-4301-9b78-8ff20ce65efb {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:48:34 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-d1b77b53-f40f-4a5c-87c0-dd59a8deaaae tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Volume volume-fac35bed-883e-4957-912d-663b9dd2673e (fac35bed-883e-4957-912d-663b9dd2673e): created successfully Sep 10 21:48:34 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-d1b77b53-f40f-4a5c-87c0-dd59a8deaaae tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6d58be0-b23e-4609-916c-cf18565e07b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:48:34 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-d1b77b53-f40f-4a5c-87c0-dd59a8deaaae tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Flow 'volume_create_manager' (01a417c4-6dec-47e2-bd0e-2d591088eae7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:48:35 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-8cf83a98-dd38-4d77-9fde-51a49edd528f tempest-SnapshotDependencyTests-422122416 None] Lock "cinder-quobyte-4c21839b-5041-4390-bf0b-d88533238da3" acquired by "_delete_snapshot" :: waited 0.408s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:48:35 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-8cf83a98-dd38-4d77-9fde-51a49edd528f tempest-SnapshotDependencyTests-422122416 None] Deleting offline snapshot 4c21839b-5041-4390-bf0b-d88533238da3 of volume 1f7662c6-07b8-422c-b9e4-4cf840d7677a {{(pid=82780) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 21:48:35 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-8cf83a98-dd38-4d77-9fde-51a49edd528f tempest-SnapshotDependencyTests-422122416 None] snapshot_file for this snap is: volume-1f7662c6-07b8-422c-b9e4-4cf840d7677a.4c21839b-5041-4390-bf0b-d88533238da3 {{(pid=82780) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 21:48:35 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[8175f47c-a47a-4f6a-ae9f-cb6f51ca5036]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:48:35 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-8cf83a98-dd38-4d77-9fde-51a49edd528f tempest-SnapshotDependencyTests-422122416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1f7662c6-07b8-422c-b9e4-4cf840d7677a.4c21839b-5041-4390-bf0b-d88533238da3 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:48:35 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-d1b77b53-f40f-4a5c-87c0-dd59a8deaaae tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Created volume successfully. Sep 10 21:48:35 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-c4262171-8144-4208-80a3-98842eb1e915 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-7b0c040e-cf14-4301-9b78-8ff20ce65efb" returned: 0 in 0.752s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:48:35 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-c4262171-8144-4208-80a3-98842eb1e915 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] <== create_volume: return (1290ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:48:35 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-c4262171-8144-4208-80a3-98842eb1e915 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.306s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:48:35 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-04bdd2c9-459d-46d4-b529-f1b6e0d31199 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.409s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:48:35 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-04bdd2c9-459d-46d4-b529-f1b6e0d31199 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T19:48:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2039068283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30d0a164-aaf4-477a-a03d-995a872bde15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b9424817a70453a8764cd9d1dc00016',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T19:48:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T19:48:23Z,use_quota=True,user_id='c8c0e59af3af4118922545ee34018f51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38c3a916-809a-4c02-b5bb-edf4cdabd0f7),volume_type_id=38c3a916-809a-4c02-b5bb-edf4cdabd0f7)}" {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 21:48:35 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-04bdd2c9-459d-46d4-b529-f1b6e0d31199 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Creating volume 30d0a164-aaf4-477a-a03d-995a872bde15 {{(pid=82780) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 21:48:35 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-04bdd2c9-459d-46d4-b529-f1b6e0d31199 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:48:35 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-04bdd2c9-459d-46d4-b529-f1b6e0d31199 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:48:35 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-04bdd2c9-459d-46d4-b529-f1b6e0d31199 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:48:35 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-04bdd2c9-459d-46d4-b529-f1b6e0d31199 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:48:35 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-04bdd2c9-459d-46d4-b529-f1b6e0d31199 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:48:35 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-04bdd2c9-459d-46d4-b529-f1b6e0d31199 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Selected 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b as target Quobyte volume. {{(pid=82780) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 21:48:35 devstack cinder-volume[82780]: INFO cinder.volume.drivers.remotefs [None req-04bdd2c9-459d-46d4-b529-f1b6e0d31199 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] casted to 10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b Sep 10 21:48:35 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-04bdd2c9-459d-46d4-b529-f1b6e0d31199 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-30d0a164-aaf4-477a-a03d-995a872bde15 1073741824 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:48:35 devstack quobyte-client[82807]: The server volume:7b04abac-7a61-4324-a576-f55b59bf30a9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7b04abac-7a61-4324-a576-f55b59bf30a9, inode=173, name=volume-30d0a164-aaf4-477a-a03d-995a872bde15, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.32), requestorAccessMask=0 Sep 10 21:48:35 devstack quobyte-client[82807]: System call of process 101669 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:48:35 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c4262171-8144-4208-80a3-98842eb1e915 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e932cd3e-28bb-420f-b68d-53e7b410e75e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b0c040e-cf14-4301-9b78-8ff20ce65efb', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:48:35 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c4262171-8144-4208-80a3-98842eb1e915 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f3c6d83-8302-4ac5-b03c-914fa46a14ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:48:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-8cf83a98-dd38-4d77-9fde-51a49edd528f tempest-SnapshotDependencyTests-422122416 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1f7662c6-07b8-422c-b9e4-4cf840d7677a.4c21839b-5041-4390-bf0b-d88533238da3" returned: 0 in 0.820s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:48:36 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.remotefs [None req-8cf83a98-dd38-4d77-9fde-51a49edd528f tempest-SnapshotDependencyTests-422122416 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f7662c6-07b8-422c-b9e4-4cf840d7677a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82780) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 21:48:36 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-c4262171-8144-4208-80a3-98842eb1e915 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Volume volume-7b0c040e-cf14-4301-9b78-8ff20ce65efb (7b0c040e-cf14-4301-9b78-8ff20ce65efb): created successfully Sep 10 21:48:36 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c4262171-8144-4208-80a3-98842eb1e915 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f3c6d83-8302-4ac5-b03c-914fa46a14ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:48:36 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-c4262171-8144-4208-80a3-98842eb1e915 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Flow 'volume_create_manager' (7d260c3b-abe1-43d2-af63-10a616d64dae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:48:36 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[129f58e2-770b-40f2-a1f7-16cc06260b43]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:48:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-8cf83a98-dd38-4d77-9fde-51a49edd528f tempest-SnapshotDependencyTests-422122416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1f7662c6-07b8-422c-b9e4-4cf840d7677a {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:48:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-04bdd2c9-459d-46d4-b529-f1b6e0d31199 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-30d0a164-aaf4-477a-a03d-995a872bde15 1073741824" returned: 0 in 0.694s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:48:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-04bdd2c9-459d-46d4-b529-f1b6e0d31199 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-30d0a164-aaf4-477a-a03d-995a872bde15 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:48:36 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-c4262171-8144-4208-80a3-98842eb1e915 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Created volume successfully. Sep 10 21:48:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-04bdd2c9-459d-46d4-b529-f1b6e0d31199 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-30d0a164-aaf4-477a-a03d-995a872bde15" returned: 0 in 0.316s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:48:36 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-04bdd2c9-459d-46d4-b529-f1b6e0d31199 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] <== create_volume: return (1077ms) {'provider_location': '10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'} {{(pid=82780) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 21:48:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-04bdd2c9-459d-46d4-b529-f1b6e0d31199 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:48:36 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-04bdd2c9-459d-46d4-b529-f1b6e0d31199 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29d4b205-cdc0-4126-a9a7-5324ecc0e702) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30d0a164-aaf4-477a-a03d-995a872bde15', 'volume_size': 1}' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:48:36 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-04bdd2c9-459d-46d4-b529-f1b6e0d31199 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (494d811a-f95c-4962-bba0-8fdcd508941b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 21:48:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-8cf83a98-dd38-4d77-9fde-51a49edd528f tempest-SnapshotDependencyTests-422122416 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1f7662c6-07b8-422c-b9e4-4cf840d7677a" returned: 0 in 0.746s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:48:36 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-8cf83a98-dd38-4d77-9fde-51a49edd528f tempest-SnapshotDependencyTests-422122416 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1f7662c6-07b8-422c-b9e4-4cf840d7677a.4c21839b-5041-4390-bf0b-d88533238da3 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:48:37 devstack cinder-volume[82780]: INFO cinder.volume.flows.manager.create_volume [None req-04bdd2c9-459d-46d4-b529-f1b6e0d31199 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Volume volume-30d0a164-aaf4-477a-a03d-995a872bde15 (30d0a164-aaf4-477a-a03d-995a872bde15): created successfully Sep 10 21:48:37 devstack quobyte-client[82807]: System call of process 101679 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:48:37 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-04bdd2c9-459d-46d4-b529-f1b6e0d31199 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (494d811a-f95c-4962-bba0-8fdcd508941b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82780) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 21:48:37 devstack cinder-volume[82780]: DEBUG cinder.volume.manager [None req-04bdd2c9-459d-46d4-b529-f1b6e0d31199 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Flow 'volume_create_manager' (eea31108-973a-4bf4-838f-76ed39bd9c81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82780) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 21:48:37 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-8cf83a98-dd38-4d77-9fde-51a49edd528f tempest-SnapshotDependencyTests-422122416 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1f7662c6-07b8-422c-b9e4-4cf840d7677a.4c21839b-5041-4390-bf0b-d88533238da3" returned: 0 in 0.374s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:48:37 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-8cf83a98-dd38-4d77-9fde-51a49edd528f tempest-SnapshotDependencyTests-422122416 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1f7662c6-07b8-422c-b9e4-4cf840d7677a.4c21839b-5041-4390-bf0b-d88533238da3 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:48:37 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-04bdd2c9-459d-46d4-b529-f1b6e0d31199 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Created volume successfully. Sep 10 21:48:37 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-8cf83a98-dd38-4d77-9fde-51a49edd528f tempest-SnapshotDependencyTests-422122416 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1f7662c6-07b8-422c-b9e4-4cf840d7677a.4c21839b-5041-4390-bf0b-d88533238da3" returned: 0 in 0.265s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:48:37 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-8cf83a98-dd38-4d77-9fde-51a49edd528f tempest-SnapshotDependencyTests-422122416 None] Lock "cinder-quobyte-4c21839b-5041-4390-bf0b-d88533238da3" released by "_delete_snapshot" :: held 2.529s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:48:37 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-8cf83a98-dd38-4d77-9fde-51a49edd528f tempest-SnapshotDependencyTests-422122416 None] Lock "cinder-quobyte-1f7662c6-07b8-422c-b9e4-4cf840d7677a" released by "delete_snapshot" :: held 2.948s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:48:37 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-201e187e-11ce-47ba-ac3f-ca55a4d2c83a tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Acquiring lock "cinder-30d0a164-aaf4-477a-a03d-995a872bde15-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:48:37 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-201e187e-11ce-47ba-ac3f-ca55a4d2c83a tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Lock "cinder-30d0a164-aaf4-477a-a03d-995a872bde15-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:48:37 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-201e187e-11ce-47ba-ac3f-ca55a4d2c83a tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:48:38 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-201e187e-11ce-47ba-ac3f-ca55a4d2c83a tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Acquiring lock "cinder-quobyte-30d0a164-aaf4-477a-a03d-995a872bde15" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:48:38 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-201e187e-11ce-47ba-ac3f-ca55a4d2c83a tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Lock "cinder-quobyte-30d0a164-aaf4-477a-a03d-995a872bde15" acquired by "delete_volume" :: waited 0.024s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:48:38 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-8cf83a98-dd38-4d77-9fde-51a49edd528f tempest-SnapshotDependencyTests-422122416 None] Created reservations ['3cee60c1-69c3-4059-a455-bd39b14e949d', 'a2438c97-843e-4b66-b94e-e2c62896fdb8', 'a1f352ac-01ec-487e-b274-a558810a511c', 'a3fc80c1-b7ac-4ca5-a4e7-a010cd036f78'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:48:38 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4956c3-7cc0-42be-a0e3-dec76169e147]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:48:38 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-201e187e-11ce-47ba-ac3f-ca55a4d2c83a tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-30d0a164-aaf4-477a-a03d-995a872bde15 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:48:38 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-8cf83a98-dd38-4d77-9fde-51a49edd528f tempest-SnapshotDependencyTests-422122416 None] Delete snapshot completed successfully. Sep 10 21:48:38 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-8cf83a98-dd38-4d77-9fde-51a49edd528f tempest-SnapshotDependencyTests-422122416 None] Lock "cinder-4c21839b-5041-4390-bf0b-d88533238da3-delete_snapshot" released by "delete_snapshot" :: held 3.936s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:48:38 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-201e187e-11ce-47ba-ac3f-ca55a4d2c83a tempest-CreateVolumesFromSourceVolumeTest-543123483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-30d0a164-aaf4-477a-a03d-995a872bde15" returned: 0 in 0.626s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:48:38 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-201e187e-11ce-47ba-ac3f-ca55a4d2c83a tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-30d0a164-aaf4-477a-a03d-995a872bde15 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:48:38 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-201e187e-11ce-47ba-ac3f-ca55a4d2c83a tempest-CreateVolumesFromSourceVolumeTest-543123483 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-30d0a164-aaf4-477a-a03d-995a872bde15" returned: 0 in 0.103s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:48:38 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-201e187e-11ce-47ba-ac3f-ca55a4d2c83a tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Lock "cinder-quobyte-30d0a164-aaf4-477a-a03d-995a872bde15" released by "delete_volume" :: held 0.897s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:48:39 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-201e187e-11ce-47ba-ac3f-ca55a4d2c83a tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Created reservations ['9cdc8c66-c805-4212-84c1-a120e5759117', '92d6643a-cd12-4bf8-9465-c7791e997c96', 'db04a016-8f08-4f3e-9ef8-f8daefc964e3', 'ad67f8ef-471b-4850-816b-736b21e3ad1e'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:48:39 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-091e8daf-ccb3-4b5d-928e-18cbabee2dcb tempest-SnapshotDependencyTests-422122416 None] Acquiring lock "cinder-1f7662c6-07b8-422c-b9e4-4cf840d7677a-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:48:39 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-091e8daf-ccb3-4b5d-928e-18cbabee2dcb tempest-SnapshotDependencyTests-422122416 None] Lock "cinder-1f7662c6-07b8-422c-b9e4-4cf840d7677a-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:48:39 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-201e187e-11ce-47ba-ac3f-ca55a4d2c83a tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:48:39 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-201e187e-11ce-47ba-ac3f-ca55a4d2c83a tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:48:39 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-201e187e-11ce-47ba-ac3f-ca55a4d2c83a tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:48:39 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-201e187e-11ce-47ba-ac3f-ca55a4d2c83a tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:48:39 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-201e187e-11ce-47ba-ac3f-ca55a4d2c83a tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:48:39 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-201e187e-11ce-47ba-ac3f-ca55a4d2c83a tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:48:39 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-091e8daf-ccb3-4b5d-928e-18cbabee2dcb tempest-SnapshotDependencyTests-422122416 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:48:39 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-091e8daf-ccb3-4b5d-928e-18cbabee2dcb tempest-SnapshotDependencyTests-422122416 None] Acquiring lock "cinder-quobyte-1f7662c6-07b8-422c-b9e4-4cf840d7677a" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:48:39 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-201e187e-11ce-47ba-ac3f-ca55a4d2c83a tempest-CreateVolumesFromSourceVolumeTest-543123483 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.401s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:48:39 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-201e187e-11ce-47ba-ac3f-ca55a4d2c83a tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:48:39 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-201e187e-11ce-47ba-ac3f-ca55a4d2c83a tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Deleted volume successfully. Sep 10 21:48:40 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-091e8daf-ccb3-4b5d-928e-18cbabee2dcb tempest-SnapshotDependencyTests-422122416 None] Lock "cinder-quobyte-1f7662c6-07b8-422c-b9e4-4cf840d7677a" acquired by "delete_volume" :: waited 0.143s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:48:40 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ddf168f-b954-45ed-841f-1b69b00c0f0a]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:48:40 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-201e187e-11ce-47ba-ac3f-ca55a4d2c83a tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Lock "cinder-30d0a164-aaf4-477a-a03d-995a872bde15-delete_volume" released by "delete_volume" :: held 2.237s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:48:40 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-091e8daf-ccb3-4b5d-928e-18cbabee2dcb tempest-SnapshotDependencyTests-422122416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1f7662c6-07b8-422c-b9e4-4cf840d7677a {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:48:40 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-7a40d0a2-32f3-45a8-866c-d52870c02413 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Acquiring lock "cinder-7b0c040e-cf14-4301-9b78-8ff20ce65efb-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:48:40 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-7a40d0a2-32f3-45a8-866c-d52870c02413 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Lock "cinder-7b0c040e-cf14-4301-9b78-8ff20ce65efb-delete_volume" acquired by "delete_volume" :: waited 0.110s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:48:40 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-7a40d0a2-32f3-45a8-866c-d52870c02413 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:48:40 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-7a40d0a2-32f3-45a8-866c-d52870c02413 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Acquiring lock "cinder-quobyte-7b0c040e-cf14-4301-9b78-8ff20ce65efb" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:48:40 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-7a40d0a2-32f3-45a8-866c-d52870c02413 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Lock "cinder-quobyte-7b0c040e-cf14-4301-9b78-8ff20ce65efb" acquired by "delete_volume" :: waited 0.015s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:48:40 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-091e8daf-ccb3-4b5d-928e-18cbabee2dcb tempest-SnapshotDependencyTests-422122416 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1f7662c6-07b8-422c-b9e4-4cf840d7677a" returned: 0 in 0.684s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:48:40 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-091e8daf-ccb3-4b5d-928e-18cbabee2dcb tempest-SnapshotDependencyTests-422122416 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1f7662c6-07b8-422c-b9e4-4cf840d7677a {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:48:40 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[4763f0ab-3c00-4a69-b3c6-1a7cd0150e2c]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:48:40 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-7a40d0a2-32f3-45a8-866c-d52870c02413 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-7b0c040e-cf14-4301-9b78-8ff20ce65efb {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:48:41 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-091e8daf-ccb3-4b5d-928e-18cbabee2dcb tempest-SnapshotDependencyTests-422122416 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-1f7662c6-07b8-422c-b9e4-4cf840d7677a" returned: 0 in 0.207s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:48:41 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-091e8daf-ccb3-4b5d-928e-18cbabee2dcb tempest-SnapshotDependencyTests-422122416 None] Lock "cinder-quobyte-1f7662c6-07b8-422c-b9e4-4cf840d7677a" released by "delete_volume" :: held 1.089s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:48:41 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-091e8daf-ccb3-4b5d-928e-18cbabee2dcb tempest-SnapshotDependencyTests-422122416 None] Created reservations ['49cacbfe-823b-4652-8d53-a8474fcc16c1', 'da2080c4-fe03-47f5-9b05-6eb0972fb52c', 'ae1c2783-8914-4688-b2b4-95bcb16325d9', 'c4f27b06-eedf-4e77-b16c-3a587057fc00'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:48:41 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-7a40d0a2-32f3-45a8-866c-d52870c02413 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-7b0c040e-cf14-4301-9b78-8ff20ce65efb" returned: 0 in 0.601s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:48:41 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-7a40d0a2-32f3-45a8-866c-d52870c02413 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-7b0c040e-cf14-4301-9b78-8ff20ce65efb {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:48:41 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-7a40d0a2-32f3-45a8-866c-d52870c02413 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-7b0c040e-cf14-4301-9b78-8ff20ce65efb" returned: 0 in 0.247s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:48:41 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-7a40d0a2-32f3-45a8-866c-d52870c02413 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Lock "cinder-quobyte-7b0c040e-cf14-4301-9b78-8ff20ce65efb" released by "delete_volume" :: held 1.121s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:48:42 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-091e8daf-ccb3-4b5d-928e-18cbabee2dcb tempest-SnapshotDependencyTests-422122416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:48:42 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-091e8daf-ccb3-4b5d-928e-18cbabee2dcb tempest-SnapshotDependencyTests-422122416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:48:42 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-091e8daf-ccb3-4b5d-928e-18cbabee2dcb tempest-SnapshotDependencyTests-422122416 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:48:42 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-091e8daf-ccb3-4b5d-928e-18cbabee2dcb tempest-SnapshotDependencyTests-422122416 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:48:42 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-091e8daf-ccb3-4b5d-928e-18cbabee2dcb tempest-SnapshotDependencyTests-422122416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:48:42 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-091e8daf-ccb3-4b5d-928e-18cbabee2dcb tempest-SnapshotDependencyTests-422122416 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:48:42 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-7a40d0a2-32f3-45a8-866c-d52870c02413 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Created reservations ['72f9094b-1851-4068-a0e5-c06d2600898e', 'edd311f8-8c2d-4232-9949-d5a2fdaa80b0', '54fe6062-df0a-4766-8ee9-2259f4ee1e56', '91d0355c-0aa9-419e-beb8-9b950bf8e5a6'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:48:42 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-091e8daf-ccb3-4b5d-928e-18cbabee2dcb tempest-SnapshotDependencyTests-422122416 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.266s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:48:42 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-091e8daf-ccb3-4b5d-928e-18cbabee2dcb tempest-SnapshotDependencyTests-422122416 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:48:42 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-091e8daf-ccb3-4b5d-928e-18cbabee2dcb tempest-SnapshotDependencyTests-422122416 None] Deleted volume successfully. Sep 10 21:48:42 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-091e8daf-ccb3-4b5d-928e-18cbabee2dcb tempest-SnapshotDependencyTests-422122416 None] Lock "cinder-1f7662c6-07b8-422c-b9e4-4cf840d7677a-delete_volume" released by "delete_volume" :: held 3.179s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:48:42 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-7a40d0a2-32f3-45a8-866c-d52870c02413 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:48:42 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-7a40d0a2-32f3-45a8-866c-d52870c02413 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:48:42 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-7a40d0a2-32f3-45a8-866c-d52870c02413 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:48:42 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-7a40d0a2-32f3-45a8-866c-d52870c02413 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:48:42 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-7a40d0a2-32f3-45a8-866c-d52870c02413 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:48:42 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-7a40d0a2-32f3-45a8-866c-d52870c02413 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:48:43 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-7e0709c4-9f7e-457a-8a68-cdfbb2750595 tempest-SnapshotDependencyTests-422122416 None] Acquiring lock "cinder-e745d1c5-222b-4ff3-8e13-411a1d967133-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:48:43 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-7a40d0a2-32f3-45a8-866c-d52870c02413 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.326s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:48:43 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-7a40d0a2-32f3-45a8-866c-d52870c02413 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:48:43 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-7a40d0a2-32f3-45a8-866c-d52870c02413 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Deleted volume successfully. Sep 10 21:48:43 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-7e0709c4-9f7e-457a-8a68-cdfbb2750595 tempest-SnapshotDependencyTests-422122416 None] Lock "cinder-e745d1c5-222b-4ff3-8e13-411a1d967133-delete_volume" acquired by "delete_volume" :: waited 0.197s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:48:43 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-7a40d0a2-32f3-45a8-866c-d52870c02413 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Lock "cinder-7b0c040e-cf14-4301-9b78-8ff20ce65efb-delete_volume" released by "delete_volume" :: held 2.873s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:48:43 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-7e0709c4-9f7e-457a-8a68-cdfbb2750595 tempest-SnapshotDependencyTests-422122416 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:48:43 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-7e0709c4-9f7e-457a-8a68-cdfbb2750595 tempest-SnapshotDependencyTests-422122416 None] Acquiring lock "cinder-quobyte-e745d1c5-222b-4ff3-8e13-411a1d967133" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:48:43 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-7e0709c4-9f7e-457a-8a68-cdfbb2750595 tempest-SnapshotDependencyTests-422122416 None] Lock "cinder-quobyte-e745d1c5-222b-4ff3-8e13-411a1d967133" acquired by "delete_volume" :: waited 0.016s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:48:43 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e78cc57-1a5c-4c6b-92e5-5074bd9bd098]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:48:43 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-7e0709c4-9f7e-457a-8a68-cdfbb2750595 tempest-SnapshotDependencyTests-422122416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-e745d1c5-222b-4ff3-8e13-411a1d967133 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:48:43 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-629bb5b4-eada-46ae-9ce5-430c1044382f tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Acquiring lock "cinder-fac35bed-883e-4957-912d-663b9dd2673e-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:48:43 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-629bb5b4-eada-46ae-9ce5-430c1044382f tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Lock "cinder-fac35bed-883e-4957-912d-663b9dd2673e-delete_volume" acquired by "delete_volume" :: waited 0.103s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:48:43 devstack quobyte-client[82807]: System call of process 101699 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:48:44 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-7e0709c4-9f7e-457a-8a68-cdfbb2750595 tempest-SnapshotDependencyTests-422122416 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-e745d1c5-222b-4ff3-8e13-411a1d967133" returned: 0 in 0.633s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:48:44 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-7e0709c4-9f7e-457a-8a68-cdfbb2750595 tempest-SnapshotDependencyTests-422122416 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-e745d1c5-222b-4ff3-8e13-411a1d967133 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:48:44 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-629bb5b4-eada-46ae-9ce5-430c1044382f tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:48:44 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-629bb5b4-eada-46ae-9ce5-430c1044382f tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Acquiring lock "cinder-quobyte-fac35bed-883e-4957-912d-663b9dd2673e" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:48:44 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-7e0709c4-9f7e-457a-8a68-cdfbb2750595 tempest-SnapshotDependencyTests-422122416 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-e745d1c5-222b-4ff3-8e13-411a1d967133" returned: 0 in 0.405s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:48:44 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-629bb5b4-eada-46ae-9ce5-430c1044382f tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Lock "cinder-quobyte-fac35bed-883e-4957-912d-663b9dd2673e" acquired by "delete_volume" :: waited 0.073s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:48:44 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-7e0709c4-9f7e-457a-8a68-cdfbb2750595 tempest-SnapshotDependencyTests-422122416 None] Lock "cinder-quobyte-e745d1c5-222b-4ff3-8e13-411a1d967133" released by "delete_volume" :: held 1.153s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:48:44 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[1718f9c4-952b-4469-b38e-241c92ef0fe2]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:48:44 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-629bb5b4-eada-46ae-9ce5-430c1044382f tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-fac35bed-883e-4957-912d-663b9dd2673e {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:48:45 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-7e0709c4-9f7e-457a-8a68-cdfbb2750595 tempest-SnapshotDependencyTests-422122416 None] Created reservations ['288324a2-8277-45af-9b7e-23a3fb73909c', '0dd28cd6-33da-4add-b50a-8cd6a576cf60', '8618c8f7-9e98-41cd-b43d-5255cd7591ea', '6163d39e-e8bd-462d-b3e3-41e984ee8cbf'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:48:45 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-7e0709c4-9f7e-457a-8a68-cdfbb2750595 tempest-SnapshotDependencyTests-422122416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:48:45 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-7e0709c4-9f7e-457a-8a68-cdfbb2750595 tempest-SnapshotDependencyTests-422122416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:48:45 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-7e0709c4-9f7e-457a-8a68-cdfbb2750595 tempest-SnapshotDependencyTests-422122416 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:48:45 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-7e0709c4-9f7e-457a-8a68-cdfbb2750595 tempest-SnapshotDependencyTests-422122416 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:48:45 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-7e0709c4-9f7e-457a-8a68-cdfbb2750595 tempest-SnapshotDependencyTests-422122416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:48:45 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-7e0709c4-9f7e-457a-8a68-cdfbb2750595 tempest-SnapshotDependencyTests-422122416 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:48:45 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-629bb5b4-eada-46ae-9ce5-430c1044382f tempest-CreateVolumesFromSourceVolumeTest-543123483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-fac35bed-883e-4957-912d-663b9dd2673e" returned: 0 in 0.719s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:48:45 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-629bb5b4-eada-46ae-9ce5-430c1044382f tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-fac35bed-883e-4957-912d-663b9dd2673e {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:48:45 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-7e0709c4-9f7e-457a-8a68-cdfbb2750595 tempest-SnapshotDependencyTests-422122416 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.253s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:48:45 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-7e0709c4-9f7e-457a-8a68-cdfbb2750595 tempest-SnapshotDependencyTests-422122416 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:48:45 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-7e0709c4-9f7e-457a-8a68-cdfbb2750595 tempest-SnapshotDependencyTests-422122416 None] Deleted volume successfully. Sep 10 21:48:45 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-629bb5b4-eada-46ae-9ce5-430c1044382f tempest-CreateVolumesFromSourceVolumeTest-543123483 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-fac35bed-883e-4957-912d-663b9dd2673e" returned: 0 in 0.316s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:48:45 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-7e0709c4-9f7e-457a-8a68-cdfbb2750595 tempest-SnapshotDependencyTests-422122416 None] Lock "cinder-e745d1c5-222b-4ff3-8e13-411a1d967133-delete_volume" released by "delete_volume" :: held 2.531s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:48:45 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-629bb5b4-eada-46ae-9ce5-430c1044382f tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Lock "cinder-quobyte-fac35bed-883e-4957-912d-663b9dd2673e" released by "delete_volume" :: held 1.232s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:48:45 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-629bb5b4-eada-46ae-9ce5-430c1044382f tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Created reservations ['bb5d911d-0820-42d8-b2a3-b7e11999ff9a', 'a865fc16-1371-4b6e-ab1a-3bbed9660d14', '06d6e8d8-b0a8-4aad-bc0f-581f9f4eb5c1', '3137b96c-3d5b-4d09-8e76-116c09bd1442'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:48:46 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-629bb5b4-eada-46ae-9ce5-430c1044382f tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:48:46 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-629bb5b4-eada-46ae-9ce5-430c1044382f tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:48:46 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-629bb5b4-eada-46ae-9ce5-430c1044382f tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:48:46 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-629bb5b4-eada-46ae-9ce5-430c1044382f tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:48:46 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-629bb5b4-eada-46ae-9ce5-430c1044382f tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:48:46 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-629bb5b4-eada-46ae-9ce5-430c1044382f tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:48:46 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-629bb5b4-eada-46ae-9ce5-430c1044382f tempest-CreateVolumesFromSourceVolumeTest-543123483 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.122s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:48:46 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-629bb5b4-eada-46ae-9ce5-430c1044382f tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:48:46 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-629bb5b4-eada-46ae-9ce5-430c1044382f tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Deleted volume successfully. Sep 10 21:48:46 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-629bb5b4-eada-46ae-9ce5-430c1044382f tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Lock "cinder-fac35bed-883e-4957-912d-663b9dd2673e-delete_volume" released by "delete_volume" :: held 2.720s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:48:47 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-15944e8b-8e3e-417e-a180-decf92192db8 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Acquiring lock "cinder-0551d5bf-31b5-4f4e-b6bf-9733453e8804-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:48:47 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-15944e8b-8e3e-417e-a180-decf92192db8 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Lock "cinder-0551d5bf-31b5-4f4e-b6bf-9733453e8804-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:48:47 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-15944e8b-8e3e-417e-a180-decf92192db8 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:48:47 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-15944e8b-8e3e-417e-a180-decf92192db8 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Acquiring lock "cinder-quobyte-0551d5bf-31b5-4f4e-b6bf-9733453e8804" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:48:47 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-15944e8b-8e3e-417e-a180-decf92192db8 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Lock "cinder-quobyte-0551d5bf-31b5-4f4e-b6bf-9733453e8804" acquired by "delete_volume" :: waited 0.014s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:48:47 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[09386aab-f915-4ed3-b2f4-7130f566f8eb]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:48:47 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-15944e8b-8e3e-417e-a180-decf92192db8 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-0551d5bf-31b5-4f4e-b6bf-9733453e8804 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:48:48 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-15944e8b-8e3e-417e-a180-decf92192db8 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-0551d5bf-31b5-4f4e-b6bf-9733453e8804" returned: 0 in 0.512s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:48:48 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-15944e8b-8e3e-417e-a180-decf92192db8 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-0551d5bf-31b5-4f4e-b6bf-9733453e8804 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:48:48 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-15944e8b-8e3e-417e-a180-decf92192db8 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-0551d5bf-31b5-4f4e-b6bf-9733453e8804" returned: 0 in 0.130s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:48:48 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-15944e8b-8e3e-417e-a180-decf92192db8 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Lock "cinder-quobyte-0551d5bf-31b5-4f4e-b6bf-9733453e8804" released by "delete_volume" :: held 0.883s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:48:48 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-15944e8b-8e3e-417e-a180-decf92192db8 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Created reservations ['3ba4f672-7653-4cfc-998f-09cb02ec3d38', 'b54785b0-2d70-4d90-a096-a9146bd36b0f', '823d70c5-29d2-40ab-a13e-2dd68f44f0f5', 'd3472caf-66e8-4411-8423-51e3b25fbde8'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:48:49 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-15944e8b-8e3e-417e-a180-decf92192db8 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:48:49 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-15944e8b-8e3e-417e-a180-decf92192db8 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:48:49 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-15944e8b-8e3e-417e-a180-decf92192db8 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:48:49 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-15944e8b-8e3e-417e-a180-decf92192db8 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:48:49 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-15944e8b-8e3e-417e-a180-decf92192db8 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:48:49 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-15944e8b-8e3e-417e-a180-decf92192db8 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:48:49 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-15944e8b-8e3e-417e-a180-decf92192db8 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.130s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:48:49 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-15944e8b-8e3e-417e-a180-decf92192db8 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:48:49 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-15944e8b-8e3e-417e-a180-decf92192db8 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Deleted volume successfully. Sep 10 21:48:49 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-15944e8b-8e3e-417e-a180-decf92192db8 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Lock "cinder-0551d5bf-31b5-4f4e-b6bf-9733453e8804-delete_volume" released by "delete_volume" :: held 2.207s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:48:49 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-b974bfe2-a3e8-4352-a5ae-396627c47659 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Acquiring lock "cinder-c8c92dda-bae8-4a0a-9d28-adae19cccaa4-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:48:49 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-b974bfe2-a3e8-4352-a5ae-396627c47659 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Lock "cinder-c8c92dda-bae8-4a0a-9d28-adae19cccaa4-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:48:49 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-b974bfe2-a3e8-4352-a5ae-396627c47659 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:48:49 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-b974bfe2-a3e8-4352-a5ae-396627c47659 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Acquiring lock "cinder-quobyte-c8c92dda-bae8-4a0a-9d28-adae19cccaa4" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:48:49 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-b974bfe2-a3e8-4352-a5ae-396627c47659 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Lock "cinder-quobyte-c8c92dda-bae8-4a0a-9d28-adae19cccaa4" acquired by "delete_volume" :: waited 0.015s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:48:49 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[696d3634-dba8-41b3-ad0b-872f73322cc7]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:48:50 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b974bfe2-a3e8-4352-a5ae-396627c47659 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-c8c92dda-bae8-4a0a-9d28-adae19cccaa4 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:48:50 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b974bfe2-a3e8-4352-a5ae-396627c47659 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-c8c92dda-bae8-4a0a-9d28-adae19cccaa4" returned: 0 in 0.513s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:48:50 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b974bfe2-a3e8-4352-a5ae-396627c47659 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-c8c92dda-bae8-4a0a-9d28-adae19cccaa4 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:48:50 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b974bfe2-a3e8-4352-a5ae-396627c47659 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-c8c92dda-bae8-4a0a-9d28-adae19cccaa4" returned: 0 in 0.120s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:48:50 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-b974bfe2-a3e8-4352-a5ae-396627c47659 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Lock "cinder-quobyte-c8c92dda-bae8-4a0a-9d28-adae19cccaa4" released by "delete_volume" :: held 0.815s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:48:51 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-b974bfe2-a3e8-4352-a5ae-396627c47659 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Created reservations ['d2255fd1-074b-4a12-95bc-8e8d9062fce9', 'fcc87275-e574-4298-ab6c-16cc94c6dc8a', '7a61b4c1-22e2-4765-8520-2ee920074cc0', '5b96aba9-983d-4776-8cea-6d8d468f299e'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:48:51 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-b974bfe2-a3e8-4352-a5ae-396627c47659 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:48:51 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-b974bfe2-a3e8-4352-a5ae-396627c47659 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:48:51 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-b974bfe2-a3e8-4352-a5ae-396627c47659 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:48:51 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-b974bfe2-a3e8-4352-a5ae-396627c47659 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:48:51 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-b974bfe2-a3e8-4352-a5ae-396627c47659 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:48:51 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b974bfe2-a3e8-4352-a5ae-396627c47659 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:48:51 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-b974bfe2-a3e8-4352-a5ae-396627c47659 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.113s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:48:51 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-b974bfe2-a3e8-4352-a5ae-396627c47659 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:48:51 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-b974bfe2-a3e8-4352-a5ae-396627c47659 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Deleted volume successfully. Sep 10 21:48:51 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-b974bfe2-a3e8-4352-a5ae-396627c47659 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Lock "cinder-c8c92dda-bae8-4a0a-9d28-adae19cccaa4-delete_volume" released by "delete_volume" :: held 1.932s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:48:52 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-dd17f251-6c1c-4af2-8f04-77302e24c195 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Acquiring lock "cinder-cc022d0a-2969-4445-b3c0-8e6a3c956966-delete_volume" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:48:52 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-dd17f251-6c1c-4af2-8f04-77302e24c195 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Lock "cinder-cc022d0a-2969-4445-b3c0-8e6a3c956966-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:48:52 devstack cinder-volume[82780]: WARNING cinder.volume.volume_utils [None req-dd17f251-6c1c-4af2-8f04-77302e24c195 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 21:48:52 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-dd17f251-6c1c-4af2-8f04-77302e24c195 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Acquiring lock "cinder-quobyte-cc022d0a-2969-4445-b3c0-8e6a3c956966" by "delete_volume" {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 21:48:52 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-dd17f251-6c1c-4af2-8f04-77302e24c195 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Lock "cinder-quobyte-cc022d0a-2969-4445-b3c0-8e6a3c956966" acquired by "delete_volume" :: waited 0.019s {{(pid=82780) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 21:48:52 devstack cinder-volume[82780]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c3fce8-8d40-4c92-9f00-5ce77f08fc35]: (4, 'qcow2') {{(pid=83915) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 21:48:52 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-dd17f251-6c1c-4af2-8f04-77302e24c195 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-cc022d0a-2969-4445-b3c0-8e6a3c956966 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:48:53 devstack quobyte-client[82807]: System call of process 101724 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 21:48:53 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-dd17f251-6c1c-4af2-8f04-77302e24c195 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-cc022d0a-2969-4445-b3c0-8e6a3c956966" returned: 0 in 0.590s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:48:53 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-dd17f251-6c1c-4af2-8f04-77302e24c195 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-cc022d0a-2969-4445-b3c0-8e6a3c956966 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:48:53 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-dd17f251-6c1c-4af2-8f04-77302e24c195 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] CMD "rm -f /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44/volume-cc022d0a-2969-4445-b3c0-8e6a3c956966" returned: 0 in 0.122s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:48:53 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-dd17f251-6c1c-4af2-8f04-77302e24c195 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Lock "cinder-quobyte-cc022d0a-2969-4445-b3c0-8e6a3c956966" released by "delete_volume" :: held 0.919s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:48:53 devstack cinder-volume[82780]: DEBUG cinder.quota [None req-dd17f251-6c1c-4af2-8f04-77302e24c195 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Created reservations ['acc88d3d-8819-46f2-a967-ce71c313497c', '71dbe9d8-c1a4-41e9-b6eb-38f81c782c4d', '7d2c0f1d-5f25-4244-af9c-4c93294544e7', 'a75f5050-2744-4729-a003-f656e40c3f35'] {{(pid=82780) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 21:48:53 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-dd17f251-6c1c-4af2-8f04-77302e24c195 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:48:53 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-dd17f251-6c1c-4af2-8f04-77302e24c195 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:48:53 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-dd17f251-6c1c-4af2-8f04-77302e24c195 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:48:53 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-dd17f251-6c1c-4af2-8f04-77302e24c195 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:48:53 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-dd17f251-6c1c-4af2-8f04-77302e24c195 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:48:53 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-dd17f251-6c1c-4af2-8f04-77302e24c195 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:48:54 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-dd17f251-6c1c-4af2-8f04-77302e24c195 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.126s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:48:54 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-dd17f251-6c1c-4af2-8f04-77302e24c195 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:48:54 devstack cinder-volume[82780]: INFO cinder.volume.manager [None req-dd17f251-6c1c-4af2-8f04-77302e24c195 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Deleted volume successfully. Sep 10 21:48:54 devstack cinder-volume[82780]: DEBUG cinder.coordination [None req-dd17f251-6c1c-4af2-8f04-77302e24c195 tempest-CreateVolumesFromSourceVolumeTest-543123483 None] Lock "cinder-cc022d0a-2969-4445-b3c0-8e6a3c956966-delete_volume" released by "delete_volume" :: held 2.173s {{(pid=82780) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 21:48:57 devstack cinder-volume[82780]: DEBUG oslo_service.periodic_task [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82780) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 21:48:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 21:48:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 21:48:57 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b': None} {{(pid=82780) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 21:48:57 devstack cinder-volume[82780]: DEBUG cinder.volume.drivers.quobyte [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Available shares ['10.10.41.181/cinder-vol-4740f49d-cb5a-4d0b-ae1e-c5c2e484906b'] {{(pid=82780) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 21:48:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.lockutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82780) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 21:48:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44 {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 21:48:57 devstack cinder-volume[82780]: DEBUG oslo_concurrency.processutils [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bf00554aadb3d87cf242b1178e32a44" returned: 0 in 0.124s {{(pid=82780) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 21:48:57 devstack cinder-volume[82780]: DEBUG cinder.manager [None req-a07edcff-6328-4c1c-841c-2918f91dca04 None None] Notifying Schedulers of capabilities ... {{(pid=82780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 21:49:03 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=82,cinder:INSERT=32,cinder:UPDATE=125,cinder:DELETE=13 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 21:49:04 devstack cinder-volume[82780]: DEBUG dbcounter [-] [82780] Writing DB stats cinder:SELECT=87,cinder:INSERT=28,cinder:UPDATE=138,cinder:DELETE=9 {{(pid=82780) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}